-- Logs begin at Tue 2022-01-11 14:18:52 UTC, end at Tue 2022-01-11 15:57:05 UTC. -- Jan 11 15:02:23.141393 dv-cinder-824187-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 11 15:02:23.151986 dv-cinder-824187-2-iscsi devstack@n-api.service[102447]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 11 15:02:23.154048 dv-cinder-824187-2-iscsi devstack@n-api.service[102447]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jan 11 15:02:23 2022] *** Jan 11 15:02:23.154048 dv-cinder-824187-2-iscsi devstack@n-api.service[102447]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 11 15:02:23.154048 dv-cinder-824187-2-iscsi devstack@n-api.service[102447]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 11 15:02:23.154048 dv-cinder-824187-2-iscsi devstack@n-api.service[102447]: nodename: dv-cinder-824187-2-iscsi Jan 11 15:02:23.154048 dv-cinder-824187-2-iscsi devstack@n-api.service[102447]: machine: x86_64 Jan 11 15:02:23.154048 dv-cinder-824187-2-iscsi devstack@n-api.service[102447]: clock source: unix Jan 11 15:02:23.154048 dv-cinder-824187-2-iscsi devstack@n-api.service[102447]: pcre jit disabled Jan 11 15:02:23.154048 dv-cinder-824187-2-iscsi devstack@n-api.service[102447]: detected number of CPU cores: 4 Jan 11 15:02:23.154048 dv-cinder-824187-2-iscsi devstack@n-api.service[102447]: current working directory: / Jan 11 15:02:23.154048 dv-cinder-824187-2-iscsi devstack@n-api.service[102447]: detected binary path: /usr/bin/uwsgi-core Jan 11 15:02:23.154048 dv-cinder-824187-2-iscsi devstack@n-api.service[102447]: your processes number limit is 47680 Jan 11 15:02:23.154819 dv-cinder-824187-2-iscsi devstack@n-api.service[102447]: your memory page size is 4096 bytes Jan 11 15:02:23.154819 dv-cinder-824187-2-iscsi devstack@n-api.service[102447]: detected max file descriptor number: 2048 Jan 11 15:02:23.154819 dv-cinder-824187-2-iscsi devstack@n-api.service[102447]: lock engine: pthread robust mutexes Jan 11 15:02:23.154819 dv-cinder-824187-2-iscsi devstack@n-api.service[102447]: thunder lock: enabled Jan 11 15:02:23.154819 dv-cinder-824187-2-iscsi devstack@n-api.service[102447]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 11 15:02:23.154819 dv-cinder-824187-2-iscsi devstack@n-api.service[102447]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 11 15:02:23.205194 dv-cinder-824187-2-iscsi devstack@n-api.service[102447]: Python main interpreter initialized at 0x5561156119c0 Jan 11 15:02:23.205194 dv-cinder-824187-2-iscsi devstack@n-api.service[102447]: python threads support enabled Jan 11 15:02:23.205194 dv-cinder-824187-2-iscsi devstack@n-api.service[102447]: your server socket listen backlog is limited to 100 connections Jan 11 15:02:23.205194 dv-cinder-824187-2-iscsi devstack@n-api.service[102447]: your mercy for graceful operations on workers is 90 seconds Jan 11 15:02:23.205546 dv-cinder-824187-2-iscsi devstack@n-api.service[102447]: mapped 403077 bytes (393 KB) for 2 cores Jan 11 15:02:23.205623 dv-cinder-824187-2-iscsi devstack@n-api.service[102447]: *** Operational MODE: preforking *** Jan 11 15:02:23.205825 dv-cinder-824187-2-iscsi devstack@n-api.service[102447]: *** uWSGI is running in multiple interpreter mode *** Jan 11 15:02:23.205825 dv-cinder-824187-2-iscsi devstack@n-api.service[102447]: spawned uWSGI master process (pid: 102447) Jan 11 15:02:23.206018 dv-cinder-824187-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 11 15:02:23.207112 dv-cinder-824187-2-iscsi devstack@n-api.service[102447]: spawned uWSGI worker 1 (pid: 102448, cores: 1) Jan 11 15:02:23.207112 dv-cinder-824187-2-iscsi devstack@n-api.service[102447]: spawned uWSGI worker 2 (pid: 102449, cores: 1) Jan 11 15:02:23.207112 dv-cinder-824187-2-iscsi devstack@n-api.service[102447]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 11 15:02:24.956344 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 11 15:02:24.956344 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: from cryptography.utils import int_from_bytes Jan 11 15:02:24.957024 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 11 15:02:24.957024 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: from cryptography.utils import int_from_bytes Jan 11 15:02:24.958016 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 11 15:02:24.958016 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: from cryptography.utils import int_from_bytes Jan 11 15:02:24.958499 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 11 15:02:24.958499 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: from cryptography.utils import int_from_bytes Jan 11 15:02:27.519315 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 11 15:02:27.519854 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 11 15:02:27.520056 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 11 15:02:27.520413 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 11 15:02:27.520679 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 11 15:02:27.521061 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.521149 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 11 15:02:27.521521 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 11 15:02:27.521604 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.521688 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.521823 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 11 15:02:27.522002 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.522195 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 11 15:02:27.522337 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.522462 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 11 15:02:27.522650 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.522860 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.522974 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.523197 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.523325 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.523556 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.523655 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.523884 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.523977 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.524198 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.524298 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.524524 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-824187-2-iscsi {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.524611 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.524849 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.524963 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.525159 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.525254 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.525471 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.526045 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.526275 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.526370 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.526601 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.526698 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.526919 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.527010 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-824187-2-iscsi {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.527226 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.527332 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.527582 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.527761 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.527903 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.528870 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.529015 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.529129 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.529222 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.529358 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.529478 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.529612 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.529732 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.529856 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.529983 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.530117 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.530252 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.530381 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.530501 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.530628 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.530775 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.530907 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.531029 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.531158 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.531280 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.531444 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-824187-2-iscsi {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.531576 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.531720 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.531845 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.531974 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.532168 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.532321 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.532502 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.532662 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.532867 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.533060 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.533250 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-824187-2-iscsi {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.533438 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.533604 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.533764 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.533925 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.534095 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.534305 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.534465 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.534597 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.534726 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.534879 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.535010 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.535169 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.535314 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.535451 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.535591 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.535722 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.535851 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.536026 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.536161 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.536339 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.536508 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.536712 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.536838 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.536959 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.537079 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.537249 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.537388 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.537518 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.537640 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.537799 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.537958 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.538130 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.538265 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.538456 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.538590 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.538780 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.538915 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.539045 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.539226 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.539375 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.539501 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.539635 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.539771 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.539905 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.540080 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.540207 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.540412 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.540547 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.540745 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.540885 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.541015 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.541138 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.541856 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.542001 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.542125 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.542325 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.542461 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.542586 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.542762 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.542898 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.543080 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.543218 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.543435 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.543564 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.543756 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.543900 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.544072 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.544204 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.544387 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.544523 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.544702 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.544841 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.545020 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.545155 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.545332 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.545465 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.545654 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.545789 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.545982 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.546114 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.546293 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.546420 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.546615 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.546833 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.546962 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.547085 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.547236 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.547394 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.547570 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.547705 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.547886 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.548020 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.548208 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.548362 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.548540 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.548672 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.548842 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.548967 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.549096 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.549227 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.549383 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.549510 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.549691 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.549824 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.550012 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.550148 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.550321 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.550450 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.550628 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.550764 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.550935 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.551071 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.551236 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.551393 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.551577 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.551710 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.551888 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.552027 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.552197 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.552373 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.552500 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.552622 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.552797 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.552935 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.553103 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.553236 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.553411 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.553536 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.553715 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.553835 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.554022 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.554149 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.554335 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.554467 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.554651 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.554785 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.554956 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.555082 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.555263 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.555421 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.555596 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.555723 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.555908 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.556045 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.556220 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.556368 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.556527 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.556653 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.556868 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.557012 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.557178 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.557305 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.557486 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.557617 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.557793 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.557921 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.558108 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.558242 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.558400 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.558524 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.558708 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.558836 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.559029 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.559156 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.559367 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.559496 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.559651 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.559777 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.559970 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.560096 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.560279 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.560419 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.560588 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.560721 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.560894 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.561095 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.561221 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.561350 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.561493 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.561620 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.561800 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.561936 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.562105 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.562232 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.562411 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.562530 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.562713 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.562849 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.563030 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.563154 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.563364 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.563495 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.563680 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.563818 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.563990 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.564123 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.564293 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.564419 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.564604 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.564730 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.564916 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.565048 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.565242 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.565368 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.565574 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.565701 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.565884 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.566009 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.566197 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.566322 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.566513 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.566642 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.566841 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.567047 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:02:27.567175 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.567340 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.567482 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.567608 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.567800 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.567927 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.568119 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.568254 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.568432 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.568559 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.568743 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.568872 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.569063 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.569202 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.569380 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.569514 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.569710 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.569842 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.570028 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.570167 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.570345 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.570472 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.570663 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.570800 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.570974 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.571116 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.571313 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.571443 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.571641 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.571778 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.571961 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.572095 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.572274 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.572401 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.573116 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.573243 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.573448 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.573583 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.573760 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.573887 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.574083 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.574208 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.574394 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.574528 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.574717 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.574845 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.575032 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.575158 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.575368 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.575497 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.575686 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.575813 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.576017 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.576152 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.576331 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.576458 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.576645 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.576781 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.576982 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.577202 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.577337 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.577459 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.577586 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.577713 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.577895 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.578031 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.578200 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.578328 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.578511 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.578637 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.578822 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.578962 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.579127 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.579259 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.579474 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.579614 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.579802 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.579939 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.580112 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.580243 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.580433 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.580569 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.580736 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.580874 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.581047 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.581174 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.581357 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.581482 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.581660 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.581786 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.581971 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.582176 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.582312 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.582435 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.582567 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.582697 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.582882 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.583016 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.583194 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.583358 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.583527 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.583662 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.583849 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.583983 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.584156 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.584306 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.584511 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.584643 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.584766 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.584894 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.585061 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.585197 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.585373 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.585494 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.585683 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.585817 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.586008 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.586144 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.586320 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.586455 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.586631 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.586757 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.586964 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.587104 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.587355 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.587486 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.587608 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.587742 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.587922 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.588062 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.588813 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.588942 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.589134 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.589271 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.589442 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.589570 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.589754 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.589881 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.590060 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.590187 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.590366 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.590501 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.590670 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.590804 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.590979 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.591107 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.591307 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.591440 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.591617 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.591747 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.591925 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.592059 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.592231 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.592359 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.592536 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.592663 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.592859 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.593000 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.593167 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.593286 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.593473 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.593606 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.593778 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.593914 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.594082 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.594215 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.594392 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.594517 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.594706 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.594842 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.595036 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.595163 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.595390 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.595530 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.595709 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.595845 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.596026 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.596160 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.596339 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.596465 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.596659 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.596787 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.596972 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.597099 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.597353 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.597491 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.597624 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.597748 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.597897 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.598027 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.598218 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.598346 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.598532 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.598660 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.598860 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.598987 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.599174 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.599362 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.599527 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.599662 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.599841 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.599969 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.600158 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.600296 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.600464 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.600590 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.600780 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.600908 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.601105 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.601244 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.601431 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.601558 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.601747 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.601873 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.602071 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.602212 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.602383 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.602510 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.602692 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.602822 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.603002 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.603139 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.603326 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.603457 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.603644 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.603773 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.603983 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.604126 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.604306 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.604440 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.604619 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.604752 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.604939 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.605068 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.605253 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.605382 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.605580 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.605707 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.605892 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.606027 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.606209 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.606334 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.606514 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.606640 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.606829 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.606957 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.607152 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.607325 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.607534 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.607662 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.607802 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.607926 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.608114 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.608241 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.608438 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.608575 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.608748 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.608881 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.609059 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.609185 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.609371 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.609508 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.609677 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.609805 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.609983 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.610110 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.610292 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.610431 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.610607 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.610734 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.610917 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.611045 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.611228 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.611400 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.611542 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.611668 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.611861 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.611998 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.612170 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.612298 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.612476 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.612853 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.613037 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.613164 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.613349 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.613479 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.613665 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.613792 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.613974 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.614106 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.614315 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.614446 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.614593 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.614721 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.614898 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.615023 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.615205 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.615351 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.615549 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.615745 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.615873 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.616061 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.616202 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.616371 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.616497 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.616679 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.616806 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.616987 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.617116 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.617332 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.617466 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.617663 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.617798 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.617932 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.618063 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.618244 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.618379 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.618565 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.618700 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.618881 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.619011 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.619195 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.619354 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.619554 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.619677 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.619869 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.619998 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.620193 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.620321 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.620508 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.620644 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.620820 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.620948 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.621132 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.621259 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.621440 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.621577 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.621751 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.621879 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.622062 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.622191 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.622384 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.622521 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.622691 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.622816 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.623001 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.623135 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.623347 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.623497 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.623622 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.623745 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.623935 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.624063 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.624253 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.624382 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.624580 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.624819 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.624947 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.625152 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.625290 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.625471 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.625605 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.625791 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.625918 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.626112 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.626248 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.626432 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.626680 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.626807 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.627023 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.627158 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.627372 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.627503 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.627706 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.627824 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.628017 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.628128 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.628323 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.628421 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.628631 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.628726 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.628948 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.629052 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.629254 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.629348 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.629559 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.629654 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.629865 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.629968 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.630175 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.630270 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.630480 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.630579 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.630788 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.630883 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.631103 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.631196 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.631445 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.631542 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.631760 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.631862 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.632067 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.632161 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.632378 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.632480 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.632680 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.632782 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.633003 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.633097 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.633312 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.633406 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.633619 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.633767 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.633925 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.634063 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.634230 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.634359 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.634542 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.634664 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.634864 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.635500 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.635745 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.635873 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.636066 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.636194 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.636382 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.636512 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.636698 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.636835 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.637003 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.637139 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.637331 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.637460 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.637640 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.637789 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.637984 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.638122 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.638247 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.638376 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.638533 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.638661 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.638843 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.639008 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.639145 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.639270 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.639479 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.639615 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.639792 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.639929 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.640101 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.640252 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.640409 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.640538 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.640713 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.640850 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.641022 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.641159 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.641327 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.641455 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.641641 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.641780 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.641950 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.642080 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.642252 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.642380 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.642556 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.642685 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.642866 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.642994 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.643173 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.643328 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.643512 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.643641 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.643822 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.643949 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.644124 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.644254 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.644436 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.644564 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.644737 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.644863 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.645041 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.645178 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.645344 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.645472 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.645652 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.645780 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.645959 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.646093 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.646259 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.646385 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.646581 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.646707 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.646889 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.647023 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.647195 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.647354 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.647557 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.647817 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.648024 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.648304 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.648522 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.648710 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.648886 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.649033 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.649179 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.649325 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.649462 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.649613 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.649753 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.649908 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.650190 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.650468 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.651275 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.651438 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.651641 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.651807 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.651966 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.652104 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.652254 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.652434 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.652680 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.652902 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.653050 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.653148 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.653238 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.653325 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.653413 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.653510 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.653598 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.653688 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.653777 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.653866 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.653939 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.654029 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.654115 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.654194 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.654278 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.654364 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.654449 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.654541 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.654627 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.654765 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.654923 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.655059 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.655233 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.655412 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.655620 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.655755 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.655930 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.656064 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.656248 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.656377 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.656569 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.656704 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.656883 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.657023 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.657198 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.657332 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.657513 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.657647 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.657821 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.657955 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.658138 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.658355 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.658484 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.658613 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.658743 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.658901 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.659044 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.659176 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.659363 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.659507 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.659690 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.659827 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.660003 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.660132 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.660316 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.660456 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.660639 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.660775 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.660962 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.661105 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.661257 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.661391 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.661582 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.661720 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.661892 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.662022 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.662204 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.662350 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.662514 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.662653 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.662824 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.662951 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.663133 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.663267 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.663459 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.663593 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.663771 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.663905 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.664084 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.664220 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.664378 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.664503 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.664694 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.664827 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.665002 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.665131 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.665314 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.665451 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.665626 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.665771 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.665934 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.666061 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.666287 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.666440 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.666599 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.666747 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.666906 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.667041 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.667218 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.667397 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.667553 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.667680 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.667866 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.668006 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.668175 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.668302 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.668515 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.668643 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.668796 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.668939 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.669115 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.669244 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.669427 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.669562 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.669749 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.669905 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.670062 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.671352 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.671352 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.671606 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.671739 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.671893 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.672031 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.672162 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.672308 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.672452 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.672585 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.672709 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.672822 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.672972 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.673135 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.673270 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.673499 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.673657 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.673808 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.673960 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.674113 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.674251 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.674385 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.674544 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.674726 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.674882 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.675039 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.675175 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.675329 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.675470 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.675613 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.675760 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.675891 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.676031 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.676141 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.676252 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.676359 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.676464 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.676581 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.676716 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.676847 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.676991 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.676991 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.677250 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.677382 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.677523 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.677649 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.677783 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.677783 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.678029 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.678159 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.678448 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.678701 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.678852 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.678987 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.679121 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.679259 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.679478 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.679620 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.679752 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.679882 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.680007 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.680162 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.680291 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.680414 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.680543 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.680667 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.680811 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.680962 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.681087 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.681218 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.681370 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.681526 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.681679 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.681836 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.681972 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.682125 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.682289 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.682428 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.682574 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.682731 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.682867 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.683044 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.683179 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.683389 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.683532 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.683720 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.683910 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.684053 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.684179 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.684304 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.684488 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.684623 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.684822 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.684952 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.685142 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.685276 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.685475 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.685604 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.685798 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.685926 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.686113 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.686269 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.686421 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.686548 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.686730 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.686860 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.687035 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.687171 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.687348 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.687496 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.687676 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.687806 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.687981 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.688109 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.688298 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.688437 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.688610 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.688823 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.688960 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.689090 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.689217 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.689353 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.689520 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.689663 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.689845 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.689972 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.690154 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.690328 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.690455 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.690578 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.690750 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.690887 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.691055 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.691193 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.691426 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.691568 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.691737 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.691873 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.692060 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.692190 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.692377 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.692532 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.692693 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.692822 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.693008 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.693141 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.693316 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.693445 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.693655 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.693791 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.693972 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.694101 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.694292 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.694433 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.694619 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.694759 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.694924 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.695052 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.695232 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.695393 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.695569 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.695710 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.695877 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.696006 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.696185 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.696315 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.696491 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.696629 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.696800 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.696929 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.697105 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.697240 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.697411 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.698130 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.698259 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.698384 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.698582 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.698729 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.698942 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.699073 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.699198 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.699352 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.699481 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.699611 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.699794 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.699939 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.700101 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.700230 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.700406 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.700535 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.700735 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.700871 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.701046 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.701173 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.701373 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.701501 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.701690 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.701826 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.701998 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.702144 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.702313 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.702448 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.702627 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.702761 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.702952 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.703083 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.703271 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.703457 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.703611 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.703741 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.703929 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.704065 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.704245 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.704383 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.704562 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.704691 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.704881 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.705008 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.705195 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.705396 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.705529 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.705662 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.705808 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.705944 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.706123 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.706253 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.706437 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.706572 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.706759 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.706976 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.707115 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.707333 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.707466 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.707658 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.707795 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.707976 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.708114 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.708293 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.708422 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.708609 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.708744 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.708978 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.709191 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.709322 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.709533 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.709669 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.709850 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.709985 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.710163 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.710293 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.710482 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.710608 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.710804 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.710939 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.711126 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.711271 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.711476 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.711617 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.711796 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.711932 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.712113 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.712252 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.712427 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.712567 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.712743 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.712879 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.713099 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.713712 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.713955 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.714092 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.714298 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.714427 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.714616 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.714745 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.714936 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.715074 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.715256 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.715417 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.715596 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.715732 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.715912 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.716053 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.716230 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.716365 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.716546 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.716675 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.716860 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.716996 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.717172 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.717310 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.717486 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.717616 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.717801 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.717937 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.718118 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.718248 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.718445 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.718574 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.718764 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.718892 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.719096 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.719232 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.719435 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.719563 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.719722 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.719858 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.720041 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.720245 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.720374 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.720565 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.720696 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.720903 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.721032 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.721233 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.721368 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.721561 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.721698 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.721878 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.722008 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.722197 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.722473 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.722616 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.722802 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.722938 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.723119 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.723246 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.723460 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.723590 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.723776 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.723900 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.724086 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.724214 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.724435 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.724569 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.724725 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.724855 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.725035 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.725175 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.725359 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.725494 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.725672 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.725817 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.725991 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.726205 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.726346 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.726552 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.726681 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.726872 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.727008 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.727201 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.727369 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.727556 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.727687 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.727876 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.728006 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.728187 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.728416 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.728546 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.728797 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.728935 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.729203 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.729352 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.729480 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.729603 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.729748 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.729888 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.730055 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.730194 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.730364 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.730500 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.730678 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.730806 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.730991 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.731121 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.731313 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.731454 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.731636 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.731777 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.731946 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.732077 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.732271 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.732409 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.732578 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.732705 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.732886 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.733022 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.733192 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.733322 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.733504 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.733631 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.733809 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.733936 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.734116 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.734244 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.734424 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.734561 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.734731 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.734859 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.735042 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.735178 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.735371 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.735584 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.735703 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.735827 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.735980 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.736109 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.736292 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.736434 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.736598 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.736727 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.736908 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.737036 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.737209 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.737345 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.737530 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.737902 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.738089 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.738228 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.738395 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.738536 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.738708 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.738844 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.739018 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.739154 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.739341 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.739554 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.739686 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.739818 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.739967 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.740094 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.740272 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.740401 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.740587 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.740724 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.740910 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.741132 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.741270 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.741513 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.741644 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.741838 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.741974 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.742154 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.742282 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.742514 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.742643 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.742827 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.742956 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.743137 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.743392 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.743525 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.743789 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.743930 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.744122 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.744264 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.744477 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.744605 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.744793 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.744921 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.745106 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.745247 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.745419 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.745546 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.745732 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.745861 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.746043 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.746172 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.746354 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.746489 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.746668 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.746797 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.746985 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.747113 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.747312 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.747452 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.747642 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.747775 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.747962 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.748091 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.748276 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.748402 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.748591 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.748729 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.748902 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.749029 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.749213 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.749340 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.749576 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.749724 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.749857 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.749983 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.750140 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.750269 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.750472 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.750616 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.750785 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.750922 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.751095 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.751224 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.751439 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.751569 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.751760 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.751890 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.752082 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.752211 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.752414 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.752547 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.752740 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.752874 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.753060 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.753197 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.753375 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.753504 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.753684 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.753812 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.754009 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.754147 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.754322 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.754450 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.754652 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.754781 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.754990 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.755129 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.755342 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.755476 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.755674 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.755803 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.755985 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.756123 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.756293 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.756423 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.756599 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.756728 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.756912 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.757043 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.757242 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.757373 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.757581 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.757711 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.757900 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.758029 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.758210 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.758337 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.758524 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.758650 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.758835 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.758964 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.759146 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.759279 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.759495 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.759639 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.759840 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.760482 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.760644 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.760773 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.760958 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.761096 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.761289 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.761416 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.761601 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.761734 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.761916 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.762054 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.762229 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.762357 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.762543 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.762673 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.762855 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.762993 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.763169 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.763350 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.763524 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.763654 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.763848 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.763991 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.764153 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.764273 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.764475 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.764610 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.764791 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.764919 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.765103 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.765232 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.765418 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.765546 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.765744 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.765885 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.766047 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.766177 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.766359 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.766489 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.766678 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.766809 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.766990 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.767119 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.767316 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.767460 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.767647 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.767777 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.767964 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.768091 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.768290 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.768426 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.768606 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.768740 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.768931 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.769067 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.769250 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.769431 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.769567 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.769700 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.769882 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.770006 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.770208 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.770309 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.770542 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.770639 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.770856 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.770951 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.771172 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.771268 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.771510 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.771606 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.771756 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 11 15:02:27.771875 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.772199 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.772552 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.772895 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.773217 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.773540 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.773854 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:02:27.774107 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 11 15:02:27.794749 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG oslo_db.sqlalchemy.engines [None req-293b814c-c114-428a-bf09-12081c337bd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102448) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 15:02:27.797962 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG oslo_db.sqlalchemy.engines [None req-616eb5df-a9eb-4ee2-951f-75bd819f2d50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 15:02:27.861309 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.context [None req-293b814c-c114-428a-bf09-12081c337bd5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),46615978-60dd-434d-8e14-87d57df7a39e(cell1) {{(pid=102448) load_cells /opt/stack/nova/nova/context.py:464}} Jan 11 15:02:27.865601 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.context [None req-616eb5df-a9eb-4ee2-951f-75bd819f2d50 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),46615978-60dd-434d-8e14-87d57df7a39e(cell1) {{(pid=102449) load_cells /opt/stack/nova/nova/context.py:464}} Jan 11 15:02:27.865762 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG oslo_concurrency.lockutils [None req-293b814c-c114-428a-bf09-12081c337bd5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:02:27.867355 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG oslo_concurrency.lockutils [None req-293b814c-c114-428a-bf09-12081c337bd5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:02:27.868162 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG oslo_concurrency.lockutils [None req-293b814c-c114-428a-bf09-12081c337bd5 None None] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:02:27.869813 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-616eb5df-a9eb-4ee2-951f-75bd819f2d50 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:02:27.870118 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG oslo_concurrency.lockutils [None req-293b814c-c114-428a-bf09-12081c337bd5 None None] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:02:27.871431 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-616eb5df-a9eb-4ee2-951f-75bd819f2d50 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:02:27.872258 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-616eb5df-a9eb-4ee2-951f-75bd819f2d50 None None] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:02:27.874186 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-616eb5df-a9eb-4ee2-951f-75bd819f2d50 None None] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:02:27.880550 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG oslo_db.sqlalchemy.engines [None req-293b814c-c114-428a-bf09-12081c337bd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102448) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 15:02:27.881370 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG oslo_db.sqlalchemy.engines [None req-293b814c-c114-428a-bf09-12081c337bd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102448) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 15:02:27.886546 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG oslo_db.sqlalchemy.engines [None req-616eb5df-a9eb-4ee2-951f-75bd819f2d50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 15:02:27.891139 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG oslo_db.sqlalchemy.engines [None req-616eb5df-a9eb-4ee2-951f-75bd819f2d50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 15:02:28.050109 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG oslo_db.sqlalchemy.engines [None req-293b814c-c114-428a-bf09-12081c337bd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102448) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 15:02:28.053141 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG oslo_db.sqlalchemy.engines [None req-616eb5df-a9eb-4ee2-951f-75bd819f2d50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 15:02:28.440517 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: WARNING keystonemiddleware.auth_token [None req-293b814c-c114-428a-bf09-12081c337bd5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 11 15:02:28.447176 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: WARNING keystonemiddleware.auth_token [None req-293b814c-c114-428a-bf09-12081c337bd5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 11 15:02:28.449082 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: WARNING keystonemiddleware.auth_token [None req-616eb5df-a9eb-4ee2-951f-75bd819f2d50 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 11 15:02:28.455591 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: WARNING keystonemiddleware.auth_token [None req-616eb5df-a9eb-4ee2-951f-75bd819f2d50 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 11 15:02:28.786875 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: WARNING keystonemiddleware.auth_token [None req-293b814c-c114-428a-bf09-12081c337bd5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 11 15:02:28.792606 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: WARNING keystonemiddleware.auth_token [None req-293b814c-c114-428a-bf09-12081c337bd5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 11 15:02:28.795303 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: WARNING keystonemiddleware.auth_token [None req-616eb5df-a9eb-4ee2-951f-75bd819f2d50 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 11 15:02:28.797925 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5561156119c0 pid: 102448 (default app) Jan 11 15:02:28.800009 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-293b814c-c114-428a-bf09-12081c337bd5 None None] Calling method '>' {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:02:28.800556 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: WARNING keystonemiddleware.auth_token [None req-616eb5df-a9eb-4ee2-951f-75bd819f2d50 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 11 15:02:28.801180 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-293b814c-c114-428a-bf09-12081c337bd5 None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001744 Jan 11 15:02:28.801594 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Tue Jan 11 15:02:28 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:02:28.805674 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5561156119c0 pid: 102449 (default app) Jan 11 15:03:58.994417 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-293b814c-c114-428a-bf09-12081c337bd5 None None] Calling method '>' {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:03:58.995437 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-293b814c-c114-428a-bf09-12081c337bd5 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jan 11 15:03:58.995839 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 2/2] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jan 11 15:03:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:03:59.446676 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-05f7c1fa-de51-49a8-8b5d-f85b21cdffaa admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:03:59.475538 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-05f7c1fa-de51-49a8-8b5d-f85b21cdffaa admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.473169 Jan 11 15:03:59.476291 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 1/3] 10.222.0.52 () {60 vars in 1291 bytes} [Tue Jan 11 15:03:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:04:01.947081 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-293b814c-c114-428a-bf09-12081c337bd5 None None] Calling method '>' {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:04:01.948569 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-293b814c-c114-428a-bf09-12081c337bd5 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002042 Jan 11 15:04:01.948969 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 3/4] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jan 11 15:04:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:04:02.007974 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-335ae05f-7c85-4a0d-98f4-61f918c03b13 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "cirros256", "vcpus": 1, "rxtx_factor": 1.0, "id": "c1"}} {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:04:02.026293 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:04:02.026293 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: warnings.warn(msg) Jan 11 15:04:02.128242 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-335ae05f-7c85-4a0d-98f4-61f918c03b13 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.173257 Jan 11 15:04:02.135835 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 2/5] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Jan 11 15:04:01 2022] POST /compute/v2.1/flavors => generated 407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:04:02.355485 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-1fdb7659-54b7-4d0b-9934-f3ddb7fee3ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:04:02.357843 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:04:02.357843 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: warnings.warn(msg) Jan 11 15:04:02.477047 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-1fdb7659-54b7-4d0b-9934-f3ddb7fee3ec admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.338886 Jan 11 15:04:02.479328 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 4/6] 10.222.0.52 () {64 vars in 1335 bytes} [Tue Jan 11 15:04:02 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:04:05.004647 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-335ae05f-7c85-4a0d-98f4-61f918c03b13 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:04:05.005670 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-335ae05f-7c85-4a0d-98f4-61f918c03b13 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jan 11 15:04:05.006090 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 3/7] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jan 11 15:04:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:04:05.114271 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-7356984a-c8d2-4703-9e0b-d49cac19e76b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d1", "vcpus": 1, "name": "ds512M", "ram": 512, "swap": 0}} {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:04:05.132747 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:04:05.132747 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: warnings.warn(msg) Jan 11 15:04:05.203863 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-7356984a-c8d2-4703-9e0b-d49cac19e76b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.191668 Jan 11 15:04:05.204681 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 5/8] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Jan 11 15:04:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:04:05.215946 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-07cd6829-d1a2-42be-831e-dc22900f33c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:04:05.217403 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:04:05.217403 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: warnings.warn(msg) Jan 11 15:04:05.345529 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-07cd6829-d1a2-42be-831e-dc22900f33c1 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.133169 Jan 11 15:04:05.347443 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 4/9] 10.222.0.52 () {64 vars in 1335 bytes} [Tue Jan 11 15:04:05 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:04:07.767988 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-7356984a-c8d2-4703-9e0b-d49cac19e76b admin admin] Calling method '>' {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:04:07.771745 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-7356984a-c8d2-4703-9e0b-d49cac19e76b admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Jan 11 15:04:07.771745 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 6/10] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jan 11 15:04:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:04:07.843132 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-c3aaffd6-8860-46bc-aeba-06de589ff832 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "disk": 10, "vcpus": 1, "id": "d2", "name": "ds1G"}} {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:04:07.917648 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-c3aaffd6-8860-46bc-aeba-06de589ff832 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.141431 Jan 11 15:04:07.918303 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 5/11] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Jan 11 15:04:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:04:07.929919 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-0ac0a97c-ec5c-4d80-925c-b556e75ee816 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:04:08.030122 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-0ac0a97c-ec5c-4d80-925c-b556e75ee816 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103799 Jan 11 15:04:08.030876 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 7/12] 10.222.0.52 () {64 vars in 1335 bytes} [Tue Jan 11 15:04:07 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:04:10.465638 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-c3aaffd6-8860-46bc-aeba-06de589ff832 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:04:10.467847 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-c3aaffd6-8860-46bc-aeba-06de589ff832 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002187 Jan 11 15:04:10.468758 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 6/13] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jan 11 15:04:10 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:04:10.532645 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-fb04ddc3-f6ab-4ad8-8a4e-931fba1daf76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "swap": 0, "id": "d3", "vcpus": 2, "name": "ds2G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:04:10.609036 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-fb04ddc3-f6ab-4ad8-8a4e-931fba1daf76 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.133952 Jan 11 15:04:10.610790 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 8/14] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Jan 11 15:04:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:04:10.622313 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-506da6ef-214e-46fd-839d-585749f4586e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:04:10.709665 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-506da6ef-214e-46fd-839d-585749f4586e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090895 Jan 11 15:04:10.710381 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 7/15] 10.222.0.52 () {64 vars in 1335 bytes} [Tue Jan 11 15:04:10 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:04:13.151533 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-fb04ddc3-f6ab-4ad8-8a4e-931fba1daf76 admin admin] Calling method '>' {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:04:13.152546 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-fb04ddc3-f6ab-4ad8-8a4e-931fba1daf76 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Jan 11 15:04:13.152933 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 9/16] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jan 11 15:04:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:04:13.214479 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-a3fb6a6e-a6d6-45f6-9584-b3c8200104bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "disk": 20, "name": "ds4G", "id": "d4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0}} {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:04:13.296264 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-a3fb6a6e-a6d6-45f6-9584-b3c8200104bb admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.137298 Jan 11 15:04:13.296753 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 8/17] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Jan 11 15:04:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:04:13.308962 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-6c7d4548-3492-4ba7-ba4c-6cdd24695b93 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:04:13.396804 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-6c7d4548-3492-4ba7-ba4c-6cdd24695b93 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091475 Jan 11 15:04:13.397592 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 10/18] 10.222.0.52 () {64 vars in 1335 bytes} [Tue Jan 11 15:04:13 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:04:15.879080 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-a3fb6a6e-a6d6-45f6-9584-b3c8200104bb admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:04:15.880617 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-a3fb6a6e-a6d6-45f6-9584-b3c8200104bb admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002179 Jan 11 15:04:15.881222 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 9/19] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jan 11 15:04:15 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:04:15.942746 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-35b3f519-0fe7-4aef-8788-18aba348deeb admin admin] Calling method '>' {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:04:15.966290 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-35b3f519-0fe7-4aef-8788-18aba348deeb admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.076107 Jan 11 15:04:15.966825 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 11/20] 10.222.0.52 () {60 vars in 1291 bytes} [Tue Jan 11 15:04:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 15:04:18.467472 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-a3fb6a6e-a6d6-45f6-9584-b3c8200104bb admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:04:18.468783 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-a3fb6a6e-a6d6-45f6-9584-b3c8200104bb admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001857 Jan 11 15:04:18.473439 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 10/21] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jan 11 15:04:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:04:18.529934 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-a14f2b47-4bd6-48ae-bc04-f19814cafa2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "vcpus": 1, "swap": 0, "ram": 512, "id": "1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:04:18.627050 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-a14f2b47-4bd6-48ae-bc04-f19814cafa2b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.150574 Jan 11 15:04:18.627641 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 12/22] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Jan 11 15:04:18 2022] POST /compute/v2.1/flavors => generated 402 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:04:18.641576 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-85ad889f-7f61-41a4-9560-c7125d36e3e8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:04:18.718339 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-85ad889f-7f61-41a4-9560-c7125d36e3e8 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080573 Jan 11 15:04:18.718982 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 11/23] 10.222.0.52 () {64 vars in 1332 bytes} [Tue Jan 11 15:04:18 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:04:21.250804 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-a14f2b47-4bd6-48ae-bc04-f19814cafa2b admin admin] Calling method '>' {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:04:21.251866 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-a14f2b47-4bd6-48ae-bc04-f19814cafa2b admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Jan 11 15:04:21.252268 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 13/24] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jan 11 15:04:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:04:21.309665 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-d9afd3f6-afe1-43aa-8651-27e09574ccd0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "2", "disk": 20, "ram": 2048, "swap": 0}} {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:04:21.402869 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-d9afd3f6-afe1-43aa-8651-27e09574ccd0 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.144525 Jan 11 15:04:21.403466 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 12/25] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Jan 11 15:04:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:04:21.415313 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-cfe75335-6b46-49a8-bce0-0a8c685613bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:04:21.486727 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-cfe75335-6b46-49a8-bce0-0a8c685613bc admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075047 Jan 11 15:04:21.487232 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 14/26] 10.222.0.52 () {64 vars in 1332 bytes} [Tue Jan 11 15:04:21 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:04:23.918244 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-d9afd3f6-afe1-43aa-8651-27e09574ccd0 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:04:23.919262 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-d9afd3f6-afe1-43aa-8651-27e09574ccd0 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jan 11 15:04:23.919777 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 13/27] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jan 11 15:04:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:04:23.975057 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-8f44188f-a825-4dae-865f-b1b0ee8ec72c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "3", "name": "m1.medium", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 40, "rxtx_factor": 1.0, "ram": 4096}} {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:04:24.077136 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-8f44188f-a825-4dae-865f-b1b0ee8ec72c admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.151480 Jan 11 15:04:24.077696 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 15/28] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Jan 11 15:04:23 2022] POST /compute/v2.1/flavors => generated 406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:04:24.089913 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-86b94901-48de-40b0-840e-6498af456e69 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:04:24.171990 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-86b94901-48de-40b0-840e-6498af456e69 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086181 Jan 11 15:04:24.172501 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 14/29] 10.222.0.52 () {64 vars in 1332 bytes} [Tue Jan 11 15:04:24 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:04:26.637744 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-8f44188f-a825-4dae-865f-b1b0ee8ec72c admin admin] Calling method '>' {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:04:26.638761 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-8f44188f-a825-4dae-865f-b1b0ee8ec72c admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jan 11 15:04:26.639162 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 16/30] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jan 11 15:04:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:04:26.722753 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-9f013442-00e7-42cb-ada1-5c2811fb369b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "ram": 8192, "vcpus": 4, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0}} {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:04:27.277451 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-9f013442-00e7-42cb-ada1-5c2811fb369b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.631468 Jan 11 15:04:27.278938 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 15/31] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Jan 11 15:04:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:04:27.290324 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-adb95600-1384-4f9d-91fb-9e9eef5270ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:04:27.389143 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-adb95600-1384-4f9d-91fb-9e9eef5270ac admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103062 Jan 11 15:04:27.389905 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 17/32] 10.222.0.52 () {64 vars in 1332 bytes} [Tue Jan 11 15:04:27 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:04:29.835593 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-9f013442-00e7-42cb-ada1-5c2811fb369b admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:04:29.836641 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-9f013442-00e7-42cb-ada1-5c2811fb369b admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jan 11 15:04:29.837045 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 16/33] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jan 11 15:04:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:04:29.901438 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-4c39bf2b-94c5-43e4-ab23-4a7233f01689 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "swap": 0, "rxtx_factor": 1.0, "vcpus": 8, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 16384, "disk": 160}} {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:04:29.980263 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-4c39bf2b-94c5-43e4-ab23-4a7233f01689 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.137188 Jan 11 15:04:29.980828 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 18/34] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Jan 11 15:04:29 2022] POST /compute/v2.1/flavors => generated 408 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:04:29.993541 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-ac3bb6c6-bce8-4a13-9a6c-c5423d38af23 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:04:30.075482 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-ac3bb6c6-bce8-4a13-9a6c-c5423d38af23 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086071 Jan 11 15:04:30.075975 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 17/35] 10.222.0.52 () {64 vars in 1332 bytes} [Tue Jan 11 15:04:29 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:04:51.757436 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-4c39bf2b-94c5-43e4-ab23-4a7233f01689 admin admin] Calling method '>' {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:04:51.758969 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-4c39bf2b-94c5-43e4-ab23-4a7233f01689 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Jan 11 15:04:51.759406 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 19/36] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jan 11 15:04:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:04:51.814682 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-0d18ee84-7475-4d37-bc54-06a5a85ce274 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:04:51.831503 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-0d18ee84-7475-4d37-bc54-06a5a85ce274 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066156 Jan 11 15:04:51.832044 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 18/37] 10.222.0.52 () {60 vars in 1291 bytes} [Tue Jan 11 15:04:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 15:04:53.451222 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-4c39bf2b-94c5-43e4-ab23-4a7233f01689 admin admin] Calling method '>' {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:04:53.452253 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-4c39bf2b-94c5-43e4-ab23-4a7233f01689 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jan 11 15:04:53.452651 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 20/38] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jan 11 15:04:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:04:53.664386 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-35df71ec-3865-4284-8695-bef372b372f0 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:04:53.669810 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.wsgi [None req-35df71ec-3865-4284-8695-bef372b372f0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 11 15:04:53.670382 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-35df71ec-3865-4284-8695-bef372b372f0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:04:53.671190 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-35df71ec-3865-4284-8695-bef372b372f0 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058827 Jan 11 15:04:53.671740 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 19/39] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Jan 11 15:04:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 11 15:04:53.681220 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-7ea9527e-0cda-4a4f-a142-264a40401b4d admin admin] Calling method '>' {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:04:53.701847 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-7ea9527e-0cda-4a4f-a142-264a40401b4d admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024607 Jan 11 15:04:53.702394 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 21/40] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Jan 11 15:04:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 15:04:53.711525 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-e389c2cb-ab1e-4e8b-a96c-647c14629ef5 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:04:53.732895 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-e389c2cb-ab1e-4e8b-a96c-647c14629ef5 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024442 Jan 11 15:04:53.735340 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 20/41] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Jan 11 15:04:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 15:04:53.744094 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-d2edd3fb-eb42-44e2-a40c-e6b77b737ad4 admin admin] Calling method '>' {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:04:53.749432 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.wsgi [None req-d2edd3fb-eb42-44e2-a40c-e6b77b737ad4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 11 15:04:53.749992 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-d2edd3fb-eb42-44e2-a40c-e6b77b737ad4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:04:53.750770 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-d2edd3fb-eb42-44e2-a40c-e6b77b737ad4 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010895 Jan 11 15:04:53.751255 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 22/42] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Jan 11 15:04:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 11 15:04:55.277662 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-e389c2cb-ab1e-4e8b-a96c-647c14629ef5 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:04:55.278715 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-e389c2cb-ab1e-4e8b-a96c-647c14629ef5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jan 11 15:04:55.279115 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 21/43] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jan 11 15:04:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:04:55.470844 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-b7461307-e889-4a84-81e7-34a771967c6c admin admin] Calling method '>' {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:04:55.476374 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.wsgi [None req-b7461307-e889-4a84-81e7-34a771967c6c admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 11 15:04:55.476938 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-b7461307-e889-4a84-81e7-34a771967c6c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:04:55.477783 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-b7461307-e889-4a84-81e7-34a771967c6c admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.057566 Jan 11 15:04:55.478297 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 23/44] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Jan 11 15:04:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 11 15:04:55.487625 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-602e8b75-d577-4e6f-b7b0-4193fd4bd233 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:04:55.500567 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-602e8b75-d577-4e6f-b7b0-4193fd4bd233 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016545 Jan 11 15:04:55.501086 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 22/45] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Jan 11 15:04:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 15:04:55.510598 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-bbfe35f7-dc85-4920-a98a-3c71c19678f6 admin admin] Calling method '>' {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:04:55.524740 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-bbfe35f7-dc85-4920-a98a-3c71c19678f6 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017594 Jan 11 15:04:55.525252 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 24/46] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Jan 11 15:04:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 15:04:55.533945 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-8019a665-09e5-42e8-aa0e-ebf05af9c35a admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:04:55.538960 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.wsgi [None req-8019a665-09e5-42e8-aa0e-ebf05af9c35a admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 11 15:04:55.539569 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-8019a665-09e5-42e8-aa0e-ebf05af9c35a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:04:55.540372 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-8019a665-09e5-42e8-aa0e-ebf05af9c35a admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009793 Jan 11 15:04:55.540840 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 23/47] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Jan 11 15:04:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 11 15:04:57.077210 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-bbfe35f7-dc85-4920-a98a-3c71c19678f6 admin admin] Calling method '>' {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:04:57.078258 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-bbfe35f7-dc85-4920-a98a-3c71c19678f6 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jan 11 15:04:57.078658 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 25/48] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jan 11 15:04:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:04:57.272019 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-c77a8eaf-a1f2-4935-ab86-977c1db1918e admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:04:57.277218 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.wsgi [None req-c77a8eaf-a1f2-4935-ab86-977c1db1918e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 11 15:04:57.277788 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-c77a8eaf-a1f2-4935-ab86-977c1db1918e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:04:57.278592 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-c77a8eaf-a1f2-4935-ab86-977c1db1918e admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059387 Jan 11 15:04:57.279104 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 24/49] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Jan 11 15:04:57 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 11 15:04:57.288180 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-8a8fac5a-cfdf-4146-bac5-e67a5654efe1 admin admin] Calling method '>' {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:04:57.302323 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-8a8fac5a-cfdf-4146-bac5-e67a5654efe1 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017091 Jan 11 15:04:57.302881 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 26/50] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Jan 11 15:04:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 15:04:57.314105 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-e149b396-847c-42eb-8219-28f23cfe6c44 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:04:57.328086 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-e149b396-847c-42eb-8219-28f23cfe6c44 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017847 Jan 11 15:04:57.328627 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 25/51] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Jan 11 15:04:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 15:04:57.337796 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-726be3db-89a7-4f48-9327-ff77b7f297a7 admin admin] Calling method '>' {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:04:57.342920 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.wsgi [None req-726be3db-89a7-4f48-9327-ff77b7f297a7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 11 15:04:57.343522 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-726be3db-89a7-4f48-9327-ff77b7f297a7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:04:57.344324 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-726be3db-89a7-4f48-9327-ff77b7f297a7 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010033 Jan 11 15:04:57.344803 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 27/52] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Jan 11 15:04:57 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 11 15:04:58.863987 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-e149b396-847c-42eb-8219-28f23cfe6c44 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:04:58.864984 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-e149b396-847c-42eb-8219-28f23cfe6c44 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jan 11 15:04:58.865407 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 26/53] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jan 11 15:04:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:04:59.053680 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-cb28f43c-3864-4bf5-b6b9-995b7958609b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:04:59.127087 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-cb28f43c-3864-4bf5-b6b9-995b7958609b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.122722 Jan 11 15:04:59.127619 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 28/54] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Jan 11 15:04:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:05:00.639313 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-e149b396-847c-42eb-8219-28f23cfe6c44 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:05:00.640333 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-e149b396-847c-42eb-8219-28f23cfe6c44 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jan 11 15:05:00.640736 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 27/55] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jan 11 15:05:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:05:00.829249 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-8a6c9738-d43a-4cdc-998c-3722434ac9d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:05:00.893258 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-8a6c9738-d43a-4cdc-998c-3722434ac9d7 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.114802 Jan 11 15:05:00.893736 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 29/56] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Jan 11 15:05:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:05:02.410833 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-e149b396-847c-42eb-8219-28f23cfe6c44 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:05:02.411860 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-e149b396-847c-42eb-8219-28f23cfe6c44 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jan 11 15:05:02.412264 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 28/57] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jan 11 15:05:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:05:02.602056 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-e93930b5-23da-4644-a662-b47e094184a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:05:02.658728 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-e93930b5-23da-4644-a662-b47e094184a4 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.106764 Jan 11 15:05:02.659271 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 30/58] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Jan 11 15:05:02 2022] POST /compute/v2.1/flavors => generated 407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:05:04.223047 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-e149b396-847c-42eb-8219-28f23cfe6c44 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:05:04.224084 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-e149b396-847c-42eb-8219-28f23cfe6c44 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jan 11 15:05:04.224486 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 29/59] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jan 11 15:05:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:05:04.417668 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-72bea468-5134-4ce4-b2d7-05c6799166cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:05:04.485790 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-72bea468-5134-4ce4-b2d7-05c6799166cd admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.119327 Jan 11 15:05:04.486261 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 31/60] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Jan 11 15:05:04 2022] POST /compute/v2.1/flavors => generated 409 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:05:06.005391 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-e149b396-847c-42eb-8219-28f23cfe6c44 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:05:06.006441 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-e149b396-847c-42eb-8219-28f23cfe6c44 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jan 11 15:05:06.006789 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 30/61] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jan 11 15:05:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:05:06.195060 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-5badb50a-639a-4832-bba2-aaad1303d9d1 admin admin] Calling method '>' {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:05:06.219379 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-5badb50a-639a-4832-bba2-aaad1303d9d1 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069793 Jan 11 15:05:06.219379 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 32/62] 10.222.0.52 () {60 vars in 1202 bytes} [Tue Jan 11 15:05:06 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 15:05:54.535779 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-e149b396-847c-42eb-8219-28f23cfe6c44 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:05:54.536807 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-e149b396-847c-42eb-8219-28f23cfe6c44 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jan 11 15:05:54.537825 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 31/63] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jan 11 15:05:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:05:54.593732 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-18fd7a1b-1f8a-446e-8c9f-d87a2b33d951 admin admin] Calling method '>' {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:05:54.613604 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-18fd7a1b-1f8a-446e-8c9f-d87a2b33d951 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070033 Jan 11 15:05:54.614130 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 33/64] 10.222.0.52 () {60 vars in 1291 bytes} [Tue Jan 11 15:05:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 15:05:54.635424 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-9284f47c-8e9b-484e-bc80-bfdf42653fa4 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:05:54.642950 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-9284f47c-8e9b-484e-bc80-bfdf42653fa4 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011080 Jan 11 15:05:54.643511 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 32/65] 10.222.0.52 () {60 vars in 1282 bytes} [Tue Jan 11 15:05:54 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:05:54.654781 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-944198b1-5097-4831-8f68-c93d2ab01bfb admin admin] Calling method '>' {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:05:54.662844 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-944198b1-5097-4831-8f68-c93d2ab01bfb admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010850 Jan 11 15:05:54.663367 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 34/66] 10.222.0.52 () {60 vars in 1285 bytes} [Tue Jan 11 15:05:54 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:05:54.673996 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-dbafa40e-4a7a-4967-84b6-3c11697df658 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:05:54.681237 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-dbafa40e-4a7a-4967-84b6-3c11697df658 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010628 Jan 11 15:05:54.681749 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 33/67] 10.222.0.52 () {60 vars in 1285 bytes} [Tue Jan 11 15:05:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:05:54.692117 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-c614432c-f8a9-43ad-b0b6-bffba4de0e42 admin admin] Calling method '>' {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:05:54.699739 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-c614432c-f8a9-43ad-b0b6-bffba4de0e42 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010835 Jan 11 15:05:54.700261 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 35/68] 10.222.0.52 () {60 vars in 1282 bytes} [Tue Jan 11 15:05:54 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:07:28.831626 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-cb1556c0-ca12-40d7-bf18-42fbf7d93f8a tempest-verify_tempest_config-1619159197 tempest-verify_tempest_config-1619159197-project] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:07:28.833565 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-cb1556c0-ca12-40d7-bf18-42fbf7d93f8a tempest-verify_tempest_config-1619159197 tempest-verify_tempest_config-1619159197-project] 10.222.0.52 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.103154 Jan 11 15:07:28.834730 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 34/69] 10.222.0.52 () {58 vars in 1133 bytes} [Tue Jan 11 15:07:28 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:08:59.962466 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-c614432c-f8a9-43ad-b0b6-bffba4de0e42 admin admin] Calling method '>' {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:08:59.963509 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-c614432c-f8a9-43ad-b0b6-bffba4de0e42 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jan 11 15:08:59.963912 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 36/70] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jan 11 15:08:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:09:00.214733 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-2a1557d8-0c8a-403b-a347-cac1aed09fda admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:09:00.217207 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:09:00.217207 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: warnings.warn(msg) Jan 11 15:09:00.218784 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-2a1557d8-0c8a-403b-a347-cac1aed09fda admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:09:00.219232 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-2a1557d8-0c8a-403b-a347-cac1aed09fda admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:09:00.220101 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-2a1557d8-0c8a-403b-a347-cac1aed09fda admin admin] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:09:00.220538 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-2a1557d8-0c8a-403b-a347-cac1aed09fda admin admin] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:09:00.259577 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-2a1557d8-0c8a-403b-a347-cac1aed09fda admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.154837 Jan 11 15:09:00.260151 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 35/71] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Jan 11 15:09:00 2022] GET /compute/v2.1/os-services => generated 791 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:09:01.788976 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-c614432c-f8a9-43ad-b0b6-bffba4de0e42 admin admin] Calling method '>' {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:09:01.789963 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-c614432c-f8a9-43ad-b0b6-bffba4de0e42 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002367 Jan 11 15:09:01.790360 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 37/72] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jan 11 15:09:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:09:01.981968 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-4010bb3b-2027-415a-a61e-da04ba50a95d admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:09:01.983190 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:09:01.983190 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: warnings.warn(msg) Jan 11 15:09:01.984798 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-4010bb3b-2027-415a-a61e-da04ba50a95d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:09:01.985241 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-4010bb3b-2027-415a-a61e-da04ba50a95d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:09:01.986059 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-4010bb3b-2027-415a-a61e-da04ba50a95d admin admin] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:09:01.986626 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-4010bb3b-2027-415a-a61e-da04ba50a95d admin admin] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:09:02.007683 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-4010bb3b-2027-415a-a61e-da04ba50a95d admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076630 Jan 11 15:09:02.008218 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 36/73] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Jan 11 15:09:01 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:09:13.926249 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-c614432c-f8a9-43ad-b0b6-bffba4de0e42 admin admin] Calling method '>' {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:09:13.927235 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-c614432c-f8a9-43ad-b0b6-bffba4de0e42 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Jan 11 15:09:13.927656 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 38/74] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jan 11 15:09:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:09:14.116483 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-e427f80a-0dd1-4592-8177-b8538a77f10e admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:09:14.117684 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:09:14.117684 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: warnings.warn(msg) Jan 11 15:09:14.119241 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-e427f80a-0dd1-4592-8177-b8538a77f10e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:09:14.119745 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-e427f80a-0dd1-4592-8177-b8538a77f10e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:09:14.120544 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-e427f80a-0dd1-4592-8177-b8538a77f10e admin admin] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:09:14.120964 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-e427f80a-0dd1-4592-8177-b8538a77f10e admin admin] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:09:14.144917 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-e427f80a-0dd1-4592-8177-b8538a77f10e admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078756 Jan 11 15:09:14.145451 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 37/75] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Jan 11 15:09:14 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 15:09:15.679470 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: DEBUG nova.api.openstack.wsgi [None req-c614432c-f8a9-43ad-b0b6-bffba4de0e42 admin admin] Calling method '>' {{(pid=102448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:09:15.681109 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: INFO nova.api.openstack.requestlog [None req-c614432c-f8a9-43ad-b0b6-bffba4de0e42 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002105 Jan 11 15:09:15.681507 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: [pid: 102448|app: 0|req: 39/76] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jan 11 15:09:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:09:15.870235 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG nova.api.openstack.wsgi [None req-a17a5280-e8a0-4184-a281-ea0641105a34 admin admin] Calling method '>' {{(pid=102449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:09:15.871451 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:09:15.871451 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: warnings.warn(msg) Jan 11 15:09:15.872959 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-a17a5280-e8a0-4184-a281-ea0641105a34 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:09:15.873770 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-a17a5280-e8a0-4184-a281-ea0641105a34 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:09:15.874633 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-a17a5280-e8a0-4184-a281-ea0641105a34 admin admin] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:09:15.875053 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: DEBUG oslo_concurrency.lockutils [None req-a17a5280-e8a0-4184-a281-ea0641105a34 admin admin] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:09:15.896401 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: INFO nova.api.openstack.requestlog [None req-a17a5280-e8a0-4184-a281-ea0641105a34 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076880 Jan 11 15:09:15.896891 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: [pid: 102449|app: 0|req: 38/77] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Jan 11 15:09:15 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 15:10:13.818366 dv-cinder-824187-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 11 15:10:13.818913 dv-cinder-824187-2-iscsi devstack@n-api.service[102447]: Tue Jan 11 15:10:13 2022 - graceful shutdown triggered... Jan 11 15:10:13.819397 dv-cinder-824187-2-iscsi devstack@n-api.service[102448]: Gracefully killing worker 1 (pid: 102448)... Jan 11 15:10:13.819768 dv-cinder-824187-2-iscsi devstack@n-api.service[102449]: Gracefully killing worker 2 (pid: 102449)... Jan 11 15:10:14.819812 dv-cinder-824187-2-iscsi devstack@n-api.service[102447]: worker 1 buried after 1 seconds Jan 11 15:10:14.820368 dv-cinder-824187-2-iscsi devstack@n-api.service[102447]: worker 2 buried after 1 seconds Jan 11 15:10:14.820368 dv-cinder-824187-2-iscsi devstack@n-api.service[102447]: goodbye to uWSGI. Jan 11 15:10:14.821377 dv-cinder-824187-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 11 15:10:14.821929 dv-cinder-824187-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 11 15:10:14.824656 dv-cinder-824187-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 11 15:10:14.842357 dv-cinder-824187-2-iscsi devstack@n-api.service[116888]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 11 15:10:14.844260 dv-cinder-824187-2-iscsi devstack@n-api.service[116888]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jan 11 15:10:14 2022] *** Jan 11 15:10:14.844260 dv-cinder-824187-2-iscsi devstack@n-api.service[116888]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 11 15:10:14.844260 dv-cinder-824187-2-iscsi devstack@n-api.service[116888]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 11 15:10:14.844260 dv-cinder-824187-2-iscsi devstack@n-api.service[116888]: nodename: dv-cinder-824187-2-iscsi Jan 11 15:10:14.844260 dv-cinder-824187-2-iscsi devstack@n-api.service[116888]: machine: x86_64 Jan 11 15:10:14.844260 dv-cinder-824187-2-iscsi devstack@n-api.service[116888]: clock source: unix Jan 11 15:10:14.844260 dv-cinder-824187-2-iscsi devstack@n-api.service[116888]: pcre jit disabled Jan 11 15:10:14.844260 dv-cinder-824187-2-iscsi devstack@n-api.service[116888]: detected number of CPU cores: 4 Jan 11 15:10:14.844260 dv-cinder-824187-2-iscsi devstack@n-api.service[116888]: current working directory: / Jan 11 15:10:14.844260 dv-cinder-824187-2-iscsi devstack@n-api.service[116888]: detected binary path: /usr/bin/uwsgi-core Jan 11 15:10:14.845347 dv-cinder-824187-2-iscsi devstack@n-api.service[116888]: your processes number limit is 47680 Jan 11 15:10:14.845347 dv-cinder-824187-2-iscsi devstack@n-api.service[116888]: your memory page size is 4096 bytes Jan 11 15:10:14.845347 dv-cinder-824187-2-iscsi devstack@n-api.service[116888]: detected max file descriptor number: 2048 Jan 11 15:10:14.845347 dv-cinder-824187-2-iscsi devstack@n-api.service[116888]: lock engine: pthread robust mutexes Jan 11 15:10:14.845347 dv-cinder-824187-2-iscsi devstack@n-api.service[116888]: thunder lock: enabled Jan 11 15:10:14.845347 dv-cinder-824187-2-iscsi devstack@n-api.service[116888]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 11 15:10:14.845347 dv-cinder-824187-2-iscsi devstack@n-api.service[116888]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 11 15:10:14.897063 dv-cinder-824187-2-iscsi devstack@n-api.service[116888]: Python main interpreter initialized at 0x55a854f6f9c0 Jan 11 15:10:14.897063 dv-cinder-824187-2-iscsi devstack@n-api.service[116888]: python threads support enabled Jan 11 15:10:14.897063 dv-cinder-824187-2-iscsi devstack@n-api.service[116888]: your server socket listen backlog is limited to 100 connections Jan 11 15:10:14.897063 dv-cinder-824187-2-iscsi devstack@n-api.service[116888]: your mercy for graceful operations on workers is 90 seconds Jan 11 15:10:14.897510 dv-cinder-824187-2-iscsi devstack@n-api.service[116888]: mapped 403077 bytes (393 KB) for 2 cores Jan 11 15:10:14.897510 dv-cinder-824187-2-iscsi devstack@n-api.service[116888]: *** Operational MODE: preforking *** Jan 11 15:10:14.897757 dv-cinder-824187-2-iscsi devstack@n-api.service[116888]: *** uWSGI is running in multiple interpreter mode *** Jan 11 15:10:14.897757 dv-cinder-824187-2-iscsi devstack@n-api.service[116888]: spawned uWSGI master process (pid: 116888) Jan 11 15:10:14.897965 dv-cinder-824187-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 11 15:10:14.898542 dv-cinder-824187-2-iscsi devstack@n-api.service[116888]: spawned uWSGI worker 1 (pid: 116902, cores: 1) Jan 11 15:10:14.899064 dv-cinder-824187-2-iscsi devstack@n-api.service[116888]: spawned uWSGI worker 2 (pid: 116903, cores: 1) Jan 11 15:10:14.899917 dv-cinder-824187-2-iscsi devstack@n-api.service[116888]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 11 15:10:16.830666 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 11 15:10:16.830666 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: from cryptography.utils import int_from_bytes Jan 11 15:10:16.831688 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 11 15:10:16.831688 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: from cryptography.utils import int_from_bytes Jan 11 15:10:16.837364 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 11 15:10:16.837364 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: from cryptography.utils import int_from_bytes Jan 11 15:10:16.837928 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 11 15:10:16.837928 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: from cryptography.utils import int_from_bytes Jan 11 15:10:19.242034 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 11 15:10:19.243608 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 11 15:10:19.243608 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 11 15:10:19.243799 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 11 15:10:19.243996 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 11 15:10:19.244397 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.244729 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.245017 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 11 15:10:19.245403 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.245489 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 11 15:10:19.245573 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.245789 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.245895 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 11 15:10:19.246093 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.246201 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 11 15:10:19.246352 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.246444 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 11 15:10:19.246694 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.246866 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.247058 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.247179 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.247371 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.247536 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.247640 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.247850 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.247965 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-824187-2-iscsi {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.248191 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.248287 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.248511 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.248608 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.248846 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.248983 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.249171 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.249387 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.249553 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.249704 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.249893 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.250050 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.250202 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.250344 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.252090 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-824187-2-iscsi {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.252458 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.252717 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.252717 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.253172 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.253389 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.253604 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.253824 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.254058 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.254275 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.254482 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.254703 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.254940 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.255184 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.255411 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.255411 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.255831 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.256064 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.256279 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.256495 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.256740 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.256978 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.257223 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.257398 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-824187-2-iscsi {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.257626 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.257782 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.258069 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.258475 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.258631 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.258801 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.258988 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.258988 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.259269 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.263364 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.263554 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.263740 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.264299 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.264299 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.264605 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-824187-2-iscsi {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.264605 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.265361 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.265534 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.265711 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.265866 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.266020 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.266020 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.266580 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.266805 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.267211 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.267445 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.267599 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.268519 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.268693 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.268848 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.269004 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.269154 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.269306 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.269462 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.269606 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.269754 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.269906 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.270594 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.270755 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.270918 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.271069 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.277304 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.277971 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.278056 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.278141 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.278222 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.278303 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.278375 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.278446 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.278600 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.278600 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.278742 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.278821 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.278901 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.278901 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.279069 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.279151 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.279229 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.279501 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.279599 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.279681 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.279767 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.279839 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.279910 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.279986 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.280065 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.280169 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.280245 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.280322 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.280394 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.280463 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.280532 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.280616 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.280709 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.280781 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.280860 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.280930 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.281007 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.281083 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.281159 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.281229 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.281305 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.281383 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.281467 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.281544 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.281615 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.281690 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.281760 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.281828 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.281909 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.281980 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.282049 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.282118 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.282193 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.282270 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.282349 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.282427 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.282498 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.282566 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.282635 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.282712 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.282783 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.282858 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.282935 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.283006 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.283103 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.283187 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.283266 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.284090 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.284226 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.284226 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.284489 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.284625 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.284759 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.284895 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.285022 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.285191 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.285336 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.285480 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.285607 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.285739 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.285870 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.286073 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.286211 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.286356 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.286505 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.286642 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.286780 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.287013 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.287158 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.287158 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.287449 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.287449 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.287756 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.288730 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.288879 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.289017 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.289152 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.289280 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.289416 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.289553 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.290329 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.290467 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.290594 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.290727 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.290862 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.291004 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.291139 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.291266 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.291435 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.291574 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.291736 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.292014 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.292154 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.292292 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.292499 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.292644 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.292772 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.292898 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.293034 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.293168 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.293304 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.293440 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.293567 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.293694 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.294493 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.294636 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.294768 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.294902 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.295042 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.295180 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.295382 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.295513 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.295655 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.295795 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.295975 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.296106 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.296249 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.296377 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.296513 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.296648 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.296778 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.296913 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.297041 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.297167 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.297167 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.297167 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.297617 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.297755 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.297755 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.298719 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.298859 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.298859 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.299116 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.299325 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.299489 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.299625 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.299625 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.299918 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.300053 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.300188 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.300366 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.300366 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.300608 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.300735 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.300900 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.301031 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.301172 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.301300 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.301459 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.301596 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.301596 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.302079 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.302218 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.302349 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.302476 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.302476 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.302723 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.302863 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.302863 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.303393 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.303559 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.303697 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.303833 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.303833 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.304235 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.304373 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.304507 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.304642 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.304642 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.304896 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.305035 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.305252 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.305602 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.305739 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.305858 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.305988 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.306112 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.306310 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 15:10:19.306435 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.306435 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.306435 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.306768 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.307017 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.307152 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.307359 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.307359 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.307595 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.307706 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.307799 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.307939 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.307939 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.308160 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.308714 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.308714 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.308946 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.309040 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.309131 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.309215 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.309342 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.309500 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.309500 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.309666 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.309764 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.309857 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.309942 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.309942 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.310109 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.310194 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.310194 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.310352 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.310449 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.310449 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.310616 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.310700 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.310783 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.310872 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.310872 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.311045 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.311128 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.311207 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.317504 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.317504 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.317888 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.317986 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.318072 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.318231 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.318319 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.318402 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.318402 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.318853 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.318949 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.319080 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.319168 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.319168 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.319168 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.319168 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.319714 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.319714 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.319902 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.319902 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.320070 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.320161 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.320252 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.320344 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.320435 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.320530 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.320615 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.320698 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.320806 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.320894 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.320977 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.321069 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.321161 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.321252 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.321343 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.321441 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.321540 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.321625 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.321804 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.321900 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.321991 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.322082 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.322175 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.322267 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.322351 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.322442 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.322526 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.322609 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.322704 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.322788 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.322871 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.322954 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.323036 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.323119 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.323214 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.323314 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.323412 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.323497 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.323589 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.323735 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.323836 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.323929 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.324014 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.324111 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.324203 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.324331 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.324416 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.324507 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.324598 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.324689 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.324773 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.324875 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.324875 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.325030 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.325112 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.325194 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.325289 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.325464 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.325557 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.325648 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.325873 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.325967 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.326061 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.326154 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.326263 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.326349 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.326433 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.326522 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.326615 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.326699 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.326788 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.326883 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.326974 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.327064 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.327158 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.327249 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.327351 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.327448 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.327533 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.327622 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.327734 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.327826 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.327911 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.327994 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.328076 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.328167 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.328258 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.328345 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.328429 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.328511 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.328754 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.329039 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.329268 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.329406 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.329520 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.329653 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.329750 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.329833 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.329957 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.330068 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.330177 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.330287 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.330397 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.330521 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.330659 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.330749 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.330832 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.330914 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.331007 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.331123 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.331239 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.331388 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.331520 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.331644 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.331765 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.331881 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.332000 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.332117 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.332268 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.332395 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.332515 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.332627 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.332736 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.332853 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.332964 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.333079 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.333206 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.333317 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.333427 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.333550 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.333670 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.333788 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.333907 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.334017 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.334126 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.334235 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.334352 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.334537 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.334658 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.334775 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.334892 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.335002 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.335002 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.335002 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.335002 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.335436 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.335566 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.335677 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.335785 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.335924 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.336135 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.336251 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.336368 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.337028 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.337161 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.337259 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.337345 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.337481 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.337569 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.337652 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.337743 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.337828 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.337949 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.338040 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.338139 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.338239 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.338336 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.338422 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.338504 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.338586 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.338834 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.338982 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.339188 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.339354 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.339498 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.339627 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.339722 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.339807 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.339938 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.340031 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.340122 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.340222 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.340314 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.340314 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.340481 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.340564 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.340646 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.340736 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.340821 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.340965 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.341061 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.341141 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.341212 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.341294 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.341294 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.341523 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.341660 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.341755 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.341846 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.341983 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.342075 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.342075 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.342317 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.342405 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.342511 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.342604 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.342689 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.342898 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.343063 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.343160 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.343252 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.343349 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.343349 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.343530 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.343620 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.343763 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.343855 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.344046 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.344147 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.344383 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.344488 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.344703 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.344801 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.345275 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.345387 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.345590 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.345682 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.345915 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.346006 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.346240 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.346343 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.346561 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.346650 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.346883 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.346976 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.347198 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.347385 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.347545 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.347644 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.347862 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.347953 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.348177 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.348276 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.348491 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.348582 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.348949 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.349057 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.349284 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.349377 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.349471 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.349555 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.349748 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.349860 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.350060 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.350159 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.350380 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.350472 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.350692 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.350790 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.351026 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.351311 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.351453 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.351686 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.351801 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.351984 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.352142 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.352838 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.352943 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.353192 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.353303 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.353517 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.353619 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.353830 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.353930 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.354158 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.354274 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.354492 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.354593 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.354815 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.354924 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.355135 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.355248 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.355483 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.355593 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.355801 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.355901 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.356125 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.356240 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.356441 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.356538 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.356753 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.356861 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.357069 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.357174 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.357386 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.357478 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.357697 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.357788 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.358017 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.358116 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.358350 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.358449 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.358673 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.358765 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.359000 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.359111 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.359346 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.359454 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.359664 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.359797 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.359989 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.360095 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.360310 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.360408 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.360629 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.360896 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.361003 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.361237 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.361337 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.361549 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.361640 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.361877 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.361967 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.362202 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.362306 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.362548 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.362648 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.362888 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.362985 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.363225 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.363351 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.363570 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.363671 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.363897 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.364037 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.364217 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.364435 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.364546 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.364642 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.364836 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.364938 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.365207 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.365529 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.365846 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.365932 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.366162 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.366255 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.366572 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.366687 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.366800 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.366894 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.367111 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.367211 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.367452 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.367558 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.367793 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.367892 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.368112 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.368208 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.368427 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.368577 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.368910 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.369236 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.369560 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.369796 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.370037 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.370199 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.370351 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.370503 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.370651 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.370797 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.370942 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.371080 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.371226 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.371412 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.371595 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.371749 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.371892 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.372040 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.372222 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.372333 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.372680 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.372871 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.373031 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.373133 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.373266 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.373415 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.373511 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.373636 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.373801 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.373959 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.374139 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.374284 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.374457 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.374603 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.374771 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.374941 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.375087 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.375264 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.375431 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.375640 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.375752 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.375958 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.376065 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.376282 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.376380 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.376598 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.376696 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.376914 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.377014 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.377236 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.377334 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.377573 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.377673 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.377890 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.377993 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.378203 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.378295 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.378527 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.378641 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.378840 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.378958 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.379245 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.379390 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.379500 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.379702 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.379869 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.380005 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.380187 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.380361 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.380451 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.380548 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.380712 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.380811 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.381026 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.381124 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.381340 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.381437 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.381651 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.381744 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.381966 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.382057 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.382278 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.382376 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.382591 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.382681 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.382903 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.383007 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.383213 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.383370 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.383611 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.383716 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.383932 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.384024 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.384247 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.384348 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.384562 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.384674 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.385288 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.385400 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.385486 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.385585 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.385678 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.385771 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.385865 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.385951 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.386136 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.386463 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.386786 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.387110 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.387470 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.387794 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.387970 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.388129 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.388326 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.388452 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.388653 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.388774 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.388984 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.389106 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.389306 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.389672 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.389762 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.389845 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.389937 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.390062 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.390242 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.390382 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.390557 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.390701 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.391020 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.391362 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.391685 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.392002 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.392324 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.392644 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.392964 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.393063 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.393285 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.393436 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.393616 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.393788 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.393941 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.394096 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.394236 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.394357 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.394530 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.394695 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.394865 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.395025 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.395185 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.395375 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.395523 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.395701 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.395845 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.396066 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.396157 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.396391 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.396505 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.396768 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.396859 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.397090 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.397214 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.397422 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.397523 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.397756 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.397855 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.398083 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.398175 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.398409 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.398514 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.398737 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.398834 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.399721 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.399842 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.400004 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.400148 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.400244 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.400367 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.400563 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.400656 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.400884 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.400989 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.401207 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.401332 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.401544 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.401644 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.401872 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.402069 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.402217 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.402378 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.402531 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.402703 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.402874 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.403082 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.403186 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.403433 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.403744 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.404064 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.404291 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.404403 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.404683 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.404792 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.404962 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.405057 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.405289 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.405483 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.405608 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.405805 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.405941 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.406122 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.406266 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.406547 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.406647 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.406871 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.406975 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.407194 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.407323 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.407551 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.407854 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.407949 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.408214 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.408326 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.408537 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.408679 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.408855 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.409145 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.409252 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.409483 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.409603 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.409846 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.409953 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.410130 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.410376 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.410549 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.410705 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.410861 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.411010 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.411106 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.411348 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.411513 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.411652 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.411827 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.411963 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.412152 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.412357 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.412463 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.412685 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.412784 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.413020 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.413122 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.413394 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.413502 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.413729 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.413829 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.414046 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.414152 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.414402 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.414491 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.415358 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.415457 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.415686 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.415822 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.416049 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.416298 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.416447 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.416788 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.416924 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.417044 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.417171 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.417271 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.417391 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.417544 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.417712 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.417888 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.418033 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.418183 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.418347 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.418484 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.418707 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.418905 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.419075 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.419187 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.419400 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.419544 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.419755 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.420104 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.420208 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.420294 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.420460 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.420857 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.421185 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.421435 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.421622 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.421773 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.421884 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.422013 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.422179 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.422279 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.422279 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.422507 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.422613 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.422742 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.422860 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.422979 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.423126 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.423228 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.423461 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.423564 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.423756 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.423850 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.424092 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.424197 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.424414 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.424506 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.424742 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.424834 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.425058 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.425163 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.425395 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.425494 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.425730 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.425829 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.426054 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.426158 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.426388 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.426487 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.426728 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.426819 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.427067 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.427170 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.427410 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.427518 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.427731 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.427830 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.428055 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.428147 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.428378 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.428476 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.428696 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.428794 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.429013 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.429105 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.429330 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.429427 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.429645 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.429733 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.429962 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.430079 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.430398 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.430510 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.430604 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.430696 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.430918 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.431023 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.431237 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.431342 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.431579 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.431690 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.431894 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.431989 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.432209 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.432299 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.432523 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.432626 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.432856 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.432946 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.433191 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.433284 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.433518 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.433619 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.433847 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.433945 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.434162 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.434253 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.434496 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.434596 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.434815 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.434913 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.435129 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.435221 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.435469 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.435572 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.435783 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.435874 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.436113 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.436205 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.436440 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.436531 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.436764 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.436866 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.437091 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.437190 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.437415 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.437507 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.437736 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.437827 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.438061 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.438159 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.438397 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.438521 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.438722 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.438832 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.439051 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.439310 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.439408 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.439659 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.439759 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.439986 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.440084 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.440361 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.440471 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.440629 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.440730 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.440944 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.441047 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.441260 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.441361 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.441580 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.441670 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.441898 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.442069 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.442221 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.442374 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.442515 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.442662 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.442831 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.442989 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.443136 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.443284 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.443510 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.443656 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.443832 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.443988 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.444137 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.444294 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.444439 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.444586 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.444750 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.444901 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.445097 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.445304 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.445448 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.445635 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.445740 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.445869 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.446099 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.446436 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.446782 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.446923 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.447123 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.447238 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.447450 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.447584 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.447781 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.447909 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.448107 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.448224 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.448527 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.448657 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.448782 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.448907 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.449068 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.449188 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.449390 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.449516 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.449787 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.449901 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.450030 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.450391 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.450678 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.451082 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.451222 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.451459 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.451605 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.451816 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.451936 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.452257 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.452443 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.452582 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.452760 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.452902 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.453097 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.453217 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.453435 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.453528 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.453773 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.453872 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.454162 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.454311 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.454483 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.454636 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.454775 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.454969 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.455114 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.455400 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.455545 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.455747 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.455890 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.456082 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.456225 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.456413 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.456556 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.456755 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.456897 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.457076 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.457225 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.457395 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.457544 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.457720 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.457871 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.458045 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.458201 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.458351 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.458498 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.458692 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.458834 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.459016 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.459165 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.459361 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.459500 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.459686 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.459843 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.459991 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.460139 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.460319 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.460544 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.460661 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.460912 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.461194 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.461280 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.461367 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.462216 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.462555 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.462730 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.462883 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.463023 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.463161 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.463331 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.463507 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.463650 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.463827 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.463968 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.464146 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.464283 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.464477 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.464631 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.464787 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.464932 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.465101 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.465330 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.465470 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.465660 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.465807 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.466006 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.466149 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.466342 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.466488 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.466668 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.466828 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.466969 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.467106 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.467339 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.467480 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.467631 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.467770 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.467947 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.468089 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.468270 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.468379 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.468592 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.468683 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.468911 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.469000 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.469226 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.469326 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.469543 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.469714 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.469859 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.470211 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.470428 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.470532 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.470745 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.470881 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.471070 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.471183 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.471413 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.471663 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.471765 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.472031 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.472133 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.472350 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.472476 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.472669 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.472780 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.473004 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.473104 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.473321 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.473427 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.473681 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.473785 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.474009 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.474119 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.474292 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.474465 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.474610 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.474710 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.474938 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.475070 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.475496 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.475645 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.475760 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.475871 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.475981 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.476093 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.476544 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.476935 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.477097 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.477853 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.478181 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.478510 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.478811 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.478931 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.479157 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.479273 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.479520 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.479641 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.479893 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.480024 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.480188 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.480513 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.480859 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.481188 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.481517 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.481841 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.482167 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.482492 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.482820 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.483143 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.483501 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.483704 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.483817 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.484070 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.484179 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.484429 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.484529 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.484765 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.484863 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.485106 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.485220 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.485435 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.485538 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.485765 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.485861 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.486090 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.486195 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.486413 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.486510 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.486736 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.486841 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.487059 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.487164 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.487404 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.487515 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.487734 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.487832 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.488056 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.488162 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.488371 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.488474 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.488713 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.488817 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.489031 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.489128 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.489363 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.489461 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.489690 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.489787 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.490023 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.490197 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.490350 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.490502 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.490655 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.490826 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.491055 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.491400 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.491581 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.491727 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.491871 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.492021 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.492354 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.492510 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.492721 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.492932 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.493168 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.493328 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.493474 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.493617 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.493767 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.493923 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.494074 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.494231 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.494375 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.494610 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.494761 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.494904 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.495055 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.495212 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.495391 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.495546 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.495697 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.495850 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.496005 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.496149 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.496299 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.496456 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.496600 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.496742 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.496894 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.497038 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.497189 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.497397 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.497554 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.497698 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.497861 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.498013 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.498164 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.498307 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.498459 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.498602 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.498761 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.498913 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.499056 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.499230 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.499419 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.499578 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.499734 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.499886 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.500036 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.500273 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.500422 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.500579 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.500723 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.500909 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.501073 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.501299 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.501455 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.501629 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.502310 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.502479 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.502625 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.502779 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.502779 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.503068 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.503353 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.503509 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.503661 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.503805 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.504073 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.504230 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.504375 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.504375 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.504743 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.504894 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.505052 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.505209 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.505354 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.505505 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.505657 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.505809 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.505959 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.506102 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.506252 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.506411 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.506555 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.506555 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.506843 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.506843 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.507113 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.507255 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.507443 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.507600 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.507744 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.507886 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.508037 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.508180 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.508369 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.508595 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.508743 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.508887 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 11 15:10:19.509029 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.509029 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.509313 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.509595 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.509921 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.510309 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.510571 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.510903 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.511467 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.511808 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.512272 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.512604 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.512982 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.513386 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.513612 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.514020 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.514506 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.514831 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.515151 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.515495 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.515835 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.516170 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.516485 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.516820 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.517145 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.517480 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.517805 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.518131 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.518529 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.518851 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.519175 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.519519 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.519927 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.520258 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.520584 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.520919 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.521328 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.521725 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.522119 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.522447 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.522769 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.523125 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.523523 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.523812 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.524667 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.524982 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 15:10:19.525232 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 11 15:10:19.535458 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_db.sqlalchemy.engines [None req-42fee02e-2bf8-476b-a6e2-84eb06328643 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116903) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 15:10:19.552169 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_db.sqlalchemy.engines [None req-dc36ec36-d11e-4409-a3a8-741407d40d07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116902) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 15:10:19.603252 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.context [None req-42fee02e-2bf8-476b-a6e2-84eb06328643 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),46615978-60dd-434d-8e14-87d57df7a39e(cell1) {{(pid=116903) load_cells /opt/stack/nova/nova/context.py:464}} Jan 11 15:10:19.607741 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-42fee02e-2bf8-476b-a6e2-84eb06328643 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:10:19.609357 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-42fee02e-2bf8-476b-a6e2-84eb06328643 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:10:19.610197 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-42fee02e-2bf8-476b-a6e2-84eb06328643 None None] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:10:19.612201 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-42fee02e-2bf8-476b-a6e2-84eb06328643 None None] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:10:19.622208 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.context [None req-dc36ec36-d11e-4409-a3a8-741407d40d07 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),46615978-60dd-434d-8e14-87d57df7a39e(cell1) {{(pid=116902) load_cells /opt/stack/nova/nova/context.py:464}} Jan 11 15:10:19.624276 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_db.sqlalchemy.engines [None req-42fee02e-2bf8-476b-a6e2-84eb06328643 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116903) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 15:10:19.624780 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dc36ec36-d11e-4409-a3a8-741407d40d07 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:10:19.626390 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dc36ec36-d11e-4409-a3a8-741407d40d07 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:10:19.628441 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dc36ec36-d11e-4409-a3a8-741407d40d07 None None] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:10:19.628580 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_db.sqlalchemy.engines [None req-42fee02e-2bf8-476b-a6e2-84eb06328643 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116903) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 15:10:19.629549 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dc36ec36-d11e-4409-a3a8-741407d40d07 None None] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:10:19.641879 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_db.sqlalchemy.engines [None req-dc36ec36-d11e-4409-a3a8-741407d40d07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116902) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 15:10:19.643466 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_db.sqlalchemy.engines [None req-dc36ec36-d11e-4409-a3a8-741407d40d07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116902) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 15:10:19.789944 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_db.sqlalchemy.engines [None req-42fee02e-2bf8-476b-a6e2-84eb06328643 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116903) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 15:10:19.806683 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_db.sqlalchemy.engines [None req-dc36ec36-d11e-4409-a3a8-741407d40d07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116902) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 15:10:20.110696 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: WARNING keystonemiddleware.auth_token [None req-42fee02e-2bf8-476b-a6e2-84eb06328643 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 11 15:10:20.117334 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: WARNING keystonemiddleware.auth_token [None req-42fee02e-2bf8-476b-a6e2-84eb06328643 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 11 15:10:20.126745 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: WARNING keystonemiddleware.auth_token [None req-dc36ec36-d11e-4409-a3a8-741407d40d07 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 11 15:10:20.133969 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: WARNING keystonemiddleware.auth_token [None req-dc36ec36-d11e-4409-a3a8-741407d40d07 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 11 15:10:20.459401 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: WARNING keystonemiddleware.auth_token [None req-42fee02e-2bf8-476b-a6e2-84eb06328643 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 11 15:10:20.464598 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: WARNING keystonemiddleware.auth_token [None req-42fee02e-2bf8-476b-a6e2-84eb06328643 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 11 15:10:20.470240 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a854f6f9c0 pid: 116903 (default app) Jan 11 15:10:20.474683 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: WARNING keystonemiddleware.auth_token [None req-dc36ec36-d11e-4409-a3a8-741407d40d07 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 11 15:10:20.481002 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: WARNING keystonemiddleware.auth_token [None req-dc36ec36-d11e-4409-a3a8-741407d40d07 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 11 15:10:20.486318 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a854f6f9c0 pid: 116902 (default app) Jan 11 15:10:56.410436 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b7224bd4-f1c2-4810-9a33-0c406c3808fb tempest-VolumesNegativeTest-913150930 tempest-VolumesNegativeTest-913150930-project] Action: 'create', calling method: .version_select at 0x7f16bbd43a60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-545440368", "metadata": {"Type": "work"}}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:10:56.413388 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b7224bd4-f1c2-4810-9a33-0c406c3808fb tempest-VolumesNegativeTest-913150930 tempest-VolumesNegativeTest-913150930-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:10:56.419385 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b7224bd4-f1c2-4810-9a33-0c406c3808fb tempest-VolumesNegativeTest-913150930 tempest-VolumesNegativeTest-913150930-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.007232 Jan 11 15:10:56.419385 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1/1] 10.222.0.52 () {60 vars in 1155 bytes} [Tue Jan 11 15:10:55 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1009 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 11 15:10:56.469652 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7101d775-1524-45db-8a58-0e4e08885079 tempest-VolumesNegativeTest-913150930 tempest-VolumesNegativeTest-913150930-project] Action: 'create', calling method: .version_select at 0x7f16bbd275e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-709683796", "metadata": {"Type": "work"}}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:10:56.471404 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7101d775-1524-45db-8a58-0e4e08885079 tempest-VolumesNegativeTest-913150930 tempest-VolumesNegativeTest-913150930-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:10:56.472563 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7101d775-1524-45db-8a58-0e4e08885079 tempest-VolumesNegativeTest-913150930 tempest-VolumesNegativeTest-913150930-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006783 Jan 11 15:10:56.478004 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 2/2] 10.222.0.52 () {60 vars in 1155 bytes} [Tue Jan 11 15:10:56 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 11 15:10:56.483044 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e00af7f0-637b-40e3-9821-0c49b71e554c tempest-VolumesNegativeTest-913150930 tempest-VolumesNegativeTest-913150930-project] Action: 'create', calling method: .version_select at 0x7f16bbd43af0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2029962048", "metadata": {"Type": "work"}}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:10:56.484392 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e00af7f0-637b-40e3-9821-0c49b71e554c tempest-VolumesNegativeTest-913150930 tempest-VolumesNegativeTest-913150930-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:10:56.485332 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e00af7f0-637b-40e3-9821-0c49b71e554c tempest-VolumesNegativeTest-913150930 tempest-VolumesNegativeTest-913150930-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006140 Jan 11 15:10:56.486021 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 3/3] 10.222.0.52 () {60 vars in 1155 bytes} [Tue Jan 11 15:10:56 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 11 15:10:56.491724 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-af71f6e3-1d90-4277-b6d0-9c345002f782 tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] Action: 'create', calling method: .version_select at 0x7f16bbd42a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1057333211"}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:10:56.496428 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d8a42b61-1f06-4cdf-a30f-3d99a14f671e tempest-VolumesNegativeTest-913150930 tempest-VolumesNegativeTest-913150930-project] Calling method '.version_select at 0x7f16bbcbd040>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:10:57.214016 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.wsgi [None req-d8a42b61-1f06-4cdf-a30f-3d99a14f671e tempest-VolumesNegativeTest-913150930 tempest-VolumesNegativeTest-913150930-project] HTTP exception thrown: Volume tempest-invalid-337030285 could not be found. Jan 11 15:10:57.214830 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d8a42b61-1f06-4cdf-a30f-3d99a14f671e tempest-VolumesNegativeTest-913150930 tempest-VolumesNegativeTest-913150930-project] Returning 404 to user: Volume tempest-invalid-337030285 could not be found. {{(pid=116903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:10:57.216175 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d8a42b61-1f06-4cdf-a30f-3d99a14f671e tempest-VolumesNegativeTest-913150930 tempest-VolumesNegativeTest-913150930-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-337030285" status: 404 len: 98 microversion: 2.1 time: 0.724946 Jan 11 15:10:57.216966 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 4/4] 10.222.0.52 () {58 vars in 1214 bytes} [Tue Jan 11 15:10:56 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-337030285 => generated 98 bytes in 726 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 11 15:10:57.227468 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-5b4e67bd-be74-4f4d-9236-0ad20ace960f tempest-VolumesNegativeTest-913150930 tempest-VolumesNegativeTest-913150930-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005128 Jan 11 15:10:57.228611 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 5/5] 10.222.0.52 () {58 vars in 1139 bytes} [Tue Jan 11 15:10:57 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jan 11 15:10:57.244888 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b9e753f2-f18a-4156-af09-d88565f0f90a tempest-VolumesNegativeTest-913150930 tempest-VolumesNegativeTest-913150930-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006883 Jan 11 15:10:57.245890 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 6/6] 10.222.0.52 () {58 vars in 1136 bytes} [Tue Jan 11 15:10:57 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 11 15:10:57.256126 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3c286868-2093-45a0-84f9-ccd0e28fea46 tempest-VolumesNegativeTest-913150930 tempest-VolumesNegativeTest-913150930-project] Calling method '.version_select at 0x7f16bbc25670>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:10:57.345681 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.wsgi [None req-3c286868-2093-45a0-84f9-ccd0e28fea46 tempest-VolumesNegativeTest-913150930 tempest-VolumesNegativeTest-913150930-project] HTTP exception thrown: Volume d32fe925-99d0-4660-8ba4-3cacecae3dbd could not be found. Jan 11 15:10:57.347407 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3c286868-2093-45a0-84f9-ccd0e28fea46 tempest-VolumesNegativeTest-913150930 tempest-VolumesNegativeTest-913150930-project] Returning 404 to user: Volume d32fe925-99d0-4660-8ba4-3cacecae3dbd could not be found. {{(pid=116903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:10:57.348492 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3c286868-2093-45a0-84f9-ccd0e28fea46 tempest-VolumesNegativeTest-913150930 tempest-VolumesNegativeTest-913150930-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/d32fe925-99d0-4660-8ba4-3cacecae3dbd" status: 404 len: 109 microversion: 2.1 time: 0.097827 Jan 11 15:10:57.350680 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 7/7] 10.222.0.52 () {58 vars in 1247 bytes} [Tue Jan 11 15:10:57 2022] DELETE /compute/v2.1/os-volumes/d32fe925-99d0-4660-8ba4-3cacecae3dbd => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 11 15:10:57.363774 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-0ea03345-95b4-4fd6-ab14-3fe6368afc2d tempest-VolumesNegativeTest-913150930 tempest-VolumesNegativeTest-913150930-project] Calling method '.version_select at 0x7f16bbc25310>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:10:57.430210 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.wsgi [None req-0ea03345-95b4-4fd6-ab14-3fe6368afc2d tempest-VolumesNegativeTest-913150930 tempest-VolumesNegativeTest-913150930-project] HTTP exception thrown: Volume 5beee0f3-7777-4f24-aad6-dec57df1df04 could not be found. Jan 11 15:10:57.431127 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-0ea03345-95b4-4fd6-ab14-3fe6368afc2d tempest-VolumesNegativeTest-913150930 tempest-VolumesNegativeTest-913150930-project] Returning 404 to user: Volume 5beee0f3-7777-4f24-aad6-dec57df1df04 could not be found. {{(pid=116903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:10:57.434208 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-0ea03345-95b4-4fd6-ab14-3fe6368afc2d tempest-VolumesNegativeTest-913150930 tempest-VolumesNegativeTest-913150930-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/5beee0f3-7777-4f24-aad6-dec57df1df04" status: 404 len: 109 microversion: 2.1 time: 0.075036 Jan 11 15:10:57.434788 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 8/8] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jan 11 15:10:57 2022] GET /compute/v2.1/os-volumes/5beee0f3-7777-4f24-aad6-dec57df1df04 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 11 15:10:58.064906 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-af71f6e3-1d90-4277-b6d0-9c345002f782 tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.383934 Jan 11 15:10:58.075466 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1/9] 10.222.0.52 () {60 vars in 1154 bytes} [Tue Jan 11 15:10:55 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2396 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 11 15:10:58.080706 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d831615f-003a-4ad4-a59e-ec9f9a01152c tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] Calling method '.version_select at 0x7f16bbd27e50>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:10:58.196213 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d831615f-003a-4ad4-a59e-ec9f9a01152c tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/5e12ca2e-a900-4077-93a4-5d10c5d57dc8" status: 200 len: 345 microversion: 2.1 time: 0.118379 Jan 11 15:10:58.201693 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 9/10] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jan 11 15:10:58 2022] GET /compute/v2.1/os-volumes/5e12ca2e-a900-4077-93a4-5d10c5d57dc8 => generated 345 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:10:59.209435 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d5f9c688-fe15-46ab-85e1-b561c5b30077 tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] Calling method '.version_select at 0x7f16bbc0d5e0>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:10:59.305192 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d5f9c688-fe15-46ab-85e1-b561c5b30077 tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/5e12ca2e-a900-4077-93a4-5d10c5d57dc8" status: 200 len: 345 microversion: 2.1 time: 0.099597 Jan 11 15:10:59.306064 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 2/11] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jan 11 15:10:59 2022] GET /compute/v2.1/os-volumes/5e12ca2e-a900-4077-93a4-5d10c5d57dc8 => generated 345 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:11:00.374686 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-675e67df-80ae-44e8-a91f-3f3ee7f8750d tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] Calling method '.version_select at 0x7f16bbd273a0>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:00.522258 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-675e67df-80ae-44e8-a91f-3f3ee7f8750d tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/5e12ca2e-a900-4077-93a4-5d10c5d57dc8" status: 200 len: 346 microversion: 2.1 time: 0.151180 Jan 11 15:11:00.523068 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 10/12] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jan 11 15:11:00 2022] GET /compute/v2.1/os-volumes/5e12ca2e-a900-4077-93a4-5d10c5d57dc8 => generated 346 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:11:00.548010 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d865b480-51ef-4817-af02-9875972e5d3f tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] Action: 'create', calling method: .version_select at 0x7f16bbd695e0>, body: {"snapshot": {"volume_id": "5e12ca2e-a900-4077-93a4-5d10c5d57dc8", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1206969780"}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:11:01.487785 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d865b480-51ef-4817-af02-9875972e5d3f tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.943549 Jan 11 15:11:01.493280 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 3/13] 10.222.0.52 () {60 vars in 1161 bytes} [Tue Jan 11 15:11:00 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:11:01.498674 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6ce39112-48aa-4f43-9f17-346ff3c19b2a tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] Calling method '.version_select at 0x7f16bbc24280>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:01.671046 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6ce39112-48aa-4f43-9f17-346ff3c19b2a tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/d60ab4f9-8542-429d-80e0-9b6dcf2ea6f7" status: 200 len: 287 microversion: 2.1 time: 0.176295 Jan 11 15:11:01.671919 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 4/14] 10.222.0.52 () {58 vars in 1250 bytes} [Tue Jan 11 15:11:01 2022] GET /compute/v2.1/os-snapshots/d60ab4f9-8542-429d-80e0-9b6dcf2ea6f7 => generated 287 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:11:01.873378 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-02977c11-044a-4e34-8cb8-d4fd2d0fa375 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2138549478", "imageRef": "d0ce98ab-06a2-4e75-9f37-288864a22cb9", "flavorRef": "452", "networks": [{"uuid": "76369959-3647-4f73-a129-60ab7e24f3af"}]}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:11:01.883319 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6e567693-927f-42d8-8e32-f36567875cba tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1773699504", "imageRef": "d0ce98ab-06a2-4e75-9f37-288864a22cb9", "flavorRef": "452", "networks": [{"uuid": "7a38fc0b-9d06-4671-b670-ce0444018148"}]}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:11:02.055449 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.network.neutron [None req-6e567693-927f-42d8-8e32-f36567875cba tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] validate_networks() for [('7a38fc0b-9d06-4671-b670-ce0444018148', None, None, None, None, None)] {{(pid=116902) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 15:11:02.063585 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.network.neutron [None req-02977c11-044a-4e34-8cb8-d4fd2d0fa375 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] validate_networks() for [('76369959-3647-4f73-a129-60ab7e24f3af', None, None, None, None, None)] {{(pid=116903) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 15:11:05.032356 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-02977c11-044a-4e34-8cb8-d4fd2d0fa375 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Flavor limits 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 15:11:05.032356 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-02977c11-044a-4e34-8cb8-d4fd2d0fa375 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Image limits 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 15:11:05.032356 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-02977c11-044a-4e34-8cb8-d4fd2d0fa375 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Flavor pref 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 15:11:05.032356 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-02977c11-044a-4e34-8cb8-d4fd2d0fa375 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Image pref 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 15:11:05.032356 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-02977c11-044a-4e34-8cb8-d4fd2d0fa375 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 15:11:05.038455 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-6e567693-927f-42d8-8e32-f36567875cba tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Flavor limits 0:0:0 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 15:11:05.038455 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-6e567693-927f-42d8-8e32-f36567875cba tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Image limits 0:0:0 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 15:11:05.038455 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-6e567693-927f-42d8-8e32-f36567875cba tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Flavor pref 0:0:0 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 15:11:05.038455 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-6e567693-927f-42d8-8e32-f36567875cba tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Image pref 0:0:0 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 15:11:05.038455 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-6e567693-927f-42d8-8e32-f36567875cba tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 15:11:05.043120 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-02977c11-044a-4e34-8cb8-d4fd2d0fa375 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:05.043120 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-02977c11-044a-4e34-8cb8-d4fd2d0fa375 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:05.043120 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-02977c11-044a-4e34-8cb8-d4fd2d0fa375 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:05.043120 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-02977c11-044a-4e34-8cb8-d4fd2d0fa375 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:05.044327 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6e567693-927f-42d8-8e32-f36567875cba tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:05.044327 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6e567693-927f-42d8-8e32-f36567875cba tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:05.044327 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6e567693-927f-42d8-8e32-f36567875cba tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:05.044327 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6e567693-927f-42d8-8e32-f36567875cba tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:05.045152 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.quota [None req-02977c11-044a-4e34-8cb8-d4fd2d0fa375 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Getting quotas for project 2ed51a96e66d44ca9c02bbe820c68180. Resources: {'instances', 'cores', 'ram'} {{(pid=116903) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 15:11:05.045623 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.quota [None req-6e567693-927f-42d8-8e32-f36567875cba tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Getting quotas for project d0e00f3a1e834285a367b73021a37cb3. Resources: {'instances', 'cores', 'ram'} {{(pid=116902) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 15:11:05.046011 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.quota [None req-02977c11-044a-4e34-8cb8-d4fd2d0fa375 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Getting quotas for user 13f0a933d4d34f8984292406266866a0 and project 2ed51a96e66d44ca9c02bbe820c68180. Resources: {'instances', 'cores', 'ram'} {{(pid=116903) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 15:11:05.046227 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.quota [None req-6e567693-927f-42d8-8e32-f36567875cba tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Getting quotas for user b68a09e5be614bb5afb475a3d0f67c47 and project d0e00f3a1e834285a367b73021a37cb3. Resources: {'instances', 'cores', 'ram'} {{(pid=116902) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 15:11:05.046227 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6e567693-927f-42d8-8e32-f36567875cba tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Going to run 1 instances... {{(pid=116902) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 15:11:05.046343 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-02977c11-044a-4e34-8cb8-d4fd2d0fa375 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Going to run 1 instances... {{(pid=116903) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 15:11:05.046422 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6e567693-927f-42d8-8e32-f36567875cba tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0ce98ab-06a2-4e75-9f37-288864a22cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 15:11:05.046506 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-02977c11-044a-4e34-8cb8-d4fd2d0fa375 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0ce98ab-06a2-4e75-9f37-288864a22cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 15:11:05.186683 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6e567693-927f-42d8-8e32-f36567875cba tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.507527 Jan 11 15:11:05.186683 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 5/15] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jan 11 15:11:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 3509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 15:11:05.189534 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6e29c5b9-bd49-41b0-9b71-cf0efdf376ca tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] Calling method '.version_select at 0x7f16bbb1ff70>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:05.274047 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-02977c11-044a-4e34-8cb8-d4fd2d0fa375 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.156801 Jan 11 15:11:05.274709 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 11/16] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jan 11 15:11:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 4159 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 15:11:05.291723 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-8c586afa-20b0-4aa0-a47b-25a9b7d600eb tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:05.292365 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-8c586afa-20b0-4aa0-a47b-25a9b7d600eb tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:05.323305 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6e29c5b9-bd49-41b0-9b71-cf0efdf376ca tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.140705 Jan 11 15:11:05.331793 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 6/17] 10.222.0.52 () {58 vars in 1139 bytes} [Tue Jan 11 15:11:05 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:11:05.340628 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0603f893-fe94-487b-b9d9-3dc246e951b9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:05.341276 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0603f893-fe94-487b-b9d9-3dc246e951b9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:05.581105 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-8c586afa-20b0-4aa0-a47b-25a9b7d600eb tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:05.605185 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-8c586afa-20b0-4aa0-a47b-25a9b7d600eb tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1215 microversion: 2.1 time: 0.324054 Jan 11 15:11:05.605956 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 12/18] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:05 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1215 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:05.610617 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d497e7ae-b085-4edc-a9e5-b1c761ff0c7d tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] Calling method '.version_select at 0x7f16baacb700>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:05.640856 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0603f893-fe94-487b-b9d9-3dc246e951b9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:05.658049 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d497e7ae-b085-4edc-a9e5-b1c761ff0c7d tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/d60ab4f9-8542-429d-80e0-9b6dcf2ea6f7" status: 200 len: 287 microversion: 2.1 time: 0.048496 Jan 11 15:11:05.660459 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 13/19] 10.222.0.52 () {58 vars in 1250 bytes} [Tue Jan 11 15:11:05 2022] GET /compute/v2.1/os-snapshots/d60ab4f9-8542-429d-80e0-9b6dcf2ea6f7 => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:11:05.682044 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0603f893-fe94-487b-b9d9-3dc246e951b9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be" status: 200 len: 1218 microversion: 2.1 time: 0.354437 Jan 11 15:11:05.684167 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 7/20] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:05 2022] GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be => generated 1218 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:06.587973 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-bdeb13b0-556f-45ea-9bc7-6b8ecc1ac9aa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2129438968", "imageRef": "d0ce98ab-06a2-4e75-9f37-288864a22cb9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38f2cfcc-7950-4b21-8532-44c7109d5cca"}]}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:11:06.714809 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.network.neutron [None req-bdeb13b0-556f-45ea-9bc7-6b8ecc1ac9aa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] validate_networks() for [('38f2cfcc-7950-4b21-8532-44c7109d5cca', None, None, None, None, None)] {{(pid=116903) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 15:11:06.764095 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5d44bd62-ab11-40b1-9898-403b4bfbc37a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'create', calling method: .version_select at 0x7f16bbc24670>, body: {"keypair": {"name": "tempest-keypair-830658203"}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:11:06.902094 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.quota [None req-5d44bd62-ab11-40b1-9898-403b4bfbc37a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Getting quotas for project 06f9437149e449d6b1d1d9a69601b197. Resources: {'key_pairs'} {{(pid=116902) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 15:11:06.929493 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.quota [None req-5d44bd62-ab11-40b1-9898-403b4bfbc37a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Getting quotas for user 055cca7e9794424a8962422a9b5dda1d and project 06f9437149e449d6b1d1d9a69601b197. Resources: {'key_pairs'} {{(pid=116902) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 15:11:07.749884 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-bdeb13b0-556f-45ea-9bc7-6b8ecc1ac9aa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Flavor limits 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 15:11:07.750371 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-bdeb13b0-556f-45ea-9bc7-6b8ecc1ac9aa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Image limits 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 15:11:07.750787 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-bdeb13b0-556f-45ea-9bc7-6b8ecc1ac9aa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Flavor pref 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 15:11:07.751198 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-bdeb13b0-556f-45ea-9bc7-6b8ecc1ac9aa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Image pref 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 15:11:07.751650 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-bdeb13b0-556f-45ea-9bc7-6b8ecc1ac9aa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 15:11:07.761496 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bdeb13b0-556f-45ea-9bc7-6b8ecc1ac9aa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:07.761982 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bdeb13b0-556f-45ea-9bc7-6b8ecc1ac9aa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:07.762789 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bdeb13b0-556f-45ea-9bc7-6b8ecc1ac9aa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:07.763227 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bdeb13b0-556f-45ea-9bc7-6b8ecc1ac9aa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:07.780696 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.quota [None req-bdeb13b0-556f-45ea-9bc7-6b8ecc1ac9aa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Getting quotas for project 46dc68d56028437c845a8b922ebb73fa. Resources: {'instances', 'cores', 'ram'} {{(pid=116903) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 15:11:07.784370 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.quota [None req-bdeb13b0-556f-45ea-9bc7-6b8ecc1ac9aa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Getting quotas for user ebbdfb4cffb24af08af575c0742abcfe and project 46dc68d56028437c845a8b922ebb73fa. Resources: {'instances', 'cores', 'ram'} {{(pid=116903) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 15:11:07.795035 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-bdeb13b0-556f-45ea-9bc7-6b8ecc1ac9aa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Going to run 1 instances... {{(pid=116903) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 15:11:07.797267 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-bdeb13b0-556f-45ea-9bc7-6b8ecc1ac9aa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0ce98ab-06a2-4e75-9f37-288864a22cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 15:11:07.898007 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.quota [None req-5d44bd62-ab11-40b1-9898-403b4bfbc37a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Getting quotas for project 06f9437149e449d6b1d1d9a69601b197. Resources: {'key_pairs'} {{(pid=116902) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 15:11:07.902100 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.quota [None req-5d44bd62-ab11-40b1-9898-403b4bfbc37a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Getting quotas for user 055cca7e9794424a8962422a9b5dda1d and project 06f9437149e449d6b1d1d9a69601b197. Resources: {'key_pairs'} {{(pid=116902) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 15:11:07.916080 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5d44bd62-ab11-40b1-9898-403b4bfbc37a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.309514 Jan 11 15:11:07.931329 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 8/21] 10.222.0.52 () {62 vars in 1198 bytes} [Tue Jan 11 15:11:06 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1311 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 11 15:11:07.931329 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-cbef3809-adfc-46d0-aa26-d25e32b5c0d6 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:07.931329 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-cbef3809-adfc-46d0-aa26-d25e32b5c0d6 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:07.956925 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-bdeb13b0-556f-45ea-9bc7-6b8ecc1ac9aa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.087283 Jan 11 15:11:07.967705 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 14/22] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jan 11 15:11:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 2099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 15:11:07.975972 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-26d83615-6cf7-4ad4-a942-8135a33ad3e5 tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] Calling method '.version_select at 0x7f16baad1af0>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:08.037645 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-26d83615-6cf7-4ad4-a942-8135a33ad3e5 tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/d60ab4f9-8542-429d-80e0-9b6dcf2ea6f7" status: 200 len: 288 microversion: 2.1 time: 0.067958 Jan 11 15:11:08.039182 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 15/23] 10.222.0.52 () {58 vars in 1250 bytes} [Tue Jan 11 15:11:07 2022] GET /compute/v2.1/os-snapshots/d60ab4f9-8542-429d-80e0-9b6dcf2ea6f7 => generated 288 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:11:08.044366 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2fe914c9-2e79-45a1-b377-97568bacd2ff tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:08.044992 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2fe914c9-2e79-45a1-b377-97568bacd2ff tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:08.063685 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-cbef3809-adfc-46d0-aa26-d25e32b5c0d6 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:08.080384 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-cbef3809-adfc-46d0-aa26-d25e32b5c0d6 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1215 microversion: 2.1 time: 0.160329 Jan 11 15:11:08.092056 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 9/24] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:07 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1215 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:08.107325 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d355ae08-96b4-46ee-b408-ed3fee7d12c1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:08.112583 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d355ae08-96b4-46ee-b408-ed3fee7d12c1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:08.292433 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-2fe914c9-2e79-45a1-b377-97568bacd2ff tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:08.297389 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2fe914c9-2e79-45a1-b377-97568bacd2ff tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be" status: 200 len: 1218 microversion: 2.1 time: 0.256886 Jan 11 15:11:08.312640 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 16/25] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:08 2022] GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be => generated 1218 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:08.322193 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-bc7bb0ed-6661-49be-8494-356a5181b5a4 tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] Calling method '.version_select at 0x7f16baacbca0>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:08.385172 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d355ae08-96b4-46ee-b408-ed3fee7d12c1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:08.397753 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d355ae08-96b4-46ee-b408-ed3fee7d12c1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1222 microversion: 2.1 time: 0.306346 Jan 11 15:11:08.418105 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 10/26] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:08 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1222 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:08.589294 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-bc7bb0ed-6661-49be-8494-356a5181b5a4 tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/d60ab4f9-8542-429d-80e0-9b6dcf2ea6f7" status: 202 len: 0 microversion: 2.1 time: 0.272987 Jan 11 15:11:08.589294 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 17/27] 10.222.0.52 () {58 vars in 1253 bytes} [Tue Jan 11 15:11:08 2022] DELETE /compute/v2.1/os-snapshots/d60ab4f9-8542-429d-80e0-9b6dcf2ea6f7 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:11:08.598298 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-51fd8b36-e238-458e-a028-c35b7688ca97 tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] Calling method '.version_select at 0x7f16ba28a160>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:08.645189 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-51fd8b36-e238-458e-a028-c35b7688ca97 tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/d60ab4f9-8542-429d-80e0-9b6dcf2ea6f7" status: 200 len: 287 microversion: 2.1 time: 0.052427 Jan 11 15:11:08.651795 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 11/28] 10.222.0.52 () {58 vars in 1250 bytes} [Tue Jan 11 15:11:08 2022] GET /compute/v2.1/os-snapshots/d60ab4f9-8542-429d-80e0-9b6dcf2ea6f7 => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:11:08.652319 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e50603eb-7a85-403f-abf0-2c42f3ec0c87 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-260351959", "imageRef": "d0ce98ab-06a2-4e75-9f37-288864a22cb9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38f2cfcc-7950-4b21-8532-44c7109d5cca"}]}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:11:08.763637 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.network.neutron [None req-e50603eb-7a85-403f-abf0-2c42f3ec0c87 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] validate_networks() for [('38f2cfcc-7950-4b21-8532-44c7109d5cca', None, None, None, None, None)] {{(pid=116903) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 15:11:09.104036 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3ed8dea6-e286-4afa-b7e6-7aa357720eea tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:09.104750 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3ed8dea6-e286-4afa-b7e6-7aa357720eea tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:09.361186 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3ed8dea6-e286-4afa-b7e6-7aa357720eea tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:09.377291 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3ed8dea6-e286-4afa-b7e6-7aa357720eea tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1215 microversion: 2.1 time: 0.277675 Jan 11 15:11:09.388866 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 12/29] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:09 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1215 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:09.391741 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d4292ee4-e8a0-4717-81af-cda1650c74ca tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:09.394755 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d4292ee4-e8a0-4717-81af-cda1650c74ca tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:09.413049 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d4292ee4-e8a0-4717-81af-cda1650c74ca tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:09.413480 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d4292ee4-e8a0-4717-81af-cda1650c74ca tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:09.414539 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d4292ee4-e8a0-4717-81af-cda1650c74ca tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:09.415443 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d4292ee4-e8a0-4717-81af-cda1650c74ca tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:09.862321 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d4292ee4-e8a0-4717-81af-cda1650c74ca tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:09.875024 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d4292ee4-e8a0-4717-81af-cda1650c74ca tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be" status: 200 len: 1222 microversion: 2.1 time: 0.493285 Jan 11 15:11:09.875645 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 13/30] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:09 2022] GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be => generated 1222 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:09.885019 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-be990c3e-9886-4835-b2bb-a3a90849ffd9 tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] Calling method '.version_select at 0x7f16ba20a790>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:09.920578 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.wsgi [None req-be990c3e-9886-4835-b2bb-a3a90849ffd9 tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] HTTP exception thrown: Snapshot d60ab4f9-8542-429d-80e0-9b6dcf2ea6f7 could not be found. Jan 11 15:11:09.923128 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-be990c3e-9886-4835-b2bb-a3a90849ffd9 tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] Returning 404 to user: Snapshot d60ab4f9-8542-429d-80e0-9b6dcf2ea6f7 could not be found. {{(pid=116902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:11:09.926008 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-be990c3e-9886-4835-b2bb-a3a90849ffd9 tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/d60ab4f9-8542-429d-80e0-9b6dcf2ea6f7" status: 404 len: 111 microversion: 2.1 time: 0.047718 Jan 11 15:11:09.931634 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 14/31] 10.222.0.52 () {58 vars in 1250 bytes} [Tue Jan 11 15:11:09 2022] GET /compute/v2.1/os-snapshots/d60ab4f9-8542-429d-80e0-9b6dcf2ea6f7 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 15:11:10.017169 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-e50603eb-7a85-403f-abf0-2c42f3ec0c87 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Flavor limits 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 15:11:10.017722 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-e50603eb-7a85-403f-abf0-2c42f3ec0c87 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Image limits 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 15:11:10.018063 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-e50603eb-7a85-403f-abf0-2c42f3ec0c87 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Flavor pref 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 15:11:10.018525 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-e50603eb-7a85-403f-abf0-2c42f3ec0c87 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Image pref 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 15:11:10.018944 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-e50603eb-7a85-403f-abf0-2c42f3ec0c87 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 15:11:10.028406 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e50603eb-7a85-403f-abf0-2c42f3ec0c87 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:10.029098 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e50603eb-7a85-403f-abf0-2c42f3ec0c87 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:10.029980 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e50603eb-7a85-403f-abf0-2c42f3ec0c87 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:10.030545 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e50603eb-7a85-403f-abf0-2c42f3ec0c87 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:10.047918 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.quota [None req-e50603eb-7a85-403f-abf0-2c42f3ec0c87 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Getting quotas for project 46dc68d56028437c845a8b922ebb73fa. Resources: {'instances', 'cores', 'ram'} {{(pid=116903) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 15:11:10.052037 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.quota [None req-e50603eb-7a85-403f-abf0-2c42f3ec0c87 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Getting quotas for user ebbdfb4cffb24af08af575c0742abcfe and project 46dc68d56028437c845a8b922ebb73fa. Resources: {'instances', 'cores', 'ram'} {{(pid=116903) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 15:11:10.068191 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e50603eb-7a85-403f-abf0-2c42f3ec0c87 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Going to run 1 instances... {{(pid=116903) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 15:11:10.071360 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e50603eb-7a85-403f-abf0-2c42f3ec0c87 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0ce98ab-06a2-4e75-9f37-288864a22cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 15:11:10.127713 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-191ab7bf-8963-4a09-9d98-096bffa12b39 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'create', calling method: .version_select at 0x7f16ba20a3a0>, body: {"keypair": {"name": "tempest-keypair-1576827656"}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:11:10.154451 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.quota [None req-191ab7bf-8963-4a09-9d98-096bffa12b39 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Getting quotas for project 9d979bb0d7f04bbe99fa7215278f1051. Resources: {'key_pairs'} {{(pid=116902) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 15:11:10.159215 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.quota [None req-191ab7bf-8963-4a09-9d98-096bffa12b39 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Getting quotas for user b805c31cc5924c6d98c83718d1884440 and project 9d979bb0d7f04bbe99fa7215278f1051. Resources: {'key_pairs'} {{(pid=116902) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 15:11:10.241526 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e50603eb-7a85-403f-abf0-2c42f3ec0c87 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.596724 Jan 11 15:11:10.242543 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 18/32] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jan 11 15:11:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 1599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 15:11:10.247170 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c457db26-9a52-4829-b43f-fd8935573b99 tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] Calling method '.version_select at 0x7f16baadeca0>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:10.593608 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c457db26-9a52-4829-b43f-fd8935573b99 tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/5e12ca2e-a900-4077-93a4-5d10c5d57dc8" status: 202 len: 0 microversion: 2.1 time: 0.349558 Jan 11 15:11:10.597914 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 19/33] 10.222.0.52 () {58 vars in 1247 bytes} [Tue Jan 11 15:11:10 2022] DELETE /compute/v2.1/os-volumes/5e12ca2e-a900-4077-93a4-5d10c5d57dc8 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:11:10.600830 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-8461bdbb-c2e1-4148-ba87-6e8dcfd18ad6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:10.601710 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-8461bdbb-c2e1-4148-ba87-6e8dcfd18ad6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:10.729900 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-8461bdbb-c2e1-4148-ba87-6e8dcfd18ad6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:10.736687 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-8461bdbb-c2e1-4148-ba87-6e8dcfd18ad6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1221 microversion: 2.1 time: 0.141132 Jan 11 15:11:10.737260 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 20/34] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:10 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1221 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:10.745108 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f3e9bbf4-b1ad-4d1e-849a-1464307e10f0 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:10.745860 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f3e9bbf4-b1ad-4d1e-849a-1464307e10f0 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:10.753123 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f3e9bbf4-b1ad-4d1e-849a-1464307e10f0 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:10.753382 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f3e9bbf4-b1ad-4d1e-849a-1464307e10f0 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:10.754289 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f3e9bbf4-b1ad-4d1e-849a-1464307e10f0 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:10.754836 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f3e9bbf4-b1ad-4d1e-849a-1464307e10f0 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:10.836648 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.quota [None req-191ab7bf-8963-4a09-9d98-096bffa12b39 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Getting quotas for project 9d979bb0d7f04bbe99fa7215278f1051. Resources: {'key_pairs'} {{(pid=116902) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 15:11:10.869747 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.quota [None req-191ab7bf-8963-4a09-9d98-096bffa12b39 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Getting quotas for user b805c31cc5924c6d98c83718d1884440 and project 9d979bb0d7f04bbe99fa7215278f1051. Resources: {'key_pairs'} {{(pid=116902) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 15:11:10.910917 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-191ab7bf-8963-4a09-9d98-096bffa12b39 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.974496 Jan 11 15:11:10.912277 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 15/35] 10.222.0.52 () {60 vars in 1157 bytes} [Tue Jan 11 15:11:09 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:10.927113 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0117264b-a348-49fe-b3e8-12d89ff2c335 tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] Calling method '.version_select at 0x7f16ba28a700>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:11.085785 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0117264b-a348-49fe-b3e8-12d89ff2c335 tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/5e12ca2e-a900-4077-93a4-5d10c5d57dc8" status: 200 len: 345 microversion: 2.1 time: 0.171722 Jan 11 15:11:11.086608 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 16/36] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jan 11 15:11:10 2022] GET /compute/v2.1/os-volumes/5e12ca2e-a900-4077-93a4-5d10c5d57dc8 => generated 345 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:11:11.091652 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-de466c86-0ce7-482a-83ed-e89b60235340 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:11.093654 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-de466c86-0ce7-482a-83ed-e89b60235340 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:11.111529 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-de466c86-0ce7-482a-83ed-e89b60235340 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:11.113365 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-de466c86-0ce7-482a-83ed-e89b60235340 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:11.114576 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-de466c86-0ce7-482a-83ed-e89b60235340 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:11.115870 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-de466c86-0ce7-482a-83ed-e89b60235340 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:11.145288 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-f3e9bbf4-b1ad-4d1e-849a-1464307e10f0 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:11.175004 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f3e9bbf4-b1ad-4d1e-849a-1464307e10f0 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1211 microversion: 2.1 time: 0.435474 Jan 11 15:11:11.177347 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 21/37] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:10 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1211 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:11.456720 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-de466c86-0ce7-482a-83ed-e89b60235340 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:11.465224 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-de466c86-0ce7-482a-83ed-e89b60235340 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be" status: 200 len: 1270 microversion: 2.1 time: 0.377361 Jan 11 15:11:11.471027 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 17/38] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:11 2022] GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be => generated 1270 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:11.754893 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-26d4811f-1873-4c70-9cb1-cf77f406d26e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:11.755755 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-26d4811f-1873-4c70-9cb1-cf77f406d26e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:11.765945 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-26d4811f-1873-4c70-9cb1-cf77f406d26e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:11.769503 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-26d4811f-1873-4c70-9cb1-cf77f406d26e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:11.777831 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-26d4811f-1873-4c70-9cb1-cf77f406d26e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:11.781239 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-26d4811f-1873-4c70-9cb1-cf77f406d26e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:12.099375 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7a8aabe4-7cb8-4f2a-8e13-0d80a63132c0 tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] Calling method '.version_select at 0x7f16ba22a430>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:12.162523 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.wsgi [None req-7a8aabe4-7cb8-4f2a-8e13-0d80a63132c0 tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] HTTP exception thrown: Volume 5e12ca2e-a900-4077-93a4-5d10c5d57dc8 could not be found. Jan 11 15:11:12.162523 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7a8aabe4-7cb8-4f2a-8e13-0d80a63132c0 tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] Returning 404 to user: Volume 5e12ca2e-a900-4077-93a4-5d10c5d57dc8 could not be found. {{(pid=116902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:11:12.162977 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7a8aabe4-7cb8-4f2a-8e13-0d80a63132c0 tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/5e12ca2e-a900-4077-93a4-5d10c5d57dc8" status: 404 len: 109 microversion: 2.1 time: 0.067569 Jan 11 15:11:12.167593 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 18/39] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jan 11 15:11:12 2022] GET /compute/v2.1/os-volumes/5e12ca2e-a900-4077-93a4-5d10c5d57dc8 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 15:11:12.173124 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3eea05c3-99c0-47fc-8eee-6a094a34e7df tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] Calling method '.version_select at 0x7f16ba21d040>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:12.235458 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.wsgi [None req-3eea05c3-99c0-47fc-8eee-6a094a34e7df tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] HTTP exception thrown: Volume 5e12ca2e-a900-4077-93a4-5d10c5d57dc8 could not be found. Jan 11 15:11:12.236074 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3eea05c3-99c0-47fc-8eee-6a094a34e7df tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] Returning 404 to user: Volume 5e12ca2e-a900-4077-93a4-5d10c5d57dc8 could not be found. {{(pid=116902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:11:12.236904 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3eea05c3-99c0-47fc-8eee-6a094a34e7df tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/5e12ca2e-a900-4077-93a4-5d10c5d57dc8" status: 404 len: 109 microversion: 2.1 time: 0.068154 Jan 11 15:11:12.240433 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 19/40] 10.222.0.52 () {58 vars in 1247 bytes} [Tue Jan 11 15:11:12 2022] DELETE /compute/v2.1/os-volumes/5e12ca2e-a900-4077-93a4-5d10c5d57dc8 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 11 15:11:12.245958 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-35d1f8e5-c063-4a94-9be4-a5ff09784ff1 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:12.246849 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-35d1f8e5-c063-4a94-9be4-a5ff09784ff1 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:12.283187 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-35d1f8e5-c063-4a94-9be4-a5ff09784ff1 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:12.285627 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-35d1f8e5-c063-4a94-9be4-a5ff09784ff1 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:12.288282 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-35d1f8e5-c063-4a94-9be4-a5ff09784ff1 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:12.291127 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-35d1f8e5-c063-4a94-9be4-a5ff09784ff1 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:12.333750 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-26d4811f-1873-4c70-9cb1-cf77f406d26e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:12.348544 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-26d4811f-1873-4c70-9cb1-cf77f406d26e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1225 microversion: 2.1 time: 0.592222 Jan 11 15:11:12.350066 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 22/41] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:11 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1225 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:12.364276 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e7a11834-9193-46d1-9f87-41dddc3c495f tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] Calling method '.version_select at 0x7f16baad1ca0>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:12.450951 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.wsgi [None req-e7a11834-9193-46d1-9f87-41dddc3c495f tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] HTTP exception thrown: Volume 5e12ca2e-a900-4077-93a4-5d10c5d57dc8 could not be found. Jan 11 15:11:12.451719 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e7a11834-9193-46d1-9f87-41dddc3c495f tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] Returning 404 to user: Volume 5e12ca2e-a900-4077-93a4-5d10c5d57dc8 could not be found. {{(pid=116903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:11:12.457809 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e7a11834-9193-46d1-9f87-41dddc3c495f tempest-VolumesSnapshotsTestJSON-74924276 tempest-VolumesSnapshotsTestJSON-74924276-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/5e12ca2e-a900-4077-93a4-5d10c5d57dc8" status: 404 len: 109 microversion: 2.1 time: 0.097076 Jan 11 15:11:12.458404 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 23/42] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jan 11 15:11:12 2022] GET /compute/v2.1/os-volumes/5e12ca2e-a900-4077-93a4-5d10c5d57dc8 => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 15:11:12.488575 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d3d550cf-f3f3-4ae9-8f8e-bd6a861b8575 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:12.490557 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d3d550cf-f3f3-4ae9-8f8e-bd6a861b8575 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:12.511031 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d3d550cf-f3f3-4ae9-8f8e-bd6a861b8575 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:12.511031 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d3d550cf-f3f3-4ae9-8f8e-bd6a861b8575 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:12.511031 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d3d550cf-f3f3-4ae9-8f8e-bd6a861b8575 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:12.511031 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d3d550cf-f3f3-4ae9-8f8e-bd6a861b8575 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:12.567544 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-35d1f8e5-c063-4a94-9be4-a5ff09784ff1 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:12.579017 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-35d1f8e5-c063-4a94-9be4-a5ff09784ff1 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1285 microversion: 2.1 time: 0.337090 Jan 11 15:11:12.589605 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 20/43] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:12 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1285 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:12.682738 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-d3d550cf-f3f3-4ae9-8f8e-bd6a861b8575 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:12.704268 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d3d550cf-f3f3-4ae9-8f8e-bd6a861b8575 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be" status: 200 len: 1276 microversion: 2.1 time: 0.219558 Jan 11 15:11:12.710212 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 24/44] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:12 2022] GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be => generated 1276 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:13.372623 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a338fd50-1ac4-4858-bb34-1a3afbc2de93 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:13.372623 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a338fd50-1ac4-4858-bb34-1a3afbc2de93 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:13.382402 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a338fd50-1ac4-4858-bb34-1a3afbc2de93 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:13.385759 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a338fd50-1ac4-4858-bb34-1a3afbc2de93 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:13.387335 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a338fd50-1ac4-4858-bb34-1a3afbc2de93 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:13.387811 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a338fd50-1ac4-4858-bb34-1a3afbc2de93 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:13.612163 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-637ad75d-f649-48cc-88b8-1fda56f42f8f tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:13.614057 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-637ad75d-f649-48cc-88b8-1fda56f42f8f tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:13.634583 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-637ad75d-f649-48cc-88b8-1fda56f42f8f tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:13.635734 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-637ad75d-f649-48cc-88b8-1fda56f42f8f tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:13.648255 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-637ad75d-f649-48cc-88b8-1fda56f42f8f tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:13.649100 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-637ad75d-f649-48cc-88b8-1fda56f42f8f tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:13.931329 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a338fd50-1ac4-4858-bb34-1a3afbc2de93 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:13.941072 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a338fd50-1ac4-4858-bb34-1a3afbc2de93 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1273 microversion: 2.1 time: 0.579565 Jan 11 15:11:13.964557 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 21/45] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:13 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1273 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:13.977607 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9da4f03e-230c-4df9-ae26-a7be8ed86eb3 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:13.978542 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9da4f03e-230c-4df9-ae26-a7be8ed86eb3 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:13.986379 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9da4f03e-230c-4df9-ae26-a7be8ed86eb3 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:13.987628 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9da4f03e-230c-4df9-ae26-a7be8ed86eb3 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:13.988765 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9da4f03e-230c-4df9-ae26-a7be8ed86eb3 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:13.989355 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9da4f03e-230c-4df9-ae26-a7be8ed86eb3 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:14.140531 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-637ad75d-f649-48cc-88b8-1fda56f42f8f tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:14.156789 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-637ad75d-f649-48cc-88b8-1fda56f42f8f tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1273 microversion: 2.1 time: 0.561806 Jan 11 15:11:14.160091 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 25/46] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:13 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1273 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:14.179374 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-9da4f03e-230c-4df9-ae26-a7be8ed86eb3 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:14.187635 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9da4f03e-230c-4df9-ae26-a7be8ed86eb3 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be" status: 200 len: 1276 microversion: 2.1 time: 0.239035 Jan 11 15:11:14.188449 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 22/47] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:13 2022] GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be => generated 1276 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:14.972877 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-8bed2101-9699-4995-b7df-33a4ea7828c9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:14.977702 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-8bed2101-9699-4995-b7df-33a4ea7828c9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:14.988234 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8bed2101-9699-4995-b7df-33a4ea7828c9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:14.989099 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8bed2101-9699-4995-b7df-33a4ea7828c9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:14.991828 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8bed2101-9699-4995-b7df-33a4ea7828c9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:14.994497 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8bed2101-9699-4995-b7df-33a4ea7828c9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:15.113728 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0e5157b3-2788-48c6-aa75-f6af8e18b95d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1702971704", "imageRef": "d0ce98ab-06a2-4e75-9f37-288864a22cb9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5b9f0d65-d5f3-4656-9171-4a158424da81"}], "security_groups": [{"name": "tempest-securitygroup--1487856924"}], "key_name": "tempest-keypair-830658203", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:11:15.258095 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-8bed2101-9699-4995-b7df-33a4ea7828c9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:15.273262 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-8bed2101-9699-4995-b7df-33a4ea7828c9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1273 microversion: 2.1 time: 0.301194 Jan 11 15:11:15.273262 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 26/48] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:14 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1273 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:15.278326 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2075ab1a-ae8e-481d-a476-88fb482c5819 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:15.285215 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2075ab1a-ae8e-481d-a476-88fb482c5819 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:15.295491 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2075ab1a-ae8e-481d-a476-88fb482c5819 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:15.298314 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2075ab1a-ae8e-481d-a476-88fb482c5819 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:15.299306 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2075ab1a-ae8e-481d-a476-88fb482c5819 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:15.299890 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2075ab1a-ae8e-481d-a476-88fb482c5819 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:15.416359 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.network.neutron [None req-0e5157b3-2788-48c6-aa75-f6af8e18b95d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] validate_networks() for [('5b9f0d65-d5f3-4656-9171-4a158424da81', None, None, None, None, None)] {{(pid=116902) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 15:11:15.642767 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-2075ab1a-ae8e-481d-a476-88fb482c5819 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:15.655001 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2075ab1a-ae8e-481d-a476-88fb482c5819 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1315 microversion: 2.1 time: 0.384041 Jan 11 15:11:15.667972 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 27/49] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:15 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:15.702317 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-af7ddbd1-1a20-4899-9e64-ea4fa2ad40e4 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:15.702317 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-af7ddbd1-1a20-4899-9e64-ea4fa2ad40e4 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:15.725492 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-af7ddbd1-1a20-4899-9e64-ea4fa2ad40e4 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:15.725960 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-af7ddbd1-1a20-4899-9e64-ea4fa2ad40e4 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:15.738014 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-af7ddbd1-1a20-4899-9e64-ea4fa2ad40e4 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:15.738827 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-af7ddbd1-1a20-4899-9e64-ea4fa2ad40e4 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:16.218508 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-af7ddbd1-1a20-4899-9e64-ea4fa2ad40e4 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:16.231866 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-af7ddbd1-1a20-4899-9e64-ea4fa2ad40e4 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be" status: 200 len: 1318 microversion: 2.1 time: 0.560804 Jan 11 15:11:16.242612 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 28/50] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:15 2022] GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be => generated 1318 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:16.289121 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-dd80f0a7-f997-40c1-9b66-354b6b23e0a6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:16.290310 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-dd80f0a7-f997-40c1-9b66-354b6b23e0a6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:16.299524 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-dd80f0a7-f997-40c1-9b66-354b6b23e0a6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:16.300251 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-dd80f0a7-f997-40c1-9b66-354b6b23e0a6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:16.301363 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-dd80f0a7-f997-40c1-9b66-354b6b23e0a6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:16.301953 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-dd80f0a7-f997-40c1-9b66-354b6b23e0a6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:16.432766 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-dd80f0a7-f997-40c1-9b66-354b6b23e0a6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:16.445741 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-dd80f0a7-f997-40c1-9b66-354b6b23e0a6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1273 microversion: 2.1 time: 0.162823 Jan 11 15:11:16.451151 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 29/51] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:16 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1273 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:16.523209 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-0e5157b3-2788-48c6-aa75-f6af8e18b95d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Flavor limits 0:0:0 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 15:11:16.524489 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-0e5157b3-2788-48c6-aa75-f6af8e18b95d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Image limits 0:0:0 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 15:11:16.525178 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-0e5157b3-2788-48c6-aa75-f6af8e18b95d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Flavor pref 0:0:0 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 15:11:16.525844 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-0e5157b3-2788-48c6-aa75-f6af8e18b95d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Image pref 0:0:0 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 15:11:16.526618 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-0e5157b3-2788-48c6-aa75-f6af8e18b95d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 15:11:16.553093 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0e5157b3-2788-48c6-aa75-f6af8e18b95d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:16.554825 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0e5157b3-2788-48c6-aa75-f6af8e18b95d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:16.555903 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0e5157b3-2788-48c6-aa75-f6af8e18b95d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:16.557323 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0e5157b3-2788-48c6-aa75-f6af8e18b95d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:16.602456 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.quota [None req-0e5157b3-2788-48c6-aa75-f6af8e18b95d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Getting quotas for project 06f9437149e449d6b1d1d9a69601b197. Resources: {'instances', 'cores', 'ram'} {{(pid=116902) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 15:11:16.607368 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.quota [None req-0e5157b3-2788-48c6-aa75-f6af8e18b95d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Getting quotas for user 055cca7e9794424a8962422a9b5dda1d and project 06f9437149e449d6b1d1d9a69601b197. Resources: {'instances', 'cores', 'ram'} {{(pid=116902) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 15:11:16.635766 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0e5157b3-2788-48c6-aa75-f6af8e18b95d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Going to run 1 instances... {{(pid=116902) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 15:11:16.645427 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0e5157b3-2788-48c6-aa75-f6af8e18b95d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0ce98ab-06a2-4e75-9f37-288864a22cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 15:11:16.678377 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-0faacfc1-0375-47f7-ae6c-4812ece484e6 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:16.680168 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-0faacfc1-0375-47f7-ae6c-4812ece484e6 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:16.694909 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0faacfc1-0375-47f7-ae6c-4812ece484e6 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:16.696738 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0faacfc1-0375-47f7-ae6c-4812ece484e6 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:16.701556 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0faacfc1-0375-47f7-ae6c-4812ece484e6 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:16.703988 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0faacfc1-0375-47f7-ae6c-4812ece484e6 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:16.941494 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0e5157b3-2788-48c6-aa75-f6af8e18b95d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.828498 Jan 11 15:11:16.942208 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 23/52] 10.222.0.52 () {62 vars in 1187 bytes} [Tue Jan 11 15:11:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 1837 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jan 11 15:11:16.954021 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-19d76a49-24c9-4539-9f5a-81f7d86a96c2 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:16.954860 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-19d76a49-24c9-4539-9f5a-81f7d86a96c2 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:17.340495 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-19d76a49-24c9-4539-9f5a-81f7d86a96c2 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:17.350016 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-19d76a49-24c9-4539-9f5a-81f7d86a96c2 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:17.359310 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-19d76a49-24c9-4539-9f5a-81f7d86a96c2 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:17.361332 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-19d76a49-24c9-4539-9f5a-81f7d86a96c2 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda" status: 200 len: 1281 microversion: 2.20 time: 0.411338 Jan 11 15:11:17.377716 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 24/53] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:11:16 2022] GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda => generated 1281 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 15:11:17.387092 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c7c8da4d-4eac-41c0-b970-f7e375028414 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:17.390885 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c7c8da4d-4eac-41c0-b970-f7e375028414 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:17.404526 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c7c8da4d-4eac-41c0-b970-f7e375028414 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:17.408257 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c7c8da4d-4eac-41c0-b970-f7e375028414 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:17.409825 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c7c8da4d-4eac-41c0-b970-f7e375028414 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:17.410426 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c7c8da4d-4eac-41c0-b970-f7e375028414 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:18.044081 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-0faacfc1-0375-47f7-ae6c-4812ece484e6 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:18.054203 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-0faacfc1-0375-47f7-ae6c-4812ece484e6 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1315 microversion: 2.1 time: 1.382802 Jan 11 15:11:18.063802 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 30/54] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:16 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1315 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:11:18.077609 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-5bc77f88-68df-4ada-906c-46459b3e9db0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:18.077609 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-5bc77f88-68df-4ada-906c-46459b3e9db0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:18.101461 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5bc77f88-68df-4ada-906c-46459b3e9db0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:18.105833 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5bc77f88-68df-4ada-906c-46459b3e9db0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:18.105833 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5bc77f88-68df-4ada-906c-46459b3e9db0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:18.105833 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5bc77f88-68df-4ada-906c-46459b3e9db0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:18.295229 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-5bc77f88-68df-4ada-906c-46459b3e9db0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:18.307685 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-5bc77f88-68df-4ada-906c-46459b3e9db0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1291 microversion: 2.1 time: 0.242435 Jan 11 15:11:18.308651 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 31/55] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:18 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1291 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:18.385390 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-5fb8e12a-8e80-47e2-afbe-d16b82472b4c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:18.386464 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-5fb8e12a-8e80-47e2-afbe-d16b82472b4c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:18.548198 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c7c8da4d-4eac-41c0-b970-f7e375028414 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:18.570136 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c7c8da4d-4eac-41c0-b970-f7e375028414 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be" status: 200 len: 1318 microversion: 2.1 time: 1.180423 Jan 11 15:11:18.574826 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 25/56] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:17 2022] GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be => generated 1318 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:18.635695 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-5fb8e12a-8e80-47e2-afbe-d16b82472b4c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:18.656870 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-5fb8e12a-8e80-47e2-afbe-d16b82472b4c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:18.661095 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-5fb8e12a-8e80-47e2-afbe-d16b82472b4c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:18.670239 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-5fb8e12a-8e80-47e2-afbe-d16b82472b4c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda" status: 200 len: 1281 microversion: 2.20 time: 0.287562 Jan 11 15:11:18.676023 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 32/57] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:11:18 2022] GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda => generated 1281 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 15:11:19.072998 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-841d91df-6a24-44fd-bfd0-c73e422c13f6 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:19.073909 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-841d91df-6a24-44fd-bfd0-c73e422c13f6 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:19.086086 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-841d91df-6a24-44fd-bfd0-c73e422c13f6 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:19.086788 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-841d91df-6a24-44fd-bfd0-c73e422c13f6 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:19.087638 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-841d91df-6a24-44fd-bfd0-c73e422c13f6 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:19.088588 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-841d91df-6a24-44fd-bfd0-c73e422c13f6 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:19.327247 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-8b94c68f-f3f2-4038-9c6d-196f77f3e857 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:19.327968 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-8b94c68f-f3f2-4038-9c6d-196f77f3e857 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:19.350748 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8b94c68f-f3f2-4038-9c6d-196f77f3e857 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:19.351349 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8b94c68f-f3f2-4038-9c6d-196f77f3e857 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:19.353249 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8b94c68f-f3f2-4038-9c6d-196f77f3e857 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:19.353718 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8b94c68f-f3f2-4038-9c6d-196f77f3e857 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:19.751990 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-8b94c68f-f3f2-4038-9c6d-196f77f3e857 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:19.764679 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-8b94c68f-f3f2-4038-9c6d-196f77f3e857 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1279 microversion: 2.1 time: 0.442153 Jan 11 15:11:19.765826 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 33/58] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:19 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1279 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:19.777334 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4bf23a4d-9216-4e50-bb73-0725e4f3ab64 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:19.780719 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4bf23a4d-9216-4e50-bb73-0725e4f3ab64 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:19.793102 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4bf23a4d-9216-4e50-bb73-0725e4f3ab64 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:19.797221 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4bf23a4d-9216-4e50-bb73-0725e4f3ab64 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:19.798306 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4bf23a4d-9216-4e50-bb73-0725e4f3ab64 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:19.798928 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4bf23a4d-9216-4e50-bb73-0725e4f3ab64 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:20.188245 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-841d91df-6a24-44fd-bfd0-c73e422c13f6 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:20.197486 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-841d91df-6a24-44fd-bfd0-c73e422c13f6 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1315 microversion: 2.1 time: 1.130765 Jan 11 15:11:20.208052 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 26/59] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:19 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1315 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:20.348933 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-4bf23a4d-9216-4e50-bb73-0725e4f3ab64 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:20.359091 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4bf23a4d-9216-4e50-bb73-0725e4f3ab64 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be" status: 200 len: 1318 microversion: 2.1 time: 0.591984 Jan 11 15:11:20.367748 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 34/60] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:19 2022] GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be => generated 1318 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:20.373064 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7c0f2f00-a456-4059-9572-818f45c5d875 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:20.373911 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7c0f2f00-a456-4059-9572-818f45c5d875 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:20.381412 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7c0f2f00-a456-4059-9572-818f45c5d875 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:20.382110 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7c0f2f00-a456-4059-9572-818f45c5d875 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:20.383690 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7c0f2f00-a456-4059-9572-818f45c5d875 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:20.394868 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7c0f2f00-a456-4059-9572-818f45c5d875 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:20.434623 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-0aa8cfa7-2463-420a-8925-89e208314300 req-bf56aa59-f80c-4edf-8acb-907ed209df18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e78f846-beb6-49c6-8f01-5cc343dbb7be", "tag": "699cc465-fddf-4b17-9874-9bfcf03e258d"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:11:20.436931 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:11:20.436931 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:11:20.452538 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-0aa8cfa7-2463-420a-8925-89e208314300 req-bf56aa59-f80c-4edf-8acb-907ed209df18 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:20.486089 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-0aa8cfa7-2463-420a-8925-89e208314300 req-bf56aa59-f80c-4edf-8acb-907ed209df18 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:20.486089 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-0aa8cfa7-2463-420a-8925-89e208314300 req-bf56aa59-f80c-4edf-8acb-907ed209df18 service nova] Creating event network-changed:699cc465-fddf-4b17-9874-9bfcf03e258d for instance 6e78f846-beb6-49c6-8f01-5cc343dbb7be on hv-cinder-82418 Jan 11 15:11:20.486089 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-0aa8cfa7-2463-420a-8925-89e208314300 req-bf56aa59-f80c-4edf-8acb-907ed209df18 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116902) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 11 15:11:20.486089 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-51b0999c-b32d-4c09-ab66-0440508c711b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:20.486089 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-51b0999c-b32d-4c09-ab66-0440508c711b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:20.487502 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-51b0999c-b32d-4c09-ab66-0440508c711b None None] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:20.487502 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-51b0999c-b32d-4c09-ab66-0440508c711b None None] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:20.492406 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.compute.rpcapi [None req-51b0999c-b32d-4c09-ab66-0440508c711b None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 11 15:11:20.494288 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-51b0999c-b32d-4c09-ab66-0440508c711b None None] Releasing lock "compute-rpcapi-router" {{(pid=116902) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 11 15:11:20.558219 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-51b0999c-b32d-4c09-ab66-0440508c711b None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.348336 Jan 11 15:11:20.559171 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 27/61] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:11:20.569229 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9e6429ad-f94a-4546-beab-591757a31546 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1874287338", "imageRef": "d0ce98ab-06a2-4e75-9f37-288864a22cb9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f4d94b5-b203-4c46-b51c-c22a8f4a2dc1"}], "security_groups": [{"name": "tempest-securitygroup--926130141"}], "key_name": "tempest-keypair-1576827656", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:11:20.782961 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-7c0f2f00-a456-4059-9572-818f45c5d875 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:20.787183 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-7c0f2f00-a456-4059-9572-818f45c5d875 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:20.791071 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-7c0f2f00-a456-4059-9572-818f45c5d875 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:20.792308 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7c0f2f00-a456-4059-9572-818f45c5d875 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda" status: 200 len: 1333 microversion: 2.20 time: 0.431139 Jan 11 15:11:20.799252 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 35/62] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:11:20 2022] GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda => generated 1333 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 15:11:20.804157 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-096fb2c9-bf2e-473f-9efc-906466016148 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:20.811934 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-096fb2c9-bf2e-473f-9efc-906466016148 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:20.823375 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-096fb2c9-bf2e-473f-9efc-906466016148 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:20.824265 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-096fb2c9-bf2e-473f-9efc-906466016148 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:20.825358 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-096fb2c9-bf2e-473f-9efc-906466016148 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:20.827462 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-096fb2c9-bf2e-473f-9efc-906466016148 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:21.098082 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-096fb2c9-bf2e-473f-9efc-906466016148 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:21.107001 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-096fb2c9-bf2e-473f-9efc-906466016148 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1279 microversion: 2.1 time: 0.306432 Jan 11 15:11:21.108179 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 36/63] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:20 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1279 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:21.220773 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.network.neutron [None req-9e6429ad-f94a-4546-beab-591757a31546 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] validate_networks() for [('3f4d94b5-b203-4c46-b51c-c22a8f4a2dc1', None, None, None, None, None)] {{(pid=116902) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 15:11:21.232241 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-499224ce-dc0a-4177-a2c6-b26f382c6747 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:21.232613 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-499224ce-dc0a-4177-a2c6-b26f382c6747 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:21.250729 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-499224ce-dc0a-4177-a2c6-b26f382c6747 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:21.251211 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-499224ce-dc0a-4177-a2c6-b26f382c6747 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:21.252079 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-499224ce-dc0a-4177-a2c6-b26f382c6747 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:21.252532 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-499224ce-dc0a-4177-a2c6-b26f382c6747 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:21.783778 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-499224ce-dc0a-4177-a2c6-b26f382c6747 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:21.802319 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-499224ce-dc0a-4177-a2c6-b26f382c6747 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1315 microversion: 2.1 time: 0.577174 Jan 11 15:11:21.802904 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 37/64] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:21 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1315 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:21.807463 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7070078d-649c-4292-ad1b-af80bc02b8ab tempest-VolumesTestJSON-498221914 tempest-VolumesTestJSON-498221914-project] Calling method '.version_select at 0x7f16baa12820>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:21.953793 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7070078d-649c-4292-ad1b-af80bc02b8ab tempest-VolumesTestJSON-498221914 tempest-VolumesTestJSON-498221914-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/3f9660ca-ece0-42d1-b660-196eb95dbb4b" status: 200 len: 351 microversion: 2.1 time: 0.149632 Jan 11 15:11:21.954431 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 38/65] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jan 11 15:11:21 2022] GET /compute/v2.1/os-volumes/3f9660ca-ece0-42d1-b660-196eb95dbb4b => generated 351 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:11:21.966153 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4f2b132c-88ff-4a77-8c72-8a8eba64c705 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:21.967026 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4f2b132c-88ff-4a77-8c72-8a8eba64c705 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:21.980672 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4f2b132c-88ff-4a77-8c72-8a8eba64c705 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:21.990851 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4f2b132c-88ff-4a77-8c72-8a8eba64c705 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:21.990851 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4f2b132c-88ff-4a77-8c72-8a8eba64c705 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:21.990851 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4f2b132c-88ff-4a77-8c72-8a8eba64c705 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:22.393316 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-9e6429ad-f94a-4546-beab-591757a31546 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Flavor limits 0:0:0 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 15:11:22.393897 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-9e6429ad-f94a-4546-beab-591757a31546 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Image limits 0:0:0 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 15:11:22.394338 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-9e6429ad-f94a-4546-beab-591757a31546 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Flavor pref 0:0:0 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 15:11:22.395747 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-9e6429ad-f94a-4546-beab-591757a31546 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Image pref 0:0:0 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 15:11:22.397117 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-9e6429ad-f94a-4546-beab-591757a31546 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 15:11:22.406765 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9e6429ad-f94a-4546-beab-591757a31546 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:22.407600 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9e6429ad-f94a-4546-beab-591757a31546 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:22.408982 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9e6429ad-f94a-4546-beab-591757a31546 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:22.409669 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9e6429ad-f94a-4546-beab-591757a31546 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:22.420156 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-4f2b132c-88ff-4a77-8c72-8a8eba64c705 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:22.428460 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4f2b132c-88ff-4a77-8c72-8a8eba64c705 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be" status: 200 len: 1318 microversion: 2.1 time: 0.472874 Jan 11 15:11:22.429103 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.quota [None req-9e6429ad-f94a-4546-beab-591757a31546 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Getting quotas for project 9d979bb0d7f04bbe99fa7215278f1051. Resources: {'instances', 'cores', 'ram'} {{(pid=116902) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 15:11:22.433822 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.quota [None req-9e6429ad-f94a-4546-beab-591757a31546 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Getting quotas for user b805c31cc5924c6d98c83718d1884440 and project 9d979bb0d7f04bbe99fa7215278f1051. Resources: {'instances', 'cores', 'ram'} {{(pid=116902) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 15:11:22.444392 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 39/66] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:21 2022] GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be => generated 1318 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:22.446143 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9e6429ad-f94a-4546-beab-591757a31546 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Going to run 1 instances... {{(pid=116902) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 15:11:22.448825 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9e6429ad-f94a-4546-beab-591757a31546 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0ce98ab-06a2-4e75-9f37-288864a22cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 15:11:22.449750 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7d45a672-1361-43d9-996c-385f79f8456a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:22.450474 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7d45a672-1361-43d9-996c-385f79f8456a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:22.457206 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7d45a672-1361-43d9-996c-385f79f8456a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:22.472316 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7d45a672-1361-43d9-996c-385f79f8456a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:22.472316 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7d45a672-1361-43d9-996c-385f79f8456a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:22.472316 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7d45a672-1361-43d9-996c-385f79f8456a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:22.537759 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-7d45a672-1361-43d9-996c-385f79f8456a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:22.547726 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-7d45a672-1361-43d9-996c-385f79f8456a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:22.553008 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-7d45a672-1361-43d9-996c-385f79f8456a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:22.553008 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7d45a672-1361-43d9-996c-385f79f8456a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda" status: 200 len: 1333 microversion: 2.20 time: 0.104445 Jan 11 15:11:22.553008 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 40/67] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:11:22 2022] GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda => generated 1333 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 15:11:22.561915 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-8b9aae16-e44f-4e82-ba98-f8f0a5d5da7f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:22.562557 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-8b9aae16-e44f-4e82-ba98-f8f0a5d5da7f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:22.568859 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8b9aae16-e44f-4e82-ba98-f8f0a5d5da7f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:22.569539 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8b9aae16-e44f-4e82-ba98-f8f0a5d5da7f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:22.570315 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8b9aae16-e44f-4e82-ba98-f8f0a5d5da7f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:22.571094 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8b9aae16-e44f-4e82-ba98-f8f0a5d5da7f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:22.651134 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9e6429ad-f94a-4546-beab-591757a31546 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.090422 Jan 11 15:11:22.652050 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 28/68] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jan 11 15:11:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 2092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 15:11:22.757292 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-8b9aae16-e44f-4e82-ba98-f8f0a5d5da7f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:22.765485 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-8b9aae16-e44f-4e82-ba98-f8f0a5d5da7f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1321 microversion: 2.1 time: 0.213495 Jan 11 15:11:22.776521 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 41/69] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:22 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:22.781276 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c01f2d2b-50fb-477e-9c29-ee1cc8bed565 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:22.782109 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c01f2d2b-50fb-477e-9c29-ee1cc8bed565 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:22.817277 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-f85e53f5-7ae5-4ae8-909e-b5ed7ffec82a req-f09f5681-03ed-42a6-aa99-f8e13c8f1cff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "065bfd29-b195-45d4-88ea-e77e18bed4e3", "tag": "3b4e6a20-fb1b-4615-a0a3-b94c10947846"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:11:22.823220 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:11:22.823220 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:11:22.831088 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-f85e53f5-7ae5-4ae8-909e-b5ed7ffec82a req-f09f5681-03ed-42a6-aa99-f8e13c8f1cff service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:22.832012 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-f85e53f5-7ae5-4ae8-909e-b5ed7ffec82a req-f09f5681-03ed-42a6-aa99-f8e13c8f1cff service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:22.852317 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-f85e53f5-7ae5-4ae8-909e-b5ed7ffec82a req-f09f5681-03ed-42a6-aa99-f8e13c8f1cff service nova] Creating event network-changed:3b4e6a20-fb1b-4615-a0a3-b94c10947846 for instance 065bfd29-b195-45d4-88ea-e77e18bed4e3 on hv-cinder-82418 Jan 11 15:11:22.854378 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [req-f85e53f5-7ae5-4ae8-909e-b5ed7ffec82a req-f09f5681-03ed-42a6-aa99-f8e13c8f1cff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201023 Jan 11 15:11:22.855408 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 29/70] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:11:22.860441 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c3e6f081-6a8d-4d1f-ae3a-8e14c16c196c tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:22.861918 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c3e6f081-6a8d-4d1f-ae3a-8e14c16c196c tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:22.867335 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-c01f2d2b-50fb-477e-9c29-ee1cc8bed565 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:22.875709 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c01f2d2b-50fb-477e-9c29-ee1cc8bed565 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 200 len: 1238 microversion: 2.1 time: 0.097858 Jan 11 15:11:22.878070 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 42/71] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:22 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 1238 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:22.881146 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c3e6f081-6a8d-4d1f-ae3a-8e14c16c196c tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:22.881597 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c3e6f081-6a8d-4d1f-ae3a-8e14c16c196c tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:22.882642 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c3e6f081-6a8d-4d1f-ae3a-8e14c16c196c tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:22.883466 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c3e6f081-6a8d-4d1f-ae3a-8e14c16c196c tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:23.066214 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c3e6f081-6a8d-4d1f-ae3a-8e14c16c196c tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:23.075421 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c3e6f081-6a8d-4d1f-ae3a-8e14c16c196c tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1315 microversion: 2.1 time: 0.218702 Jan 11 15:11:23.085882 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 30/72] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:22 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:23.488366 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-471c3d33-6e4f-437e-8924-5f51c56e12db tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:23.488366 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-471c3d33-6e4f-437e-8924-5f51c56e12db tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:23.488366 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-471c3d33-6e4f-437e-8924-5f51c56e12db tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:23.488366 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-471c3d33-6e4f-437e-8924-5f51c56e12db tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:23.488734 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-471c3d33-6e4f-437e-8924-5f51c56e12db tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:23.488734 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-471c3d33-6e4f-437e-8924-5f51c56e12db tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:23.570992 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1a462c09-3dd4-4fd1-b816-38d9ce94fafb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:23.575743 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1a462c09-3dd4-4fd1-b816-38d9ce94fafb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:23.585646 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1a462c09-3dd4-4fd1-b816-38d9ce94fafb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:23.586145 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1a462c09-3dd4-4fd1-b816-38d9ce94fafb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:23.586953 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1a462c09-3dd4-4fd1-b816-38d9ce94fafb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:23.587435 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1a462c09-3dd4-4fd1-b816-38d9ce94fafb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:23.669020 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-471c3d33-6e4f-437e-8924-5f51c56e12db tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:23.676661 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-471c3d33-6e4f-437e-8924-5f51c56e12db tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be" status: 200 len: 1318 microversion: 2.1 time: 0.229224 Jan 11 15:11:23.677825 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 43/73] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:23 2022] GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:23.696476 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1a462c09-3dd4-4fd1-b816-38d9ce94fafb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:23.705204 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1a462c09-3dd4-4fd1-b816-38d9ce94fafb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:23.707843 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1a462c09-3dd4-4fd1-b816-38d9ce94fafb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:23.707967 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1a462c09-3dd4-4fd1-b816-38d9ce94fafb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda" status: 200 len: 1333 microversion: 2.20 time: 0.142566 Jan 11 15:11:23.708502 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 31/74] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:11:23 2022] GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda => generated 1333 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 15:11:23.783126 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-bc83b69c-734a-40e7-8f3b-5116f6aff48a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:23.783796 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-bc83b69c-734a-40e7-8f3b-5116f6aff48a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:23.790616 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bc83b69c-734a-40e7-8f3b-5116f6aff48a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:23.791148 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bc83b69c-734a-40e7-8f3b-5116f6aff48a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:23.792021 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bc83b69c-734a-40e7-8f3b-5116f6aff48a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:23.792455 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bc83b69c-734a-40e7-8f3b-5116f6aff48a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:23.893248 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0069cad8-6901-4fb6-8685-df3b1218aacb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:23.893869 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0069cad8-6901-4fb6-8685-df3b1218aacb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:23.980600 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0069cad8-6901-4fb6-8685-df3b1218aacb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:23.990753 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0069cad8-6901-4fb6-8685-df3b1218aacb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 200 len: 1238 microversion: 2.1 time: 0.101562 Jan 11 15:11:23.992188 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 32/75] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:23 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 1238 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:11:23.994503 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-bc83b69c-734a-40e7-8f3b-5116f6aff48a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:24.002932 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-bc83b69c-734a-40e7-8f3b-5116f6aff48a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1321 microversion: 2.1 time: 0.223605 Jan 11 15:11:24.004230 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 44/76] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:23 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:24.093607 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d1284ad3-41c2-4c79-879b-45e99c77ee4e tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:24.094230 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d1284ad3-41c2-4c79-879b-45e99c77ee4e tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:24.100366 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d1284ad3-41c2-4c79-879b-45e99c77ee4e tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:24.101137 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d1284ad3-41c2-4c79-879b-45e99c77ee4e tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:24.102243 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d1284ad3-41c2-4c79-879b-45e99c77ee4e tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:24.102837 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d1284ad3-41c2-4c79-879b-45e99c77ee4e tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:24.254053 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d1284ad3-41c2-4c79-879b-45e99c77ee4e tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:24.262275 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d1284ad3-41c2-4c79-879b-45e99c77ee4e tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1315 microversion: 2.1 time: 0.172749 Jan 11 15:11:24.263134 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 33/77] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:24 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:24.695274 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d9200f54-0968-4c91-a07b-80eb185de97e tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:24.696569 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d9200f54-0968-4c91-a07b-80eb185de97e tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:24.704574 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d9200f54-0968-4c91-a07b-80eb185de97e tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:24.705371 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d9200f54-0968-4c91-a07b-80eb185de97e tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:24.706599 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d9200f54-0968-4c91-a07b-80eb185de97e tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:24.707718 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d9200f54-0968-4c91-a07b-80eb185de97e tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:24.728174 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-35ac7286-9471-4662-b895-e9bd6cba4902 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:24.729680 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-35ac7286-9471-4662-b895-e9bd6cba4902 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:24.744434 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-35ac7286-9471-4662-b895-e9bd6cba4902 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:24.744916 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-35ac7286-9471-4662-b895-e9bd6cba4902 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:24.745731 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-35ac7286-9471-4662-b895-e9bd6cba4902 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:24.746175 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-35ac7286-9471-4662-b895-e9bd6cba4902 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:24.827240 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-35ac7286-9471-4662-b895-e9bd6cba4902 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:24.836677 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-35ac7286-9471-4662-b895-e9bd6cba4902 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:24.843699 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-35ac7286-9471-4662-b895-e9bd6cba4902 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:24.846242 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-35ac7286-9471-4662-b895-e9bd6cba4902 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda" status: 200 len: 1333 microversion: 2.20 time: 0.123562 Jan 11 15:11:24.847472 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 34/78] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:11:24 2022] GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda => generated 1333 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 15:11:24.917625 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-d9200f54-0968-4c91-a07b-80eb185de97e tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:24.925940 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d9200f54-0968-4c91-a07b-80eb185de97e tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be" status: 200 len: 1318 microversion: 2.1 time: 0.235766 Jan 11 15:11:24.930661 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 45/79] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:24 2022] GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:25.008455 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2ddf5b6e-e623-4af4-9e58-a667fd7b807f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:25.009123 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2ddf5b6e-e623-4af4-9e58-a667fd7b807f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:25.016122 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2ddf5b6e-e623-4af4-9e58-a667fd7b807f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:25.017249 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2ddf5b6e-e623-4af4-9e58-a667fd7b807f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:25.018587 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2ddf5b6e-e623-4af4-9e58-a667fd7b807f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:25.019307 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2ddf5b6e-e623-4af4-9e58-a667fd7b807f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:25.022325 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-22dbc7ef-cf09-4137-87cf-2f1f7188dacd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:25.023897 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-22dbc7ef-cf09-4137-87cf-2f1f7188dacd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:25.031583 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-22dbc7ef-cf09-4137-87cf-2f1f7188dacd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:25.032396 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-22dbc7ef-cf09-4137-87cf-2f1f7188dacd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:25.033417 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-22dbc7ef-cf09-4137-87cf-2f1f7188dacd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:25.034062 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-22dbc7ef-cf09-4137-87cf-2f1f7188dacd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:25.115675 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-2ddf5b6e-e623-4af4-9e58-a667fd7b807f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:25.126226 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2ddf5b6e-e623-4af4-9e58-a667fd7b807f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 200 len: 1242 microversion: 2.1 time: 0.121972 Jan 11 15:11:25.127111 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 35/80] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:25 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 1242 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:25.206336 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-22dbc7ef-cf09-4137-87cf-2f1f7188dacd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:25.221480 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6a2117f5-ce2d-483d-a4ea-c34f1015e466 tempest-VolumesTestJSON-498221914 tempest-VolumesTestJSON-498221914-project] Calling method '.version_select at 0x7f16ba21d280>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:25.233583 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-22dbc7ef-cf09-4137-87cf-2f1f7188dacd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1321 microversion: 2.1 time: 0.213484 Jan 11 15:11:25.233583 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 46/81] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:25 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:25.278537 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-5aec33ef-5c60-4e08-a975-58a0366eaf9b tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:25.283163 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-5aec33ef-5c60-4e08-a975-58a0366eaf9b tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:25.285086 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5aec33ef-5c60-4e08-a975-58a0366eaf9b tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:25.285540 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5aec33ef-5c60-4e08-a975-58a0366eaf9b tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:25.286364 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5aec33ef-5c60-4e08-a975-58a0366eaf9b tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:25.286807 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5aec33ef-5c60-4e08-a975-58a0366eaf9b tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:25.295901 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6a2117f5-ce2d-483d-a4ea-c34f1015e466 tempest-VolumesTestJSON-498221914 tempest-VolumesTestJSON-498221914-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/a70760e8-06a1-43e2-8387-cf48ee4992ce" status: 200 len: 350 microversion: 2.1 time: 0.082096 Jan 11 15:11:25.296721 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 36/82] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jan 11 15:11:25 2022] GET /compute/v2.1/os-volumes/a70760e8-06a1-43e2-8387-cf48ee4992ce => generated 350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:11:25.427501 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-5aec33ef-5c60-4e08-a975-58a0366eaf9b tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:25.433879 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-5aec33ef-5c60-4e08-a975-58a0366eaf9b tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1315 microversion: 2.1 time: 0.158972 Jan 11 15:11:25.434440 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 47/83] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:25 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:11:25.865298 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-11e87602-2904-4375-8686-8375b6752edb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:25.865908 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-11e87602-2904-4375-8686-8375b6752edb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:25.871740 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-11e87602-2904-4375-8686-8375b6752edb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:25.872194 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-11e87602-2904-4375-8686-8375b6752edb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:25.872971 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-11e87602-2904-4375-8686-8375b6752edb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:25.873413 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-11e87602-2904-4375-8686-8375b6752edb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:25.934509 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-11e87602-2904-4375-8686-8375b6752edb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:25.942640 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-11e87602-2904-4375-8686-8375b6752edb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:25.944167 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-11e87602-2904-4375-8686-8375b6752edb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:25.944986 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b590ab15-6c3f-4bcc-bca6-30db3999d7d0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:25.945245 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-11e87602-2904-4375-8686-8375b6752edb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda" status: 200 len: 1333 microversion: 2.20 time: 0.084306 Jan 11 15:11:25.945642 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b590ab15-6c3f-4bcc-bca6-30db3999d7d0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:25.945790 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 37/84] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:11:25 2022] GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda => generated 1333 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 15:11:25.951597 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b590ab15-6c3f-4bcc-bca6-30db3999d7d0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:25.952048 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b590ab15-6c3f-4bcc-bca6-30db3999d7d0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:25.952833 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b590ab15-6c3f-4bcc-bca6-30db3999d7d0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:25.953271 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b590ab15-6c3f-4bcc-bca6-30db3999d7d0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:26.143899 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-749a78dc-8c04-4c28-8741-a53b45535a1f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:26.144739 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-749a78dc-8c04-4c28-8741-a53b45535a1f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:26.151499 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-749a78dc-8c04-4c28-8741-a53b45535a1f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:26.152009 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-749a78dc-8c04-4c28-8741-a53b45535a1f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:26.152924 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-749a78dc-8c04-4c28-8741-a53b45535a1f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:26.153371 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-749a78dc-8c04-4c28-8741-a53b45535a1f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:26.217195 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-749a78dc-8c04-4c28-8741-a53b45535a1f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:26.230166 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-749a78dc-8c04-4c28-8741-a53b45535a1f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 200 len: 1242 microversion: 2.1 time: 0.089808 Jan 11 15:11:26.239932 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 38/85] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:26 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:11:26.252253 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5e4dbbc7-8561-4cdb-85e9-10426f2e638d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:26.252253 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5e4dbbc7-8561-4cdb-85e9-10426f2e638d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:26.257885 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-b590ab15-6c3f-4bcc-bca6-30db3999d7d0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:26.262309 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5e4dbbc7-8561-4cdb-85e9-10426f2e638d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:26.262756 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5e4dbbc7-8561-4cdb-85e9-10426f2e638d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:26.264903 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5e4dbbc7-8561-4cdb-85e9-10426f2e638d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:26.265631 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5e4dbbc7-8561-4cdb-85e9-10426f2e638d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:26.267182 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b590ab15-6c3f-4bcc-bca6-30db3999d7d0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be" status: 200 len: 1318 microversion: 2.1 time: 0.325793 Jan 11 15:11:26.268163 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 48/86] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:25 2022] GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:11:26.398173 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-5e4dbbc7-8561-4cdb-85e9-10426f2e638d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:26.405465 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5e4dbbc7-8561-4cdb-85e9-10426f2e638d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1321 microversion: 2.1 time: 0.160681 Jan 11 15:11:26.406035 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 39/87] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:26 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:11:26.450892 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f612dff8-262d-416d-9f68-f0d15dcf2873 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:26.451526 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f612dff8-262d-416d-9f68-f0d15dcf2873 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:26.457385 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f612dff8-262d-416d-9f68-f0d15dcf2873 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:26.457834 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f612dff8-262d-416d-9f68-f0d15dcf2873 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:26.458664 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f612dff8-262d-416d-9f68-f0d15dcf2873 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:26.459100 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f612dff8-262d-416d-9f68-f0d15dcf2873 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:26.597658 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-f612dff8-262d-416d-9f68-f0d15dcf2873 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:26.605677 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f612dff8-262d-416d-9f68-f0d15dcf2873 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1315 microversion: 2.1 time: 0.158448 Jan 11 15:11:26.606241 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 49/88] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:26 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:26.964114 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8ab76dda-f6ec-490a-9644-5a0f3352600c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:26.964769 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8ab76dda-f6ec-490a-9644-5a0f3352600c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:26.976173 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8ab76dda-f6ec-490a-9644-5a0f3352600c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:26.976545 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8ab76dda-f6ec-490a-9644-5a0f3352600c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:26.977341 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8ab76dda-f6ec-490a-9644-5a0f3352600c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:26.977783 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8ab76dda-f6ec-490a-9644-5a0f3352600c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:27.035790 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-8ab76dda-f6ec-490a-9644-5a0f3352600c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:27.044751 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-8ab76dda-f6ec-490a-9644-5a0f3352600c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:27.046263 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-8ab76dda-f6ec-490a-9644-5a0f3352600c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:27.047461 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8ab76dda-f6ec-490a-9644-5a0f3352600c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda" status: 200 len: 1333 microversion: 2.20 time: 0.087600 Jan 11 15:11:27.048103 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 40/89] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:11:26 2022] GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda => generated 1333 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 15:11:27.246474 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f43f8bdc-a775-4327-bf1b-c1e926fdcfdd tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:27.247086 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f43f8bdc-a775-4327-bf1b-c1e926fdcfdd tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:27.253402 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f43f8bdc-a775-4327-bf1b-c1e926fdcfdd tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:27.254111 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f43f8bdc-a775-4327-bf1b-c1e926fdcfdd tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:27.255596 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f43f8bdc-a775-4327-bf1b-c1e926fdcfdd tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:27.256170 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f43f8bdc-a775-4327-bf1b-c1e926fdcfdd tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:27.284532 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9d5b5f5c-ab86-47a9-b542-4f95f8e98c73 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:27.285427 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9d5b5f5c-ab86-47a9-b542-4f95f8e98c73 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:27.292200 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9d5b5f5c-ab86-47a9-b542-4f95f8e98c73 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:27.292889 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9d5b5f5c-ab86-47a9-b542-4f95f8e98c73 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:27.293774 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9d5b5f5c-ab86-47a9-b542-4f95f8e98c73 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:27.294133 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9d5b5f5c-ab86-47a9-b542-4f95f8e98c73 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:27.317150 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-f43f8bdc-a775-4327-bf1b-c1e926fdcfdd tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:27.322742 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f43f8bdc-a775-4327-bf1b-c1e926fdcfdd tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 200 len: 1242 microversion: 2.1 time: 0.079844 Jan 11 15:11:27.323360 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 50/90] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:27 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:27.422542 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-659a5799-854e-46cf-9449-1df8366feabe tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:27.423186 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-659a5799-854e-46cf-9449-1df8366feabe tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:27.429650 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-659a5799-854e-46cf-9449-1df8366feabe tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:27.430100 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-659a5799-854e-46cf-9449-1df8366feabe tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:27.430891 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-659a5799-854e-46cf-9449-1df8366feabe tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:27.432323 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-659a5799-854e-46cf-9449-1df8366feabe tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:27.433616 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-9d5b5f5c-ab86-47a9-b542-4f95f8e98c73 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:27.440987 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9d5b5f5c-ab86-47a9-b542-4f95f8e98c73 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be" status: 200 len: 1318 microversion: 2.1 time: 0.160053 Jan 11 15:11:27.441555 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 41/91] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:27 2022] GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:11:27.564828 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-659a5799-854e-46cf-9449-1df8366feabe tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:27.572650 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-659a5799-854e-46cf-9449-1df8366feabe tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1321 microversion: 2.1 time: 0.154040 Jan 11 15:11:27.573222 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 51/92] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:27 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:11:27.622655 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a2ceec31-3358-4a3c-92f1-fa309f94002e tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:27.623262 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a2ceec31-3358-4a3c-92f1-fa309f94002e tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:27.629025 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a2ceec31-3358-4a3c-92f1-fa309f94002e tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:27.629475 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a2ceec31-3358-4a3c-92f1-fa309f94002e tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:27.630815 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a2ceec31-3358-4a3c-92f1-fa309f94002e tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:27.631237 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a2ceec31-3358-4a3c-92f1-fa309f94002e tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:27.760831 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a2ceec31-3358-4a3c-92f1-fa309f94002e tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:27.776363 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a2ceec31-3358-4a3c-92f1-fa309f94002e tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1315 microversion: 2.1 time: 0.157125 Jan 11 15:11:27.780201 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 42/93] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:27 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:28.068298 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-958a98d4-7d95-4995-9b93-01d7af545eab tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:28.068926 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-958a98d4-7d95-4995-9b93-01d7af545eab tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:28.083504 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-958a98d4-7d95-4995-9b93-01d7af545eab tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:28.083504 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-958a98d4-7d95-4995-9b93-01d7af545eab tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:28.083504 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-958a98d4-7d95-4995-9b93-01d7af545eab tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:28.083504 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-958a98d4-7d95-4995-9b93-01d7af545eab tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:28.121409 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0de19c68-2c10-4c6b-b8d9-01310425d21c tempest-VolumesTestJSON-498221914 tempest-VolumesTestJSON-498221914-project] Calling method '.version_select at 0x7f16ba186c10>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:28.210481 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0de19c68-2c10-4c6b-b8d9-01310425d21c tempest-VolumesTestJSON-498221914 tempest-VolumesTestJSON-498221914-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/2b0d77ea-1151-4049-a354-683542d2dbf9" status: 200 len: 348 microversion: 2.1 time: 0.093267 Jan 11 15:11:28.211198 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 43/94] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jan 11 15:11:28 2022] GET /compute/v2.1/os-volumes/2b0d77ea-1151-4049-a354-683542d2dbf9 => generated 348 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:11:28.226356 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4c280f04-94eb-46a3-a6b9-d4909eaf97d1 tempest-VolumesTestJSON-498221914 tempest-VolumesTestJSON-498221914-project] Calling method '.version_select at 0x7f16ba1d24c0>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:28.322244 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-958a98d4-7d95-4995-9b93-01d7af545eab tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:28.330774 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-958a98d4-7d95-4995-9b93-01d7af545eab tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:28.341486 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4c280f04-94eb-46a3-a6b9-d4909eaf97d1 tempest-VolumesTestJSON-498221914 tempest-VolumesTestJSON-498221914-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.121840 Jan 11 15:11:28.341486 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 44/95] 10.222.0.52 () {58 vars in 1133 bytes} [Tue Jan 11 15:11:28 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:11:28.344256 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-958a98d4-7d95-4995-9b93-01d7af545eab tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:28.345753 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-958a98d4-7d95-4995-9b93-01d7af545eab tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda" status: 200 len: 1333 microversion: 2.20 time: 0.284019 Jan 11 15:11:28.346303 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 52/96] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:11:28 2022] GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda => generated 1333 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 15:11:28.362565 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2c0f5059-a23b-4d4c-8497-c8f331b6c18f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:28.363543 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2c0f5059-a23b-4d4c-8497-c8f331b6c18f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:28.367691 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-fff56956-3bb5-495e-aefd-7ccd9857f2cc tempest-VolumesTestJSON-498221914 tempest-VolumesTestJSON-498221914-project] Calling method '.version_select at 0x7f16ba9c40d0>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:28.388392 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2c0f5059-a23b-4d4c-8497-c8f331b6c18f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:28.388856 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2c0f5059-a23b-4d4c-8497-c8f331b6c18f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:28.389675 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2c0f5059-a23b-4d4c-8497-c8f331b6c18f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:28.390275 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2c0f5059-a23b-4d4c-8497-c8f331b6c18f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:28.462510 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-fff56956-3bb5-495e-aefd-7ccd9857f2cc tempest-VolumesTestJSON-498221914 tempest-VolumesTestJSON-498221914-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 691 microversion: 2.1 time: 0.098378 Jan 11 15:11:28.463444 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 53/97] 10.222.0.52 () {58 vars in 1148 bytes} [Tue Jan 11 15:11:28 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 691 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:11:28.470501 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-62a15213-867d-4d10-8201-34b42f38a80c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:28.470501 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-62a15213-867d-4d10-8201-34b42f38a80c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:28.475871 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-62a15213-867d-4d10-8201-34b42f38a80c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:28.476320 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-62a15213-867d-4d10-8201-34b42f38a80c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:28.477164 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-62a15213-867d-4d10-8201-34b42f38a80c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:28.477516 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-62a15213-867d-4d10-8201-34b42f38a80c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:28.496294 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-2c0f5059-a23b-4d4c-8497-c8f331b6c18f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:28.506825 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2c0f5059-a23b-4d4c-8497-c8f331b6c18f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 200 len: 1234 microversion: 2.1 time: 0.164624 Jan 11 15:11:28.507428 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 45/98] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:28 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 1234 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:28.511938 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b7e4692a-3d6e-4e1c-96e0-dcd9dad3d344 tempest-VolumesTestJSON-498221914 tempest-VolumesTestJSON-498221914-project] Calling method '.version_select at 0x7f16ba186ee0>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:28.621672 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b7e4692a-3d6e-4e1c-96e0-dcd9dad3d344 tempest-VolumesTestJSON-498221914 tempest-VolumesTestJSON-498221914-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.113000 Jan 11 15:11:28.622267 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 46/99] 10.222.0.52 () {58 vars in 1133 bytes} [Tue Jan 11 15:11:28 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:28.640362 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-02bd0e3e-57aa-41b5-934a-39d1562cffef tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:28.644039 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-02bd0e3e-57aa-41b5-934a-39d1562cffef tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:28.654042 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-02bd0e3e-57aa-41b5-934a-39d1562cffef tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:28.654707 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-02bd0e3e-57aa-41b5-934a-39d1562cffef tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:28.656036 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-02bd0e3e-57aa-41b5-934a-39d1562cffef tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:28.656958 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-02bd0e3e-57aa-41b5-934a-39d1562cffef tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:29.249166 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-62a15213-867d-4d10-8201-34b42f38a80c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:29.260816 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-62a15213-867d-4d10-8201-34b42f38a80c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be" status: 200 len: 1318 microversion: 2.1 time: 0.796275 Jan 11 15:11:29.263266 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 54/100] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:28 2022] GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be => generated 1318 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:29.274437 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c83caa5e-7778-44e0-a781-b03f27da4bc7 tempest-VolumesTestJSON-498221914 tempest-VolumesTestJSON-498221914-project] Calling method '.version_select at 0x7f16ba9c4040>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:29.378713 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c83caa5e-7778-44e0-a781-b03f27da4bc7 tempest-VolumesTestJSON-498221914 tempest-VolumesTestJSON-498221914-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.113833 Jan 11 15:11:29.379382 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 55/101] 10.222.0.52 () {58 vars in 1166 bytes} [Tue Jan 11 15:11:29 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:11:29.385522 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a1708f99-e34c-4be2-9a18-4dd3f8812f27 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:29.386612 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a1708f99-e34c-4be2-9a18-4dd3f8812f27 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:29.395221 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a1708f99-e34c-4be2-9a18-4dd3f8812f27 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:29.396003 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a1708f99-e34c-4be2-9a18-4dd3f8812f27 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:29.397703 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a1708f99-e34c-4be2-9a18-4dd3f8812f27 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:29.398371 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a1708f99-e34c-4be2-9a18-4dd3f8812f27 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:29.407368 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-02bd0e3e-57aa-41b5-934a-39d1562cffef tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:29.415784 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-02bd0e3e-57aa-41b5-934a-39d1562cffef tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1321 microversion: 2.1 time: 0.790486 Jan 11 15:11:29.424896 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 47/102] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:28 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1321 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:29.430918 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3481984a-af00-433a-bee5-6c4e4829184a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:29.431562 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3481984a-af00-433a-bee5-6c4e4829184a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:29.442986 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3481984a-af00-433a-bee5-6c4e4829184a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:29.443837 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3481984a-af00-433a-bee5-6c4e4829184a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:29.444844 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3481984a-af00-433a-bee5-6c4e4829184a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:29.445868 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3481984a-af00-433a-bee5-6c4e4829184a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:29.663069 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3481984a-af00-433a-bee5-6c4e4829184a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:29.693836 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3481984a-af00-433a-bee5-6c4e4829184a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:29.695480 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3481984a-af00-433a-bee5-6c4e4829184a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:29.696626 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3481984a-af00-433a-bee5-6c4e4829184a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda" status: 200 len: 1339 microversion: 2.20 time: 0.275429 Jan 11 15:11:29.697397 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 48/103] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:11:29 2022] GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda => generated 1339 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 15:11:29.701786 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-cacbe354-6e64-4728-95fb-55a3836f0482 tempest-VolumesTestJSON-498221914 tempest-VolumesTestJSON-498221914-project] Calling method '.version_select at 0x7f16ba1d2e50>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:29.799180 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-cacbe354-6e64-4728-95fb-55a3836f0482 tempest-VolumesTestJSON-498221914 tempest-VolumesTestJSON-498221914-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 691 microversion: 2.1 time: 0.100601 Jan 11 15:11:29.799981 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 49/104] 10.222.0.52 () {58 vars in 1169 bytes} [Tue Jan 11 15:11:29 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 691 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:11:29.804507 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f874a022-d914-47b8-ae6d-4a8233b6c144 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:29.805317 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f874a022-d914-47b8-ae6d-4a8233b6c144 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:29.812428 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f874a022-d914-47b8-ae6d-4a8233b6c144 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:29.813181 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f874a022-d914-47b8-ae6d-4a8233b6c144 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:29.814203 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f874a022-d914-47b8-ae6d-4a8233b6c144 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:29.815387 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f874a022-d914-47b8-ae6d-4a8233b6c144 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:29.956119 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f874a022-d914-47b8-ae6d-4a8233b6c144 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:29.968769 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-a1708f99-e34c-4be2-9a18-4dd3f8812f27 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:29.974899 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f874a022-d914-47b8-ae6d-4a8233b6c144 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 200 len: 1298 microversion: 2.1 time: 0.173836 Jan 11 15:11:29.980011 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a1708f99-e34c-4be2-9a18-4dd3f8812f27 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1315 microversion: 2.1 time: 0.598582 Jan 11 15:11:29.981335 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 56/105] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:29 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1315 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:29.983633 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 50/106] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:29 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 1298 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:29.988500 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a6d34453-6b8d-4690-b180-ff25ef24c5ae tempest-VolumesTestJSON-498221914 tempest-VolumesTestJSON-498221914-project] Calling method '.version_select at 0x7f16baa35940>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:30.115142 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-f69398cb-e36d-4e6b-9c2a-9988162fa680 req-d9c60b05-4d06-4bd7-a00d-779543e59933 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2127507f-81ad-406d-a9fa-9e4c615184ba", "tag": "8258f5fe-4e30-4513-9898-eab0cc1ce678"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:11:30.116877 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:11:30.116877 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:11:30.133057 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a6d34453-6b8d-4690-b180-ff25ef24c5ae tempest-VolumesTestJSON-498221914 tempest-VolumesTestJSON-498221914-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.148364 Jan 11 15:11:30.133839 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 57/107] 10.222.0.52 () {58 vars in 1154 bytes} [Tue Jan 11 15:11:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:30.136696 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-f69398cb-e36d-4e6b-9c2a-9988162fa680 req-d9c60b05-4d06-4bd7-a00d-779543e59933 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:30.137373 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-f69398cb-e36d-4e6b-9c2a-9988162fa680 req-d9c60b05-4d06-4bd7-a00d-779543e59933 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:30.144550 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-467a2318-e7ba-4a01-8d77-d84d17bdae23 tempest-VolumesTestJSON-498221914 tempest-VolumesTestJSON-498221914-project] Calling method '.version_select at 0x7f16baa704c0>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:30.162601 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-f69398cb-e36d-4e6b-9c2a-9988162fa680 req-d9c60b05-4d06-4bd7-a00d-779543e59933 service nova] Creating event network-changed:8258f5fe-4e30-4513-9898-eab0cc1ce678 for instance 2127507f-81ad-406d-a9fa-9e4c615184ba on hv-cinder-82418 Jan 11 15:11:30.171151 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [req-f69398cb-e36d-4e6b-9c2a-9988162fa680 req-d9c60b05-4d06-4bd7-a00d-779543e59933 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069802 Jan 11 15:11:30.172471 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 51/108] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:11:30.265564 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-467a2318-e7ba-4a01-8d77-d84d17bdae23 tempest-VolumesTestJSON-498221914 tempest-VolumesTestJSON-498221914-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.124503 Jan 11 15:11:30.266805 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 58/109] 10.222.0.52 () {58 vars in 1187 bytes} [Tue Jan 11 15:11:30 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:11:30.278861 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-38eab9ae-2274-4864-8934-2592c232c9b9 tempest-VolumesTestJSON-498221914 tempest-VolumesTestJSON-498221914-project] Calling method '.version_select at 0x7f16ba186430>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:30.279724 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-bc184f1a-e9d1-4c34-9ae8-75f1a5385e69 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:30.280637 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-bc184f1a-e9d1-4c34-9ae8-75f1a5385e69 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:30.309059 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bc184f1a-e9d1-4c34-9ae8-75f1a5385e69 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:30.311014 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bc184f1a-e9d1-4c34-9ae8-75f1a5385e69 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:30.319009 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bc184f1a-e9d1-4c34-9ae8-75f1a5385e69 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:30.319578 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bc184f1a-e9d1-4c34-9ae8-75f1a5385e69 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:30.384080 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-38eab9ae-2274-4864-8934-2592c232c9b9 tempest-VolumesTestJSON-498221914 tempest-VolumesTestJSON-498221914-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.109249 Jan 11 15:11:30.384642 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 52/110] 10.222.0.52 () {58 vars in 1154 bytes} [Tue Jan 11 15:11:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:30.432615 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-94160dde-43dd-49fc-961b-7cfddc84b900 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:30.434138 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-94160dde-43dd-49fc-961b-7cfddc84b900 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:30.444415 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-94160dde-43dd-49fc-961b-7cfddc84b900 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:30.445261 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-94160dde-43dd-49fc-961b-7cfddc84b900 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:30.446700 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-94160dde-43dd-49fc-961b-7cfddc84b900 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:30.453549 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-94160dde-43dd-49fc-961b-7cfddc84b900 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:30.944052 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-bc184f1a-e9d1-4c34-9ae8-75f1a5385e69 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:30.954483 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-bc184f1a-e9d1-4c34-9ae8-75f1a5385e69 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be" status: 200 len: 1318 microversion: 2.1 time: 0.678810 Jan 11 15:11:30.955067 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 59/111] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:30 2022] GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be => generated 1318 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:11:30.966029 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-0292c103-8335-4b68-a83d-b207f49d4f66 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:30.966897 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-0292c103-8335-4b68-a83d-b207f49d4f66 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:30.975064 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0292c103-8335-4b68-a83d-b207f49d4f66 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:30.977813 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0292c103-8335-4b68-a83d-b207f49d4f66 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:30.979030 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0292c103-8335-4b68-a83d-b207f49d4f66 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:30.979465 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0292c103-8335-4b68-a83d-b207f49d4f66 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:30.998060 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-94160dde-43dd-49fc-961b-7cfddc84b900 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:31.005488 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-94160dde-43dd-49fc-961b-7cfddc84b900 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1321 microversion: 2.1 time: 0.576729 Jan 11 15:11:31.006058 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 53/112] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:30 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1321 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:11:31.015033 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d2d9b00f-0d29-4265-984b-0291d1a73ba6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:31.015662 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d2d9b00f-0d29-4265-984b-0291d1a73ba6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:31.021831 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d2d9b00f-0d29-4265-984b-0291d1a73ba6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:31.027522 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d2d9b00f-0d29-4265-984b-0291d1a73ba6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:31.027522 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d2d9b00f-0d29-4265-984b-0291d1a73ba6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:31.027522 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d2d9b00f-0d29-4265-984b-0291d1a73ba6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:31.740151 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-0292c103-8335-4b68-a83d-b207f49d4f66 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:31.754201 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-0292c103-8335-4b68-a83d-b207f49d4f66 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:31.756604 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-0292c103-8335-4b68-a83d-b207f49d4f66 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:31.760591 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-0292c103-8335-4b68-a83d-b207f49d4f66 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda" status: 200 len: 1407 microversion: 2.20 time: 0.804110 Jan 11 15:11:31.761169 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 60/113] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:11:30 2022] GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda => generated 1407 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 15:11:31.769889 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-6e0e2477-e19e-4d2d-9931-923f39378cc2 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:31.771067 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-6e0e2477-e19e-4d2d-9931-923f39378cc2 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:31.788046 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6e0e2477-e19e-4d2d-9931-923f39378cc2 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:31.788172 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d2d9b00f-0d29-4265-984b-0291d1a73ba6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:31.790641 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6e0e2477-e19e-4d2d-9931-923f39378cc2 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:31.791877 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6e0e2477-e19e-4d2d-9931-923f39378cc2 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:31.793723 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6e0e2477-e19e-4d2d-9931-923f39378cc2 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:31.799827 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d2d9b00f-0d29-4265-984b-0291d1a73ba6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 200 len: 1363 microversion: 2.1 time: 0.787729 Jan 11 15:11:31.800622 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 54/114] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:31 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 1363 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:31.972130 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ea3fc896-62ab-4e2c-ac25-0271a74a952c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:31.973101 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ea3fc896-62ab-4e2c-ac25-0271a74a952c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:31.980823 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ea3fc896-62ab-4e2c-ac25-0271a74a952c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:31.981494 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ea3fc896-62ab-4e2c-ac25-0271a74a952c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:31.982374 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ea3fc896-62ab-4e2c-ac25-0271a74a952c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:31.982885 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ea3fc896-62ab-4e2c-ac25-0271a74a952c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:32.205633 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-6e0e2477-e19e-4d2d-9931-923f39378cc2 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:32.216954 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-6e0e2477-e19e-4d2d-9931-923f39378cc2 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1315 microversion: 2.1 time: 0.454632 Jan 11 15:11:32.227567 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 61/115] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:31 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1315 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:32.227567 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-fc5b92f9-7a45-422c-b08f-6f70815c9e37 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:32.227567 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-fc5b92f9-7a45-422c-b08f-6f70815c9e37 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:32.241353 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fc5b92f9-7a45-422c-b08f-6f70815c9e37 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:32.244329 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fc5b92f9-7a45-422c-b08f-6f70815c9e37 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:32.246933 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fc5b92f9-7a45-422c-b08f-6f70815c9e37 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:32.248153 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fc5b92f9-7a45-422c-b08f-6f70815c9e37 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:32.481509 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ea3fc896-62ab-4e2c-ac25-0271a74a952c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:32.490163 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ea3fc896-62ab-4e2c-ac25-0271a74a952c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be" status: 200 len: 1318 microversion: 2.1 time: 0.520801 Jan 11 15:11:32.491465 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 55/116] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:31 2022] GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be => generated 1318 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:11:32.497617 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-b3fe7942-4df5-4520-85fa-53bf896aa191 req-9effa904-9467-4389-895f-11d72ac7cddf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdd2d856-37d5-436b-b0c4-9874da364cda", "tag": "cdf915de-7c8e-41e0-bca7-ba954f5c9fed"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:11:32.499780 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:11:32.499780 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:11:32.508593 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-b3fe7942-4df5-4520-85fa-53bf896aa191 req-9effa904-9467-4389-895f-11d72ac7cddf service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:32.509258 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-b3fe7942-4df5-4520-85fa-53bf896aa191 req-9effa904-9467-4389-895f-11d72ac7cddf service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:32.521420 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-b3fe7942-4df5-4520-85fa-53bf896aa191 req-9effa904-9467-4389-895f-11d72ac7cddf service nova] Creating event network-changed:cdf915de-7c8e-41e0-bca7-ba954f5c9fed for instance bdd2d856-37d5-436b-b0c4-9874da364cda on hv-cinder-82418 Jan 11 15:11:32.527638 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [req-b3fe7942-4df5-4520-85fa-53bf896aa191 req-9effa904-9467-4389-895f-11d72ac7cddf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034142 Jan 11 15:11:32.528444 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 56/117] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:11:32.533741 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-3c16b684-5cda-4816-b3bb-3610bc6a961b req-0b6b7366-f409-45d7-9216-5f6dfb21f67c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b978091-0bf4-4e69-8053-76e49154df4c", "tag": "bf027a14-5183-43e1-9c6a-261c8c11f0ec"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:11:32.535727 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:11:32.535727 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:11:32.545191 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-3c16b684-5cda-4816-b3bb-3610bc6a961b req-0b6b7366-f409-45d7-9216-5f6dfb21f67c service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:32.545675 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-3c16b684-5cda-4816-b3bb-3610bc6a961b req-0b6b7366-f409-45d7-9216-5f6dfb21f67c service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:32.555880 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-fc5b92f9-7a45-422c-b08f-6f70815c9e37 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:32.561356 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-3c16b684-5cda-4816-b3bb-3610bc6a961b req-0b6b7366-f409-45d7-9216-5f6dfb21f67c service nova] Creating event network-changed:bf027a14-5183-43e1-9c6a-261c8c11f0ec for instance 3b978091-0bf4-4e69-8053-76e49154df4c on hv-cinder-82418 Jan 11 15:11:32.564925 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-fc5b92f9-7a45-422c-b08f-6f70815c9e37 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1321 microversion: 2.1 time: 0.346231 Jan 11 15:11:32.566135 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 62/118] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:32 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1321 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:32.566700 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [req-3c16b684-5cda-4816-b3bb-3610bc6a961b req-0b6b7366-f409-45d7-9216-5f6dfb21f67c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036716 Jan 11 15:11:32.567623 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 57/119] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:11:32.780426 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4d857c4b-dab9-4165-a432-c24b3820fd78 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:32.782180 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4d857c4b-dab9-4165-a432-c24b3820fd78 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:32.793547 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4d857c4b-dab9-4165-a432-c24b3820fd78 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:32.794917 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4d857c4b-dab9-4165-a432-c24b3820fd78 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:32.796092 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4d857c4b-dab9-4165-a432-c24b3820fd78 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:32.797145 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4d857c4b-dab9-4165-a432-c24b3820fd78 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:32.818786 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-63ae2f4c-525d-4afb-86d3-e419d7f0e47f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:32.823568 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-63ae2f4c-525d-4afb-86d3-e419d7f0e47f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:32.842555 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-63ae2f4c-525d-4afb-86d3-e419d7f0e47f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:32.843018 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-63ae2f4c-525d-4afb-86d3-e419d7f0e47f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:32.844099 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-63ae2f4c-525d-4afb-86d3-e419d7f0e47f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:32.844549 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-63ae2f4c-525d-4afb-86d3-e419d7f0e47f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:33.185852 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-4d857c4b-dab9-4165-a432-c24b3820fd78 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:33.190710 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-63ae2f4c-525d-4afb-86d3-e419d7f0e47f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:33.194327 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-4d857c4b-dab9-4165-a432-c24b3820fd78 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:33.195837 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-4d857c4b-dab9-4165-a432-c24b3820fd78 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:33.196932 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4d857c4b-dab9-4165-a432-c24b3820fd78 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda" status: 200 len: 1407 microversion: 2.20 time: 0.422199 Jan 11 15:11:33.207483 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 63/120] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:11:32 2022] GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda => generated 1407 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 15:11:33.218689 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-63ae2f4c-525d-4afb-86d3-e419d7f0e47f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 200 len: 1363 microversion: 2.1 time: 0.404650 Jan 11 15:11:33.221659 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 58/121] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:32 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 1363 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:33.243710 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ca336b16-bbcf-4bb1-9334-411bf58a0c9a tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:33.243710 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-ca336b16-bbcf-4bb1-9334-411bf58a0c9a tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:33.248932 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ca336b16-bbcf-4bb1-9334-411bf58a0c9a tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:33.249755 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ca336b16-bbcf-4bb1-9334-411bf58a0c9a tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:33.250831 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ca336b16-bbcf-4bb1-9334-411bf58a0c9a tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:33.251598 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ca336b16-bbcf-4bb1-9334-411bf58a0c9a tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:33.506850 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c49e8aee-fe76-4aa5-9f32-97802a8d5c82 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:33.508183 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c49e8aee-fe76-4aa5-9f32-97802a8d5c82 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:33.532839 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c49e8aee-fe76-4aa5-9f32-97802a8d5c82 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:33.533293 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c49e8aee-fe76-4aa5-9f32-97802a8d5c82 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:33.534088 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c49e8aee-fe76-4aa5-9f32-97802a8d5c82 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:33.534525 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c49e8aee-fe76-4aa5-9f32-97802a8d5c82 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:33.586344 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-ca336b16-bbcf-4bb1-9334-411bf58a0c9a tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:33.594051 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-ca336b16-bbcf-4bb1-9334-411bf58a0c9a tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1315 microversion: 2.1 time: 0.363813 Jan 11 15:11:33.594646 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 64/122] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:33 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:33.601162 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-caf70b88-d01a-4154-8dad-60a483f9b785 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:33.601766 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-caf70b88-d01a-4154-8dad-60a483f9b785 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:33.608981 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-caf70b88-d01a-4154-8dad-60a483f9b785 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:33.609440 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-caf70b88-d01a-4154-8dad-60a483f9b785 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:33.610351 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-caf70b88-d01a-4154-8dad-60a483f9b785 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:33.610796 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-caf70b88-d01a-4154-8dad-60a483f9b785 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:34.031106 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c49e8aee-fe76-4aa5-9f32-97802a8d5c82 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:34.035390 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-caf70b88-d01a-4154-8dad-60a483f9b785 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:34.039855 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c49e8aee-fe76-4aa5-9f32-97802a8d5c82 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be" status: 200 len: 1318 microversion: 2.1 time: 0.537637 Jan 11 15:11:34.043924 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-caf70b88-d01a-4154-8dad-60a483f9b785 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1321 microversion: 2.1 time: 0.446171 Jan 11 15:11:34.049351 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 59/123] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:33 2022] GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be => generated 1318 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:11:34.051140 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 65/124] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:33 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1321 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:34.221759 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b052339f-5a62-496a-a5eb-c697619522d7 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:34.222361 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b052339f-5a62-496a-a5eb-c697619522d7 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:34.228693 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b052339f-5a62-496a-a5eb-c697619522d7 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:34.229132 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b052339f-5a62-496a-a5eb-c697619522d7 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:34.229896 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b052339f-5a62-496a-a5eb-c697619522d7 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:34.230328 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b052339f-5a62-496a-a5eb-c697619522d7 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:34.237094 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-58ae2cad-e3ed-40b9-8dad-7d1cb94d1f07 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:34.237852 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-58ae2cad-e3ed-40b9-8dad-7d1cb94d1f07 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:34.244415 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-58ae2cad-e3ed-40b9-8dad-7d1cb94d1f07 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:34.244945 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-58ae2cad-e3ed-40b9-8dad-7d1cb94d1f07 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:34.245734 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-58ae2cad-e3ed-40b9-8dad-7d1cb94d1f07 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:34.246173 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-58ae2cad-e3ed-40b9-8dad-7d1cb94d1f07 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:34.436240 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-58ae2cad-e3ed-40b9-8dad-7d1cb94d1f07 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:34.440645 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b052339f-5a62-496a-a5eb-c697619522d7 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:34.447984 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-58ae2cad-e3ed-40b9-8dad-7d1cb94d1f07 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 200 len: 1363 microversion: 2.1 time: 0.214720 Jan 11 15:11:34.448562 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 66/125] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:34 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:11:34.456715 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b052339f-5a62-496a-a5eb-c697619522d7 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:34.458708 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b052339f-5a62-496a-a5eb-c697619522d7 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:34.460455 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b052339f-5a62-496a-a5eb-c697619522d7 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda" status: 200 len: 1407 microversion: 2.20 time: 0.242396 Jan 11 15:11:34.461017 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 60/126] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:11:34 2022] GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 15:11:34.554278 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [req-79625294-d0a3-475d-875a-32f7f1195c39 req-8a634df6-a134-408a-b9c4-5332e0d0e609 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "556650b4-5ee6-4ed5-ad51-cb3c36cca0b4", "tag": "3c3557a2-ffc2-4330-a17d-f0701fba5be9"}]} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:11:34.556491 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:11:34.556491 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: warnings.warn(msg) Jan 11 15:11:34.566898 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-79625294-d0a3-475d-875a-32f7f1195c39 req-8a634df6-a134-408a-b9c4-5332e0d0e609 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:34.567537 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-79625294-d0a3-475d-875a-32f7f1195c39 req-8a634df6-a134-408a-b9c4-5332e0d0e609 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:34.592911 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.compute.server_external_events [req-79625294-d0a3-475d-875a-32f7f1195c39 req-8a634df6-a134-408a-b9c4-5332e0d0e609 service nova] Creating event network-changed:3c3557a2-ffc2-4330-a17d-f0701fba5be9 for instance 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 on hv-cinder-82418 Jan 11 15:11:34.593672 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-79625294-d0a3-475d-875a-32f7f1195c39 req-8a634df6-a134-408a-b9c4-5332e0d0e609 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116903) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 11 15:11:34.594958 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a326a41c-512c-41b8-b5d3-6862a02a2218 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:34.595447 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a326a41c-512c-41b8-b5d3-6862a02a2218 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:34.596254 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a326a41c-512c-41b8-b5d3-6862a02a2218 None None] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:34.596691 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a326a41c-512c-41b8-b5d3-6862a02a2218 None None] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:34.607090 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.compute.rpcapi [None req-a326a41c-512c-41b8-b5d3-6862a02a2218 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 11 15:11:34.608310 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a326a41c-512c-41b8-b5d3-6862a02a2218 None None] Releasing lock "compute-rpcapi-router" {{(pid=116903) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 11 15:11:34.611164 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-06288812-2828-4533-966f-95d537878948 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:34.611799 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-06288812-2828-4533-966f-95d537878948 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:34.621392 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-06288812-2828-4533-966f-95d537878948 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:34.622075 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-06288812-2828-4533-966f-95d537878948 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:34.622881 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-06288812-2828-4533-966f-95d537878948 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:34.623370 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-06288812-2828-4533-966f-95d537878948 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:34.636270 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a326a41c-512c-41b8-b5d3-6862a02a2218 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085422 Jan 11 15:11:34.638314 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 67/127] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:11:34.783115 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-06288812-2828-4533-966f-95d537878948 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:34.788776 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-06288812-2828-4533-966f-95d537878948 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1315 microversion: 2.1 time: 0.181934 Jan 11 15:11:34.789883 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 61/128] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:34 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:35.057925 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-5f1100a2-db1f-4993-b9dd-4d613b296052 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:35.058957 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-5f1100a2-db1f-4993-b9dd-4d613b296052 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:35.061336 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b4f78456-c1cd-4316-beee-3ea0385ab73f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:35.063325 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b4f78456-c1cd-4316-beee-3ea0385ab73f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:35.065932 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5f1100a2-db1f-4993-b9dd-4d613b296052 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:35.066641 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5f1100a2-db1f-4993-b9dd-4d613b296052 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:35.067628 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5f1100a2-db1f-4993-b9dd-4d613b296052 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:35.068212 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5f1100a2-db1f-4993-b9dd-4d613b296052 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:35.070145 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b4f78456-c1cd-4316-beee-3ea0385ab73f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:35.070757 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b4f78456-c1cd-4316-beee-3ea0385ab73f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:35.072085 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b4f78456-c1cd-4316-beee-3ea0385ab73f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:35.072755 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b4f78456-c1cd-4316-beee-3ea0385ab73f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:35.371714 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b4f78456-c1cd-4316-beee-3ea0385ab73f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:35.375542 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-5f1100a2-db1f-4993-b9dd-4d613b296052 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:35.379049 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b4f78456-c1cd-4316-beee-3ea0385ab73f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1321 microversion: 2.1 time: 0.321448 Jan 11 15:11:35.385105 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-5f1100a2-db1f-4993-b9dd-4d613b296052 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be" status: 200 len: 1318 microversion: 2.1 time: 0.331752 Jan 11 15:11:35.385787 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 68/129] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:35 2022] GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:35.388585 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 62/130] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:35 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1321 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:35.463468 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f1bff979-4eae-45e9-a85d-2f0dca4e7319 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:35.464115 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f1bff979-4eae-45e9-a85d-2f0dca4e7319 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:35.470085 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f1bff979-4eae-45e9-a85d-2f0dca4e7319 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:35.470623 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f1bff979-4eae-45e9-a85d-2f0dca4e7319 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:35.471421 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f1bff979-4eae-45e9-a85d-2f0dca4e7319 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:35.471896 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f1bff979-4eae-45e9-a85d-2f0dca4e7319 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:35.478749 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-17f1a183-15d5-4b78-a9cb-a29eb389d967 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:35.479385 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-17f1a183-15d5-4b78-a9cb-a29eb389d967 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:35.485669 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-17f1a183-15d5-4b78-a9cb-a29eb389d967 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:35.486123 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-17f1a183-15d5-4b78-a9cb-a29eb389d967 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:35.487107 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-17f1a183-15d5-4b78-a9cb-a29eb389d967 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:35.487661 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-17f1a183-15d5-4b78-a9cb-a29eb389d967 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:35.682633 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-17f1a183-15d5-4b78-a9cb-a29eb389d967 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:35.690150 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-f1bff979-4eae-45e9-a85d-2f0dca4e7319 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:35.701332 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f1bff979-4eae-45e9-a85d-2f0dca4e7319 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 200 len: 1363 microversion: 2.1 time: 0.241327 Jan 11 15:11:35.702030 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 69/131] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:35 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:35.703633 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-17f1a183-15d5-4b78-a9cb-a29eb389d967 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:35.705403 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-17f1a183-15d5-4b78-a9cb-a29eb389d967 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:35.706625 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-17f1a183-15d5-4b78-a9cb-a29eb389d967 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda" status: 200 len: 1407 microversion: 2.20 time: 0.232387 Jan 11 15:11:35.707321 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 63/132] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:11:35 2022] GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 15:11:35.805631 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a134b69d-8ba5-46b9-8214-3b418bdba713 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:35.806460 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a134b69d-8ba5-46b9-8214-3b418bdba713 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:35.818126 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a134b69d-8ba5-46b9-8214-3b418bdba713 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:35.818656 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a134b69d-8ba5-46b9-8214-3b418bdba713 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:35.819506 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a134b69d-8ba5-46b9-8214-3b418bdba713 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:35.820120 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a134b69d-8ba5-46b9-8214-3b418bdba713 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:35.957758 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-a134b69d-8ba5-46b9-8214-3b418bdba713 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:35.966212 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a134b69d-8ba5-46b9-8214-3b418bdba713 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1315 microversion: 2.1 time: 0.164244 Jan 11 15:11:35.966783 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 70/133] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:35 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:36.395566 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d28d66f2-047b-427c-92fb-c70b4fe106b2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:36.396312 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d28d66f2-047b-427c-92fb-c70b4fe106b2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:36.402547 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-04d83329-70b0-4892-a487-7ceb5aa1dd7b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:36.403035 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d28d66f2-047b-427c-92fb-c70b4fe106b2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:36.403282 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d28d66f2-047b-427c-92fb-c70b4fe106b2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:36.403581 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-04d83329-70b0-4892-a487-7ceb5aa1dd7b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:36.404075 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d28d66f2-047b-427c-92fb-c70b4fe106b2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:36.404539 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d28d66f2-047b-427c-92fb-c70b4fe106b2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:36.410358 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-04d83329-70b0-4892-a487-7ceb5aa1dd7b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:36.411043 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-04d83329-70b0-4892-a487-7ceb5aa1dd7b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:36.411935 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-04d83329-70b0-4892-a487-7ceb5aa1dd7b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:36.412441 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-04d83329-70b0-4892-a487-7ceb5aa1dd7b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:36.627932 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-04d83329-70b0-4892-a487-7ceb5aa1dd7b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:36.632270 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d28d66f2-047b-427c-92fb-c70b4fe106b2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:36.639452 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-04d83329-70b0-4892-a487-7ceb5aa1dd7b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be" status: 200 len: 1318 microversion: 2.1 time: 0.240840 Jan 11 15:11:36.640298 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 71/134] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:36 2022] GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:11:36.642591 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d28d66f2-047b-427c-92fb-c70b4fe106b2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1321 microversion: 2.1 time: 0.250867 Jan 11 15:11:36.643262 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 64/135] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:36 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1321 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:36.718607 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3c4b9730-9a16-40fc-9424-7849b1a6a385 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:36.720944 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3c4b9730-9a16-40fc-9424-7849b1a6a385 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:36.725897 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-72ddebfc-a8b3-4a1d-a0dd-0f49b57997c4 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:36.726853 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-72ddebfc-a8b3-4a1d-a0dd-0f49b57997c4 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:36.727684 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3c4b9730-9a16-40fc-9424-7849b1a6a385 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:36.728388 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3c4b9730-9a16-40fc-9424-7849b1a6a385 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:36.729380 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3c4b9730-9a16-40fc-9424-7849b1a6a385 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:36.730019 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3c4b9730-9a16-40fc-9424-7849b1a6a385 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:36.741925 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-72ddebfc-a8b3-4a1d-a0dd-0f49b57997c4 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:36.742605 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-72ddebfc-a8b3-4a1d-a0dd-0f49b57997c4 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:36.743872 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-72ddebfc-a8b3-4a1d-a0dd-0f49b57997c4 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:36.744850 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-72ddebfc-a8b3-4a1d-a0dd-0f49b57997c4 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:36.984012 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-3c4b9730-9a16-40fc-9424-7849b1a6a385 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:36.987375 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3c4b9730-9a16-40fc-9424-7849b1a6a385 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 200 len: 1363 microversion: 2.1 time: 0.272649 Jan 11 15:11:36.988125 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 72/136] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:36 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 1363 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:37.003106 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-72ddebfc-a8b3-4a1d-a0dd-0f49b57997c4 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:37.011670 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-72ddebfc-a8b3-4a1d-a0dd-0f49b57997c4 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:37.013342 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-72ddebfc-a8b3-4a1d-a0dd-0f49b57997c4 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:37.014639 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-72ddebfc-a8b3-4a1d-a0dd-0f49b57997c4 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda" status: 200 len: 1407 microversion: 2.20 time: 0.293225 Jan 11 15:11:37.019211 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 65/137] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:11:36 2022] GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda => generated 1407 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 15:11:37.030428 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9591b104-329a-4714-9fef-c850eb1b620f tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:37.031761 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9591b104-329a-4714-9fef-c850eb1b620f tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:37.040160 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9591b104-329a-4714-9fef-c850eb1b620f tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:37.040618 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9591b104-329a-4714-9fef-c850eb1b620f tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:37.041414 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9591b104-329a-4714-9fef-c850eb1b620f tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:37.041935 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9591b104-329a-4714-9fef-c850eb1b620f tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:37.092098 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [req-215d6bae-8a00-4ede-b44a-75ea62be1f37 req-841825f7-b5df-4c70-a7d4-44a7d9736a9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e78f846-beb6-49c6-8f01-5cc343dbb7be", "name": "network-vif-plugged", "status": "completed", "tag": "699cc465-fddf-4b17-9874-9bfcf03e258d"}]} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:11:37.095612 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:11:37.095612 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: warnings.warn(msg) Jan 11 15:11:37.114702 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-215d6bae-8a00-4ede-b44a-75ea62be1f37 req-841825f7-b5df-4c70-a7d4-44a7d9736a9a service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:37.118106 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-215d6bae-8a00-4ede-b44a-75ea62be1f37 req-841825f7-b5df-4c70-a7d4-44a7d9736a9a service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:37.135433 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.compute.server_external_events [req-215d6bae-8a00-4ede-b44a-75ea62be1f37 req-841825f7-b5df-4c70-a7d4-44a7d9736a9a service nova] Creating event network-vif-plugged:699cc465-fddf-4b17-9874-9bfcf03e258d for instance 6e78f846-beb6-49c6-8f01-5cc343dbb7be on hv-cinder-82418 Jan 11 15:11:37.152677 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [req-215d6bae-8a00-4ede-b44a-75ea62be1f37 req-841825f7-b5df-4c70-a7d4-44a7d9736a9a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163170 Jan 11 15:11:37.154030 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 73/138] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:11:37.304506 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-9591b104-329a-4714-9fef-c850eb1b620f tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:37.314349 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9591b104-329a-4714-9fef-c850eb1b620f tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1315 microversion: 2.1 time: 0.293376 Jan 11 15:11:37.314970 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 66/139] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:37 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:37.656548 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4afe40bf-e5d3-4c79-8c06-93455f10d8b6 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:37.657245 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4afe40bf-e5d3-4c79-8c06-93455f10d8b6 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:37.661659 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-bc89ecb0-bce8-491a-845e-5a5f0606d527 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:37.662297 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-bc89ecb0-bce8-491a-845e-5a5f0606d527 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:37.665176 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4afe40bf-e5d3-4c79-8c06-93455f10d8b6 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:37.665629 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4afe40bf-e5d3-4c79-8c06-93455f10d8b6 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:37.666416 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4afe40bf-e5d3-4c79-8c06-93455f10d8b6 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:37.666885 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4afe40bf-e5d3-4c79-8c06-93455f10d8b6 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:37.669067 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bc89ecb0-bce8-491a-845e-5a5f0606d527 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:37.669473 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bc89ecb0-bce8-491a-845e-5a5f0606d527 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:37.670258 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bc89ecb0-bce8-491a-845e-5a5f0606d527 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:37.670833 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bc89ecb0-bce8-491a-845e-5a5f0606d527 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:37.924757 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-4afe40bf-e5d3-4c79-8c06-93455f10d8b6 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:37.931977 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4afe40bf-e5d3-4c79-8c06-93455f10d8b6 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be" status: 200 len: 1318 microversion: 2.1 time: 0.279316 Jan 11 15:11:37.933125 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 74/140] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:37 2022] GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:37.957182 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-bc89ecb0-bce8-491a-845e-5a5f0606d527 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:37.966752 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-bc89ecb0-bce8-491a-845e-5a5f0606d527 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1321 microversion: 2.1 time: 0.308847 Jan 11 15:11:37.967662 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 67/141] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:37 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1321 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:38.004336 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-1777751e-e9bb-4bf6-b7f0-eebc8d949222 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:38.005043 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-1777751e-e9bb-4bf6-b7f0-eebc8d949222 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:38.011688 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1777751e-e9bb-4bf6-b7f0-eebc8d949222 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:38.012136 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1777751e-e9bb-4bf6-b7f0-eebc8d949222 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:38.012917 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1777751e-e9bb-4bf6-b7f0-eebc8d949222 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:38.013355 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1777751e-e9bb-4bf6-b7f0-eebc8d949222 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:38.032573 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-66cf1f01-82e0-488c-bcbc-6f16480b3f48 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:38.033491 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-66cf1f01-82e0-488c-bcbc-6f16480b3f48 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:38.039192 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-66cf1f01-82e0-488c-bcbc-6f16480b3f48 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:38.039681 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-66cf1f01-82e0-488c-bcbc-6f16480b3f48 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:38.040461 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-66cf1f01-82e0-488c-bcbc-6f16480b3f48 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:38.040900 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-66cf1f01-82e0-488c-bcbc-6f16480b3f48 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:38.198456 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-1777751e-e9bb-4bf6-b7f0-eebc8d949222 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:38.217467 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-1777751e-e9bb-4bf6-b7f0-eebc8d949222 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 200 len: 1363 microversion: 2.1 time: 0.212325 Jan 11 15:11:38.217467 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 75/142] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:37 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:38.249904 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-66cf1f01-82e0-488c-bcbc-6f16480b3f48 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:38.270388 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-66cf1f01-82e0-488c-bcbc-6f16480b3f48 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:38.270388 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-66cf1f01-82e0-488c-bcbc-6f16480b3f48 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:38.270924 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-66cf1f01-82e0-488c-bcbc-6f16480b3f48 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda" status: 200 len: 1407 microversion: 2.20 time: 0.241575 Jan 11 15:11:38.271761 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 68/143] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:11:38 2022] GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 15:11:38.331496 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-978231f3-c4ab-485f-84e6-be4be47ce90c tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:38.332600 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-978231f3-c4ab-485f-84e6-be4be47ce90c tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:38.341443 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-978231f3-c4ab-485f-84e6-be4be47ce90c tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:38.343033 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-978231f3-c4ab-485f-84e6-be4be47ce90c tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:38.344787 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-978231f3-c4ab-485f-84e6-be4be47ce90c tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:38.346287 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-978231f3-c4ab-485f-84e6-be4be47ce90c tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:38.531965 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-978231f3-c4ab-485f-84e6-be4be47ce90c tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:38.541178 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-978231f3-c4ab-485f-84e6-be4be47ce90c tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1315 microversion: 2.1 time: 0.213829 Jan 11 15:11:38.541878 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 76/144] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:38 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:38.948778 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a35600a0-7df3-4955-be57-dd1f9448b670 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:38.949497 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a35600a0-7df3-4955-be57-dd1f9448b670 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:38.956411 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a35600a0-7df3-4955-be57-dd1f9448b670 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:38.957108 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a35600a0-7df3-4955-be57-dd1f9448b670 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:38.957916 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a35600a0-7df3-4955-be57-dd1f9448b670 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:38.958356 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a35600a0-7df3-4955-be57-dd1f9448b670 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:38.984054 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7f2787e1-8a21-47c6-871e-b1606cdbf25d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:38.984803 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7f2787e1-8a21-47c6-871e-b1606cdbf25d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:38.990561 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7f2787e1-8a21-47c6-871e-b1606cdbf25d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:38.991012 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7f2787e1-8a21-47c6-871e-b1606cdbf25d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:38.991848 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7f2787e1-8a21-47c6-871e-b1606cdbf25d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:38.992291 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7f2787e1-8a21-47c6-871e-b1606cdbf25d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:39.144815 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a35600a0-7df3-4955-be57-dd1f9448b670 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:39.155320 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a35600a0-7df3-4955-be57-dd1f9448b670 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be" status: 200 len: 1318 microversion: 2.1 time: 0.210261 Jan 11 15:11:39.156188 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 69/145] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:38 2022] GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:39.173976 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-7f2787e1-8a21-47c6-871e-b1606cdbf25d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:39.181779 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7f2787e1-8a21-47c6-871e-b1606cdbf25d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1321 microversion: 2.1 time: 0.201220 Jan 11 15:11:39.184010 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 77/146] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:38 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:11:39.187787 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-8d559df2-e58d-4276-bb0f-a8d83b0ead0f req-163b7cd8-f69f-4b7e-ab0e-a367bb09dca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "065bfd29-b195-45d4-88ea-e77e18bed4e3", "name": "network-vif-plugged", "status": "completed", "tag": "3b4e6a20-fb1b-4615-a0a3-b94c10947846"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:11:39.189507 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:11:39.189507 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:11:39.197673 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-8d559df2-e58d-4276-bb0f-a8d83b0ead0f req-163b7cd8-f69f-4b7e-ab0e-a367bb09dca4 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:39.201139 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-8d559df2-e58d-4276-bb0f-a8d83b0ead0f req-163b7cd8-f69f-4b7e-ab0e-a367bb09dca4 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:39.213077 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-8d559df2-e58d-4276-bb0f-a8d83b0ead0f req-163b7cd8-f69f-4b7e-ab0e-a367bb09dca4 service nova] Creating event network-vif-plugged:3b4e6a20-fb1b-4615-a0a3-b94c10947846 for instance 065bfd29-b195-45d4-88ea-e77e18bed4e3 on hv-cinder-82418 Jan 11 15:11:39.218525 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [req-8d559df2-e58d-4276-bb0f-a8d83b0ead0f req-163b7cd8-f69f-4b7e-ab0e-a367bb09dca4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034706 Jan 11 15:11:39.219132 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 70/147] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:11:39.232324 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-9e584c3f-a133-4bd7-881a-67c5df892390 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:39.233087 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-9e584c3f-a133-4bd7-881a-67c5df892390 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:39.241970 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9e584c3f-a133-4bd7-881a-67c5df892390 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:39.242524 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9e584c3f-a133-4bd7-881a-67c5df892390 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:39.243540 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9e584c3f-a133-4bd7-881a-67c5df892390 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:39.248547 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9e584c3f-a133-4bd7-881a-67c5df892390 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:39.290080 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-aa4881d8-34e5-4ed9-9c4d-5d38489cbf19 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:39.290946 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-aa4881d8-34e5-4ed9-9c4d-5d38489cbf19 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:39.309520 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aa4881d8-34e5-4ed9-9c4d-5d38489cbf19 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:39.309976 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aa4881d8-34e5-4ed9-9c4d-5d38489cbf19 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:39.310761 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aa4881d8-34e5-4ed9-9c4d-5d38489cbf19 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:39.311195 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aa4881d8-34e5-4ed9-9c4d-5d38489cbf19 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:39.431475 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-9e584c3f-a133-4bd7-881a-67c5df892390 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:39.448782 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-9e584c3f-a133-4bd7-881a-67c5df892390 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 200 len: 1363 microversion: 2.1 time: 0.210188 Jan 11 15:11:39.448782 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 78/148] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:39 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:39.474358 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-aa4881d8-34e5-4ed9-9c4d-5d38489cbf19 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:39.482116 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-aa4881d8-34e5-4ed9-9c4d-5d38489cbf19 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:39.483630 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-aa4881d8-34e5-4ed9-9c4d-5d38489cbf19 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:39.484712 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-aa4881d8-34e5-4ed9-9c4d-5d38489cbf19 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda" status: 200 len: 1407 microversion: 2.20 time: 0.199110 Jan 11 15:11:39.485272 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 71/149] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:11:39 2022] GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 15:11:39.558817 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-5c04aa4d-4bc8-43cc-b372-150394e0c025 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:39.559892 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-5c04aa4d-4bc8-43cc-b372-150394e0c025 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:39.566842 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5c04aa4d-4bc8-43cc-b372-150394e0c025 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:39.567284 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5c04aa4d-4bc8-43cc-b372-150394e0c025 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:39.568082 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5c04aa4d-4bc8-43cc-b372-150394e0c025 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:39.569086 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5c04aa4d-4bc8-43cc-b372-150394e0c025 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:39.700971 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-5c04aa4d-4bc8-43cc-b372-150394e0c025 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:39.708325 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-5c04aa4d-4bc8-43cc-b372-150394e0c025 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1315 microversion: 2.1 time: 0.153544 Jan 11 15:11:39.709109 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 79/150] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:39 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:40.171603 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-bbd5ab17-f838-4b68-9bea-48cb89eaa283 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:40.172263 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-bbd5ab17-f838-4b68-9bea-48cb89eaa283 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:40.178682 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bbd5ab17-f838-4b68-9bea-48cb89eaa283 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:40.179074 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bbd5ab17-f838-4b68-9bea-48cb89eaa283 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:40.179875 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bbd5ab17-f838-4b68-9bea-48cb89eaa283 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:40.180314 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bbd5ab17-f838-4b68-9bea-48cb89eaa283 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:40.199459 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c4d6ad01-0842-4f0a-81cb-cb49c1cbd835 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:40.200082 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c4d6ad01-0842-4f0a-81cb-cb49c1cbd835 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:40.205740 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c4d6ad01-0842-4f0a-81cb-cb49c1cbd835 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:40.206195 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c4d6ad01-0842-4f0a-81cb-cb49c1cbd835 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:40.207038 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c4d6ad01-0842-4f0a-81cb-cb49c1cbd835 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:40.207449 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c4d6ad01-0842-4f0a-81cb-cb49c1cbd835 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:40.374636 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-bbd5ab17-f838-4b68-9bea-48cb89eaa283 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:40.381858 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-bbd5ab17-f838-4b68-9bea-48cb89eaa283 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be" status: 200 len: 1318 microversion: 2.1 time: 0.213781 Jan 11 15:11:40.382429 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 72/151] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:40 2022] GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:40.388311 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-c4d6ad01-0842-4f0a-81cb-cb49c1cbd835 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:40.395640 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c4d6ad01-0842-4f0a-81cb-cb49c1cbd835 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1321 microversion: 2.1 time: 0.199713 Jan 11 15:11:40.396160 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 80/152] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:40 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:11:40.455620 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-80a1533f-b3ce-48cc-8c9f-99e639b3bdef tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:40.456228 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-80a1533f-b3ce-48cc-8c9f-99e639b3bdef tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:40.462437 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-80a1533f-b3ce-48cc-8c9f-99e639b3bdef tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:40.462883 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-80a1533f-b3ce-48cc-8c9f-99e639b3bdef tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:40.463697 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-80a1533f-b3ce-48cc-8c9f-99e639b3bdef tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:40.464136 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-80a1533f-b3ce-48cc-8c9f-99e639b3bdef tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:40.501608 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a7ff8bfa-a806-4c34-a814-44e359246d40 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:40.502218 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a7ff8bfa-a806-4c34-a814-44e359246d40 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:40.508547 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a7ff8bfa-a806-4c34-a814-44e359246d40 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:40.508998 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a7ff8bfa-a806-4c34-a814-44e359246d40 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:40.509782 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a7ff8bfa-a806-4c34-a814-44e359246d40 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:40.510218 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a7ff8bfa-a806-4c34-a814-44e359246d40 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:40.650359 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-80a1533f-b3ce-48cc-8c9f-99e639b3bdef tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:40.657766 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-80a1533f-b3ce-48cc-8c9f-99e639b3bdef tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 200 len: 1363 microversion: 2.1 time: 0.205616 Jan 11 15:11:40.658524 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 73/153] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:40 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:40.700067 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-a7ff8bfa-a806-4c34-a814-44e359246d40 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:40.708070 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-a7ff8bfa-a806-4c34-a814-44e359246d40 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:40.710180 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-a7ff8bfa-a806-4c34-a814-44e359246d40 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:40.711320 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a7ff8bfa-a806-4c34-a814-44e359246d40 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda" status: 200 len: 1407 microversion: 2.20 time: 0.213317 Jan 11 15:11:40.711884 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 81/154] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:11:40 2022] GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 15:11:40.724455 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7894cd7e-9969-46e7-9dbb-dd5a62471733 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:40.725108 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-7894cd7e-9969-46e7-9dbb-dd5a62471733 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:40.730965 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7894cd7e-9969-46e7-9dbb-dd5a62471733 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:40.735412 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7894cd7e-9969-46e7-9dbb-dd5a62471733 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:40.735412 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7894cd7e-9969-46e7-9dbb-dd5a62471733 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:40.735412 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7894cd7e-9969-46e7-9dbb-dd5a62471733 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:40.862765 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-7894cd7e-9969-46e7-9dbb-dd5a62471733 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:40.869866 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7894cd7e-9969-46e7-9dbb-dd5a62471733 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1315 microversion: 2.1 time: 0.149025 Jan 11 15:11:40.870440 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 74/155] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:40 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:41.397996 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-bfd2c74c-b353-4f10-b6e6-f57e77745287 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:41.398601 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-bfd2c74c-b353-4f10-b6e6-f57e77745287 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:41.404447 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bfd2c74c-b353-4f10-b6e6-f57e77745287 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:41.404892 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bfd2c74c-b353-4f10-b6e6-f57e77745287 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:41.405667 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bfd2c74c-b353-4f10-b6e6-f57e77745287 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:41.406104 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bfd2c74c-b353-4f10-b6e6-f57e77745287 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:41.412728 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e0dc661a-0e3f-4cd2-9db6-8c24be11ecea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:41.413331 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e0dc661a-0e3f-4cd2-9db6-8c24be11ecea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:41.419009 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e0dc661a-0e3f-4cd2-9db6-8c24be11ecea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:41.419499 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e0dc661a-0e3f-4cd2-9db6-8c24be11ecea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:41.420268 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e0dc661a-0e3f-4cd2-9db6-8c24be11ecea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:41.420697 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e0dc661a-0e3f-4cd2-9db6-8c24be11ecea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:41.596535 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-bfd2c74c-b353-4f10-b6e6-f57e77745287 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:41.601352 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e0dc661a-0e3f-4cd2-9db6-8c24be11ecea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:41.604283 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-bfd2c74c-b353-4f10-b6e6-f57e77745287 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be" status: 200 len: 1318 microversion: 2.1 time: 0.209928 Jan 11 15:11:41.604869 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 82/156] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:41 2022] GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:41.608531 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e0dc661a-0e3f-4cd2-9db6-8c24be11ecea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1321 microversion: 2.1 time: 0.199850 Jan 11 15:11:41.609095 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 75/157] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:41 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:11:41.673494 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f30049be-b163-4ebc-a618-eed7af84eabe tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:41.674182 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f30049be-b163-4ebc-a618-eed7af84eabe tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:41.680744 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f30049be-b163-4ebc-a618-eed7af84eabe tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:41.681258 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f30049be-b163-4ebc-a618-eed7af84eabe tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:41.682093 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f30049be-b163-4ebc-a618-eed7af84eabe tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:41.682615 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f30049be-b163-4ebc-a618-eed7af84eabe tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:41.729252 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4a788ef0-eed5-4cfa-b2aa-1ae4121308bf tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:41.729858 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-4a788ef0-eed5-4cfa-b2aa-1ae4121308bf tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:41.735678 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4a788ef0-eed5-4cfa-b2aa-1ae4121308bf tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:41.736139 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4a788ef0-eed5-4cfa-b2aa-1ae4121308bf tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:41.736916 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4a788ef0-eed5-4cfa-b2aa-1ae4121308bf tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:41.737356 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4a788ef0-eed5-4cfa-b2aa-1ae4121308bf tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:41.839056 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-f30049be-b163-4ebc-a618-eed7af84eabe tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:41.847140 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f30049be-b163-4ebc-a618-eed7af84eabe tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 200 len: 1363 microversion: 2.1 time: 0.177166 Jan 11 15:11:41.847744 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 83/158] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:41 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:41.885616 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-68d3373c-e83a-498e-836e-62abac99cb1e tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:41.886675 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-68d3373c-e83a-498e-836e-62abac99cb1e tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:41.891969 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-68d3373c-e83a-498e-836e-62abac99cb1e tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:41.892412 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-68d3373c-e83a-498e-836e-62abac99cb1e tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:41.893213 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-68d3373c-e83a-498e-836e-62abac99cb1e tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:41.893642 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-68d3373c-e83a-498e-836e-62abac99cb1e tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:41.904956 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-4a788ef0-eed5-4cfa-b2aa-1ae4121308bf tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:41.912665 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-4a788ef0-eed5-4cfa-b2aa-1ae4121308bf tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:41.914284 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-4a788ef0-eed5-4cfa-b2aa-1ae4121308bf tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:41.915406 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4a788ef0-eed5-4cfa-b2aa-1ae4121308bf tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda" status: 200 len: 1407 microversion: 2.20 time: 0.189820 Jan 11 15:11:41.915979 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 76/159] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:11:41 2022] GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 15:11:42.017749 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-68d3373c-e83a-498e-836e-62abac99cb1e tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:42.025441 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-68d3373c-e83a-498e-836e-62abac99cb1e tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1315 microversion: 2.1 time: 0.143439 Jan 11 15:11:42.026006 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 84/160] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:41 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:11:42.619849 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-af81a20d-f46c-44e4-9347-227c1df85717 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:42.620503 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-af81a20d-f46c-44e4-9347-227c1df85717 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:42.625233 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-eb06a97e-e984-4ff0-b666-f283ea514557 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:42.625835 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-eb06a97e-e984-4ff0-b666-f283ea514557 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:42.626668 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-af81a20d-f46c-44e4-9347-227c1df85717 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:42.627125 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-af81a20d-f46c-44e4-9347-227c1df85717 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:42.627949 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-af81a20d-f46c-44e4-9347-227c1df85717 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:42.628394 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-af81a20d-f46c-44e4-9347-227c1df85717 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:42.631571 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-eb06a97e-e984-4ff0-b666-f283ea514557 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:42.632017 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-eb06a97e-e984-4ff0-b666-f283ea514557 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:42.632778 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-eb06a97e-e984-4ff0-b666-f283ea514557 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:42.633211 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-eb06a97e-e984-4ff0-b666-f283ea514557 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:42.820998 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-eb06a97e-e984-4ff0-b666-f283ea514557 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:42.828094 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-eb06a97e-e984-4ff0-b666-f283ea514557 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1321 microversion: 2.1 time: 0.206510 Jan 11 15:11:42.828437 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-af81a20d-f46c-44e4-9347-227c1df85717 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:42.828663 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 85/161] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:42 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:42.836547 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-af81a20d-f46c-44e4-9347-227c1df85717 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be" status: 200 len: 1318 microversion: 2.1 time: 0.220377 Jan 11 15:11:42.837195 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 77/162] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:42 2022] GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:42.864014 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-5e5db245-4ac5-4b45-bd7f-9775db04265c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:42.864737 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-5e5db245-4ac5-4b45-bd7f-9775db04265c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:42.870668 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5e5db245-4ac5-4b45-bd7f-9775db04265c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:42.871066 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5e5db245-4ac5-4b45-bd7f-9775db04265c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:42.871863 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5e5db245-4ac5-4b45-bd7f-9775db04265c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:42.872296 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5e5db245-4ac5-4b45-bd7f-9775db04265c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:42.932641 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3012a9dc-976e-4f6e-9a24-026f2aedeebf tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:42.933378 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3012a9dc-976e-4f6e-9a24-026f2aedeebf tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:42.939142 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3012a9dc-976e-4f6e-9a24-026f2aedeebf tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:42.939615 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3012a9dc-976e-4f6e-9a24-026f2aedeebf tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:42.940383 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3012a9dc-976e-4f6e-9a24-026f2aedeebf tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:42.940815 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3012a9dc-976e-4f6e-9a24-026f2aedeebf tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:43.032072 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-5e5db245-4ac5-4b45-bd7f-9775db04265c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:43.039725 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-5e5db245-4ac5-4b45-bd7f-9775db04265c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 200 len: 1363 microversion: 2.1 time: 0.179201 Jan 11 15:11:43.040237 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 86/163] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:42 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:11:43.046176 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-da5271ce-7deb-432d-b0dc-5dcfae63ad96 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:43.046833 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-da5271ce-7deb-432d-b0dc-5dcfae63ad96 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:43.052673 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-da5271ce-7deb-432d-b0dc-5dcfae63ad96 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:43.053119 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-da5271ce-7deb-432d-b0dc-5dcfae63ad96 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:43.053895 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-da5271ce-7deb-432d-b0dc-5dcfae63ad96 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:43.054330 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-da5271ce-7deb-432d-b0dc-5dcfae63ad96 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:43.100668 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3012a9dc-976e-4f6e-9a24-026f2aedeebf tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:43.108432 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3012a9dc-976e-4f6e-9a24-026f2aedeebf tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:43.109918 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3012a9dc-976e-4f6e-9a24-026f2aedeebf tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:43.111045 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3012a9dc-976e-4f6e-9a24-026f2aedeebf tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda" status: 200 len: 1407 microversion: 2.20 time: 0.182062 Jan 11 15:11:43.111644 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 78/164] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:11:42 2022] GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 15:11:43.181101 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-da5271ce-7deb-432d-b0dc-5dcfae63ad96 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:43.188202 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-da5271ce-7deb-432d-b0dc-5dcfae63ad96 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1315 microversion: 2.1 time: 0.145446 Jan 11 15:11:43.188793 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 87/165] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:43 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:43.845170 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-52bfb70e-ceb6-455b-acfd-833cdf7475e3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:43.845771 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-52bfb70e-ceb6-455b-acfd-833cdf7475e3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:43.852215 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-52bfb70e-ceb6-455b-acfd-833cdf7475e3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:43.852667 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-52bfb70e-ceb6-455b-acfd-833cdf7475e3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:43.853436 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-52bfb70e-ceb6-455b-acfd-833cdf7475e3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:43.853540 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-18a4da08-b3fc-47d0-b02b-03ee0d2622c7 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:43.853940 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-52bfb70e-ceb6-455b-acfd-833cdf7475e3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:43.854107 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-18a4da08-b3fc-47d0-b02b-03ee0d2622c7 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:43.859876 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-18a4da08-b3fc-47d0-b02b-03ee0d2622c7 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:43.860360 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-18a4da08-b3fc-47d0-b02b-03ee0d2622c7 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:43.861123 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-18a4da08-b3fc-47d0-b02b-03ee0d2622c7 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:43.861550 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-18a4da08-b3fc-47d0-b02b-03ee0d2622c7 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:44.045973 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-52bfb70e-ceb6-455b-acfd-833cdf7475e3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:44.049145 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-18a4da08-b3fc-47d0-b02b-03ee0d2622c7 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:44.053920 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-52bfb70e-ceb6-455b-acfd-833cdf7475e3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1321 microversion: 2.1 time: 0.212590 Jan 11 15:11:44.054586 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 79/166] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:43 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:44.058257 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-18a4da08-b3fc-47d0-b02b-03ee0d2622c7 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be" status: 200 len: 1318 microversion: 2.1 time: 0.208981 Jan 11 15:11:44.058965 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 88/167] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:43 2022] GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:11:44.062854 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c58acc17-8b99-4928-b7d7-c6268a707049 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:44.063786 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c58acc17-8b99-4928-b7d7-c6268a707049 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:44.070368 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c58acc17-8b99-4928-b7d7-c6268a707049 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:44.070828 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c58acc17-8b99-4928-b7d7-c6268a707049 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:44.071641 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c58acc17-8b99-4928-b7d7-c6268a707049 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:44.072085 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c58acc17-8b99-4928-b7d7-c6268a707049 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:44.128545 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b12f96ef-b3d9-42fd-aa84-0cbfb3d27007 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:44.129327 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b12f96ef-b3d9-42fd-aa84-0cbfb3d27007 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:44.135655 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b12f96ef-b3d9-42fd-aa84-0cbfb3d27007 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:44.136169 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b12f96ef-b3d9-42fd-aa84-0cbfb3d27007 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:44.136949 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b12f96ef-b3d9-42fd-aa84-0cbfb3d27007 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:44.137383 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b12f96ef-b3d9-42fd-aa84-0cbfb3d27007 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:44.227180 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c58acc17-8b99-4928-b7d7-c6268a707049 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:44.234891 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c58acc17-8b99-4928-b7d7-c6268a707049 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 200 len: 1363 microversion: 2.1 time: 0.179035 Jan 11 15:11:44.235525 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 80/168] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:44 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:44.240422 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3c21d597-311e-447c-8340-9f8db7fcb1fd tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:44.241020 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3c21d597-311e-447c-8340-9f8db7fcb1fd tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:44.249314 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c21d597-311e-447c-8340-9f8db7fcb1fd tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:44.249768 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c21d597-311e-447c-8340-9f8db7fcb1fd tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:44.250553 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c21d597-311e-447c-8340-9f8db7fcb1fd tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:44.250995 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c21d597-311e-447c-8340-9f8db7fcb1fd tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:44.306140 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-b12f96ef-b3d9-42fd-aa84-0cbfb3d27007 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:44.313946 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-b12f96ef-b3d9-42fd-aa84-0cbfb3d27007 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:44.315448 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-b12f96ef-b3d9-42fd-aa84-0cbfb3d27007 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:44.316630 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b12f96ef-b3d9-42fd-aa84-0cbfb3d27007 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda" status: 200 len: 1407 microversion: 2.20 time: 0.191763 Jan 11 15:11:44.317190 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 89/169] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:11:44 2022] GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 15:11:44.389774 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3c21d597-311e-447c-8340-9f8db7fcb1fd tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:44.397053 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3c21d597-311e-447c-8340-9f8db7fcb1fd tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1315 microversion: 2.1 time: 0.160599 Jan 11 15:11:44.397612 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 81/170] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:44 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:45.070219 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-24ec6cde-ab31-4fbc-bb46-0c71b985f120 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:45.070901 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-24ec6cde-ab31-4fbc-bb46-0c71b985f120 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:45.074894 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e6372aa3-f92e-4e53-bf52-9f95e266ab29 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:45.075507 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e6372aa3-f92e-4e53-bf52-9f95e266ab29 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:45.076851 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-24ec6cde-ab31-4fbc-bb46-0c71b985f120 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:45.077472 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-24ec6cde-ab31-4fbc-bb46-0c71b985f120 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:45.078270 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-24ec6cde-ab31-4fbc-bb46-0c71b985f120 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:45.078701 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-24ec6cde-ab31-4fbc-bb46-0c71b985f120 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:45.081268 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e6372aa3-f92e-4e53-bf52-9f95e266ab29 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:45.081717 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e6372aa3-f92e-4e53-bf52-9f95e266ab29 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:45.082495 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e6372aa3-f92e-4e53-bf52-9f95e266ab29 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:45.082928 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e6372aa3-f92e-4e53-bf52-9f95e266ab29 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:45.269167 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-24ec6cde-ab31-4fbc-bb46-0c71b985f120 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:45.273530 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e6372aa3-f92e-4e53-bf52-9f95e266ab29 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:45.276503 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-24ec6cde-ab31-4fbc-bb46-0c71b985f120 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1321 microversion: 2.1 time: 0.210671 Jan 11 15:11:45.277149 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 90/171] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:45 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:45.281149 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e6372aa3-f92e-4e53-bf52-9f95e266ab29 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be" status: 200 len: 1509 microversion: 2.1 time: 0.209925 Jan 11 15:11:45.281457 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-5d50e4b0-9d75-4453-81f0-87c635be6f31 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:45.283365 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 82/172] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:45 2022] GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be => generated 1509 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:11:45.283488 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-5d50e4b0-9d75-4453-81f0-87c635be6f31 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:45.288273 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5d50e4b0-9d75-4453-81f0-87c635be6f31 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:45.288726 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5d50e4b0-9d75-4453-81f0-87c635be6f31 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:45.289508 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5d50e4b0-9d75-4453-81f0-87c635be6f31 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:45.289950 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5d50e4b0-9d75-4453-81f0-87c635be6f31 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:45.334459 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6e2b5d01-21fb-4717-a21d-131dde60ee2b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:45.335067 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6e2b5d01-21fb-4717-a21d-131dde60ee2b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:45.340842 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6e2b5d01-21fb-4717-a21d-131dde60ee2b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:45.341444 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6e2b5d01-21fb-4717-a21d-131dde60ee2b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:45.342731 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6e2b5d01-21fb-4717-a21d-131dde60ee2b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:45.342841 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6e2b5d01-21fb-4717-a21d-131dde60ee2b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:45.488415 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-5d50e4b0-9d75-4453-81f0-87c635be6f31 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:45.496256 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-5d50e4b0-9d75-4453-81f0-87c635be6f31 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 200 len: 1363 microversion: 2.1 time: 0.218118 Jan 11 15:11:45.496833 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 91/173] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:45 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:45.502087 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-9de62780-be38-401e-9089-493ad09c044d tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:45.502863 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-9de62780-be38-401e-9089-493ad09c044d tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:45.510536 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9de62780-be38-401e-9089-493ad09c044d tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:45.511197 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9de62780-be38-401e-9089-493ad09c044d tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:45.512157 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9de62780-be38-401e-9089-493ad09c044d tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:45.512745 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9de62780-be38-401e-9089-493ad09c044d tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:45.525496 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6e2b5d01-21fb-4717-a21d-131dde60ee2b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:45.535153 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6e2b5d01-21fb-4717-a21d-131dde60ee2b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:45.537519 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6e2b5d01-21fb-4717-a21d-131dde60ee2b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:45.538741 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6e2b5d01-21fb-4717-a21d-131dde60ee2b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda" status: 200 len: 1407 microversion: 2.20 time: 0.207986 Jan 11 15:11:45.539431 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 83/174] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:11:45 2022] GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 15:11:45.647914 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-9de62780-be38-401e-9089-493ad09c044d tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:45.655278 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-9de62780-be38-401e-9089-493ad09c044d tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1315 microversion: 2.1 time: 0.157136 Jan 11 15:11:45.655879 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 92/175] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:45 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:46.292504 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a9c1788e-7645-4c54-b61e-7cab01b769ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:46.293111 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a9c1788e-7645-4c54-b61e-7cab01b769ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:46.298892 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a9c1788e-7645-4c54-b61e-7cab01b769ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:46.299362 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a9c1788e-7645-4c54-b61e-7cab01b769ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:46.300132 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a9c1788e-7645-4c54-b61e-7cab01b769ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:46.300564 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a9c1788e-7645-4c54-b61e-7cab01b769ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:46.437687 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a9c1788e-7645-4c54-b61e-7cab01b769ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:46.444972 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a9c1788e-7645-4c54-b61e-7cab01b769ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1321 microversion: 2.1 time: 0.156041 Jan 11 15:11:46.445541 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 84/176] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:46 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:46.512875 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e5e89df2-9717-48b4-a35d-1e59e3dc8bbb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:46.513507 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e5e89df2-9717-48b4-a35d-1e59e3dc8bbb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:46.519375 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e5e89df2-9717-48b4-a35d-1e59e3dc8bbb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:46.519859 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e5e89df2-9717-48b4-a35d-1e59e3dc8bbb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:46.520656 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e5e89df2-9717-48b4-a35d-1e59e3dc8bbb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:46.521600 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e5e89df2-9717-48b4-a35d-1e59e3dc8bbb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:46.556469 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9350e0e8-129c-496a-8727-ba5dee3c71fb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:46.557075 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9350e0e8-129c-496a-8727-ba5dee3c71fb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:46.563245 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9350e0e8-129c-496a-8727-ba5dee3c71fb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:46.563791 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9350e0e8-129c-496a-8727-ba5dee3c71fb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:46.564669 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9350e0e8-129c-496a-8727-ba5dee3c71fb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:46.565194 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9350e0e8-129c-496a-8727-ba5dee3c71fb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:46.682344 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-e5e89df2-9717-48b4-a35d-1e59e3dc8bbb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:46.690081 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e5e89df2-9717-48b4-a35d-1e59e3dc8bbb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 200 len: 1363 microversion: 2.1 time: 0.180820 Jan 11 15:11:46.690648 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 93/177] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:46 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:46.695455 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a185a9dc-76cc-434a-a664-bdc4d1db1774 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:46.696306 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a185a9dc-76cc-434a-a664-bdc4d1db1774 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:46.701965 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a185a9dc-76cc-434a-a664-bdc4d1db1774 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:46.702419 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a185a9dc-76cc-434a-a664-bdc4d1db1774 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:46.703202 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a185a9dc-76cc-434a-a664-bdc4d1db1774 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:46.703674 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a185a9dc-76cc-434a-a664-bdc4d1db1774 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:46.729887 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-9350e0e8-129c-496a-8727-ba5dee3c71fb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:46.739678 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-9350e0e8-129c-496a-8727-ba5dee3c71fb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:46.742199 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-9350e0e8-129c-496a-8727-ba5dee3c71fb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:46.743354 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9350e0e8-129c-496a-8727-ba5dee3c71fb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda" status: 200 len: 1407 microversion: 2.20 time: 0.190462 Jan 11 15:11:46.746121 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 85/178] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:11:46 2022] GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 15:11:46.836917 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-a185a9dc-76cc-434a-a664-bdc4d1db1774 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:46.844288 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a185a9dc-76cc-434a-a664-bdc4d1db1774 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1315 microversion: 2.1 time: 0.152728 Jan 11 15:11:46.844846 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 94/179] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:46 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:47.461646 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-104d3288-150c-4ad5-b35f-cdd6f5a83467 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:47.462158 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-104d3288-150c-4ad5-b35f-cdd6f5a83467 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:47.468279 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-104d3288-150c-4ad5-b35f-cdd6f5a83467 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:47.468733 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-104d3288-150c-4ad5-b35f-cdd6f5a83467 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:47.469504 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-104d3288-150c-4ad5-b35f-cdd6f5a83467 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:47.469944 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-104d3288-150c-4ad5-b35f-cdd6f5a83467 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:47.605498 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-104d3288-150c-4ad5-b35f-cdd6f5a83467 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:47.612878 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-104d3288-150c-4ad5-b35f-cdd6f5a83467 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1321 microversion: 2.1 time: 0.155032 Jan 11 15:11:47.613456 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 86/180] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:47 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:47.707136 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-77edf139-eb5c-4241-bc80-9cc3f01fe988 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:47.707765 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-77edf139-eb5c-4241-bc80-9cc3f01fe988 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:47.713948 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-77edf139-eb5c-4241-bc80-9cc3f01fe988 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:47.714337 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-77edf139-eb5c-4241-bc80-9cc3f01fe988 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:47.715194 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-77edf139-eb5c-4241-bc80-9cc3f01fe988 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:47.715699 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-77edf139-eb5c-4241-bc80-9cc3f01fe988 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:47.760206 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ecd4e04f-69ef-4824-b3ce-eae8da5ab173 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:47.760839 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ecd4e04f-69ef-4824-b3ce-eae8da5ab173 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:47.766738 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ecd4e04f-69ef-4824-b3ce-eae8da5ab173 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:47.767188 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ecd4e04f-69ef-4824-b3ce-eae8da5ab173 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:47.767987 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ecd4e04f-69ef-4824-b3ce-eae8da5ab173 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:47.768432 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ecd4e04f-69ef-4824-b3ce-eae8da5ab173 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:47.867820 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-77edf139-eb5c-4241-bc80-9cc3f01fe988 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:47.874973 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-77edf139-eb5c-4241-bc80-9cc3f01fe988 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 200 len: 1363 microversion: 2.1 time: 0.171557 Jan 11 15:11:47.875564 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 95/181] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:47 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:47.881376 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2bb406d9-7bc9-4648-a455-d08a62747457 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:47.881980 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2bb406d9-7bc9-4648-a455-d08a62747457 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:47.887856 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2bb406d9-7bc9-4648-a455-d08a62747457 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:47.888309 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2bb406d9-7bc9-4648-a455-d08a62747457 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:47.889088 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2bb406d9-7bc9-4648-a455-d08a62747457 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:47.890757 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2bb406d9-7bc9-4648-a455-d08a62747457 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:47.937012 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ecd4e04f-69ef-4824-b3ce-eae8da5ab173 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:47.944753 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ecd4e04f-69ef-4824-b3ce-eae8da5ab173 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:47.946244 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ecd4e04f-69ef-4824-b3ce-eae8da5ab173 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:47.947357 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ecd4e04f-69ef-4824-b3ce-eae8da5ab173 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda" status: 200 len: 1407 microversion: 2.20 time: 0.190824 Jan 11 15:11:47.947919 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 87/182] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:11:47 2022] GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 15:11:48.021796 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-2bb406d9-7bc9-4648-a455-d08a62747457 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:48.028955 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2bb406d9-7bc9-4648-a455-d08a62747457 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1315 microversion: 2.1 time: 0.152477 Jan 11 15:11:48.029513 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 96/183] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:47 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:48.629693 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6c515b6c-035d-4c54-a7b2-46026ca8aab1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:48.630333 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6c515b6c-035d-4c54-a7b2-46026ca8aab1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:48.636354 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6c515b6c-035d-4c54-a7b2-46026ca8aab1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:48.636679 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6c515b6c-035d-4c54-a7b2-46026ca8aab1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:48.637470 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6c515b6c-035d-4c54-a7b2-46026ca8aab1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:48.637907 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6c515b6c-035d-4c54-a7b2-46026ca8aab1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:48.766336 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6c515b6c-035d-4c54-a7b2-46026ca8aab1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:48.774226 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6c515b6c-035d-4c54-a7b2-46026ca8aab1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1321 microversion: 2.1 time: 0.148142 Jan 11 15:11:48.774791 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 88/184] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:48 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:48.840577 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [req-2496d8e5-db06-44a1-a8ce-deda68e058eb req-77a19412-6664-4e89-bd87-8c10c3a8c5d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdd2d856-37d5-436b-b0c4-9874da364cda", "name": "network-vif-plugged", "status": "completed", "tag": "cdf915de-7c8e-41e0-bca7-ba954f5c9fed"}]} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:11:48.842467 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:11:48.842467 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: warnings.warn(msg) Jan 11 15:11:48.851008 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-2496d8e5-db06-44a1-a8ce-deda68e058eb req-77a19412-6664-4e89-bd87-8c10c3a8c5d6 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:48.851484 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-2496d8e5-db06-44a1-a8ce-deda68e058eb req-77a19412-6664-4e89-bd87-8c10c3a8c5d6 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:48.861951 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.compute.server_external_events [req-2496d8e5-db06-44a1-a8ce-deda68e058eb req-77a19412-6664-4e89-bd87-8c10c3a8c5d6 service nova] Creating event network-vif-plugged:cdf915de-7c8e-41e0-bca7-ba954f5c9fed for instance bdd2d856-37d5-436b-b0c4-9874da364cda on hv-cinder-82418 Jan 11 15:11:48.866801 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [req-2496d8e5-db06-44a1-a8ce-deda68e058eb req-77a19412-6664-4e89-bd87-8c10c3a8c5d6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030253 Jan 11 15:11:48.867409 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 97/185] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:11:48.895273 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d0227397-23ea-4627-9200-633792608060 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:48.897083 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d0227397-23ea-4627-9200-633792608060 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:48.903780 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d0227397-23ea-4627-9200-633792608060 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:48.904242 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d0227397-23ea-4627-9200-633792608060 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:48.905031 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d0227397-23ea-4627-9200-633792608060 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:48.905475 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d0227397-23ea-4627-9200-633792608060 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:48.965828 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3ee16829-198a-4aca-993c-4fc3d9ef3a7e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:48.967053 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3ee16829-198a-4aca-993c-4fc3d9ef3a7e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:48.974153 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3ee16829-198a-4aca-993c-4fc3d9ef3a7e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:48.974609 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3ee16829-198a-4aca-993c-4fc3d9ef3a7e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:48.975443 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3ee16829-198a-4aca-993c-4fc3d9ef3a7e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:48.976013 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3ee16829-198a-4aca-993c-4fc3d9ef3a7e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:49.094722 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d0227397-23ea-4627-9200-633792608060 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:49.103539 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d0227397-23ea-4627-9200-633792608060 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 200 len: 1363 microversion: 2.1 time: 0.215159 Jan 11 15:11:49.114118 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 89/186] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:48 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:49.119407 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-56098275-80f6-43ea-bfb3-76287bc41c9e tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:49.120463 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-56098275-80f6-43ea-bfb3-76287bc41c9e tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:49.126895 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-56098275-80f6-43ea-bfb3-76287bc41c9e tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:49.127383 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-56098275-80f6-43ea-bfb3-76287bc41c9e tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:49.128175 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-56098275-80f6-43ea-bfb3-76287bc41c9e tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:49.128724 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-56098275-80f6-43ea-bfb3-76287bc41c9e tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:49.171101 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-3ee16829-198a-4aca-993c-4fc3d9ef3a7e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:49.187420 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-3ee16829-198a-4aca-993c-4fc3d9ef3a7e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:49.190107 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-3ee16829-198a-4aca-993c-4fc3d9ef3a7e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:49.193863 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3ee16829-198a-4aca-993c-4fc3d9ef3a7e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda" status: 200 len: 1407 microversion: 2.20 time: 0.231797 Jan 11 15:11:49.195635 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 98/187] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:11:48 2022] GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 15:11:49.317524 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-56098275-80f6-43ea-bfb3-76287bc41c9e tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:49.324738 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-56098275-80f6-43ea-bfb3-76287bc41c9e tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1315 microversion: 2.1 time: 0.208953 Jan 11 15:11:49.325328 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 90/188] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:49 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:49.790980 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-da653a6d-3810-43a9-9d24-2941fda43d18 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:49.791621 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-da653a6d-3810-43a9-9d24-2941fda43d18 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:49.797581 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-da653a6d-3810-43a9-9d24-2941fda43d18 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:49.798349 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-da653a6d-3810-43a9-9d24-2941fda43d18 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:49.799770 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-da653a6d-3810-43a9-9d24-2941fda43d18 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:49.805615 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-da653a6d-3810-43a9-9d24-2941fda43d18 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:49.957119 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-da653a6d-3810-43a9-9d24-2941fda43d18 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:49.968789 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-da653a6d-3810-43a9-9d24-2941fda43d18 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1321 microversion: 2.1 time: 0.181662 Jan 11 15:11:49.969787 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 99/189] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:49 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:50.123106 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-84f53793-ccc9-49bb-adec-c1d1777506f5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:50.123106 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-84f53793-ccc9-49bb-adec-c1d1777506f5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:50.127771 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-84f53793-ccc9-49bb-adec-c1d1777506f5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:50.128252 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-84f53793-ccc9-49bb-adec-c1d1777506f5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:50.129044 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-84f53793-ccc9-49bb-adec-c1d1777506f5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:50.129485 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-84f53793-ccc9-49bb-adec-c1d1777506f5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:50.219675 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4417d610-296c-46d4-99e8-1dc1c07f1384 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:50.220287 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4417d610-296c-46d4-99e8-1dc1c07f1384 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:50.227372 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4417d610-296c-46d4-99e8-1dc1c07f1384 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:50.228036 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4417d610-296c-46d4-99e8-1dc1c07f1384 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:50.229430 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4417d610-296c-46d4-99e8-1dc1c07f1384 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:50.230535 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4417d610-296c-46d4-99e8-1dc1c07f1384 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:50.273504 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-84f53793-ccc9-49bb-adec-c1d1777506f5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:50.283979 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-84f53793-ccc9-49bb-adec-c1d1777506f5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 200 len: 1363 microversion: 2.1 time: 0.166982 Jan 11 15:11:50.284666 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 91/190] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:50 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:50.341799 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-55326f6d-bbf2-41db-bbd0-65f900a09424 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:50.342409 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-55326f6d-bbf2-41db-bbd0-65f900a09424 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:50.348363 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-55326f6d-bbf2-41db-bbd0-65f900a09424 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:50.348820 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-55326f6d-bbf2-41db-bbd0-65f900a09424 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:50.349681 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-55326f6d-bbf2-41db-bbd0-65f900a09424 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:50.361296 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-55326f6d-bbf2-41db-bbd0-65f900a09424 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:50.575362 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-4417d610-296c-46d4-99e8-1dc1c07f1384 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:50.583847 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-4417d610-296c-46d4-99e8-1dc1c07f1384 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:50.585416 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-4417d610-296c-46d4-99e8-1dc1c07f1384 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:50.586603 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4417d610-296c-46d4-99e8-1dc1c07f1384 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda" status: 200 len: 1407 microversion: 2.20 time: 0.376510 Jan 11 15:11:50.587430 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 100/191] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:11:50 2022] GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda => generated 1407 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 15:11:50.665800 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-55326f6d-bbf2-41db-bbd0-65f900a09424 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:50.672990 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-55326f6d-bbf2-41db-bbd0-65f900a09424 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1503 microversion: 2.1 time: 0.334985 Jan 11 15:11:50.673559 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 92/192] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:50 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1503 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:50.882258 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [req-f4147875-2cb4-46fb-91e7-b52a9ef1a369 req-57ac529f-e3f9-41e6-ad2e-a2da04fe83ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2127507f-81ad-406d-a9fa-9e4c615184ba", "name": "network-vif-plugged", "status": "completed", "tag": "8258f5fe-4e30-4513-9898-eab0cc1ce678"}, {"server_uuid": "3b978091-0bf4-4e69-8053-76e49154df4c", "name": "network-vif-plugged", "status": "completed", "tag": "bf027a14-5183-43e1-9c6a-261c8c11f0ec"}, {"server_uuid": "556650b4-5ee6-4ed5-ad51-cb3c36cca0b4", "name": "network-vif-plugged", "status": "completed", "tag": "3c3557a2-ffc2-4330-a17d-f0701fba5be9"}]} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:11:50.884284 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:11:50.884284 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: warnings.warn(msg) Jan 11 15:11:50.892232 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-f4147875-2cb4-46fb-91e7-b52a9ef1a369 req-57ac529f-e3f9-41e6-ad2e-a2da04fe83ea service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:50.892669 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-f4147875-2cb4-46fb-91e7-b52a9ef1a369 req-57ac529f-e3f9-41e6-ad2e-a2da04fe83ea service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:50.910708 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.compute.server_external_events [req-f4147875-2cb4-46fb-91e7-b52a9ef1a369 req-57ac529f-e3f9-41e6-ad2e-a2da04fe83ea service nova] Creating event network-vif-plugged:8258f5fe-4e30-4513-9898-eab0cc1ce678 for instance 2127507f-81ad-406d-a9fa-9e4c615184ba on hv-cinder-82418 Jan 11 15:11:50.911208 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.compute.server_external_events [req-f4147875-2cb4-46fb-91e7-b52a9ef1a369 req-57ac529f-e3f9-41e6-ad2e-a2da04fe83ea service nova] Creating event network-vif-plugged:bf027a14-5183-43e1-9c6a-261c8c11f0ec for instance 3b978091-0bf4-4e69-8053-76e49154df4c on hv-cinder-82418 Jan 11 15:11:50.911912 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.compute.server_external_events [req-f4147875-2cb4-46fb-91e7-b52a9ef1a369 req-57ac529f-e3f9-41e6-ad2e-a2da04fe83ea service nova] Creating event network-vif-plugged:3c3557a2-ffc2-4330-a17d-f0701fba5be9 for instance 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 on hv-cinder-82418 Jan 11 15:11:50.920119 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [req-f4147875-2cb4-46fb-91e7-b52a9ef1a369 req-57ac529f-e3f9-41e6-ad2e-a2da04fe83ea service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.042129 Jan 11 15:11:50.920723 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 101/193] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:11:50.985822 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2cfb31f7-bb26-4618-a558-98e435c491da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:50.986281 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2cfb31f7-bb26-4618-a558-98e435c491da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:50.992684 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2cfb31f7-bb26-4618-a558-98e435c491da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:50.993138 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2cfb31f7-bb26-4618-a558-98e435c491da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:50.993915 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2cfb31f7-bb26-4618-a558-98e435c491da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:50.994352 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2cfb31f7-bb26-4618-a558-98e435c491da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:51.141744 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-2cfb31f7-bb26-4618-a558-98e435c491da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:51.149900 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2cfb31f7-bb26-4618-a558-98e435c491da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1321 microversion: 2.1 time: 0.167740 Jan 11 15:11:51.150537 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 93/194] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:50 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:51.301145 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-47643878-5796-400c-b4aa-dfa99aecd7ec tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:51.302009 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-47643878-5796-400c-b4aa-dfa99aecd7ec tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:51.308666 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-47643878-5796-400c-b4aa-dfa99aecd7ec tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:51.309105 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-47643878-5796-400c-b4aa-dfa99aecd7ec tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:51.311355 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-47643878-5796-400c-b4aa-dfa99aecd7ec tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:51.311355 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-47643878-5796-400c-b4aa-dfa99aecd7ec tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:51.426616 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-193da514-2ba2-4dd8-9da2-0cd91044bc15 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43ed0210-fa7b-4c68-a3df-34164b27365c"}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:11:51.428792 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-193da514-2ba2-4dd8-9da2-0cd91044bc15 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:51.439382 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-193da514-2ba2-4dd8-9da2-0cd91044bc15 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:51.448981 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-193da514-2ba2-4dd8-9da2-0cd91044bc15 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:51.450364 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-193da514-2ba2-4dd8-9da2-0cd91044bc15 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:51.450818 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-193da514-2ba2-4dd8-9da2-0cd91044bc15 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:51.521820 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-47643878-5796-400c-b4aa-dfa99aecd7ec tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:51.529200 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-47643878-5796-400c-b4aa-dfa99aecd7ec tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 200 len: 1363 microversion: 2.1 time: 0.232020 Jan 11 15:11:51.529857 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 102/195] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:51 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:51.607774 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-0e3cfceb-e487-4621-9f57-3465c4f31c4e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:51.608378 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-0e3cfceb-e487-4621-9f57-3465c4f31c4e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:51.614242 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0e3cfceb-e487-4621-9f57-3465c4f31c4e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:51.614683 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0e3cfceb-e487-4621-9f57-3465c4f31c4e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:51.615598 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0e3cfceb-e487-4621-9f57-3465c4f31c4e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:51.616029 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0e3cfceb-e487-4621-9f57-3465c4f31c4e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:51.744309 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-0e3cfceb-e487-4621-9f57-3465c4f31c4e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:51.752353 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-0e3cfceb-e487-4621-9f57-3465c4f31c4e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:51.753929 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-0e3cfceb-e487-4621-9f57-3465c4f31c4e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:51.755056 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-0e3cfceb-e487-4621-9f57-3465c4f31c4e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda" status: 200 len: 1599 microversion: 2.20 time: 0.150998 Jan 11 15:11:51.759645 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 103/196] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:11:51 2022] GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 15:11:51.773528 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-42f73857-4ae8-4f44-aa27-11652834e38f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:51.774037 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-42f73857-4ae8-4f44-aa27-11652834e38f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:51.779832 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-42f73857-4ae8-4f44-aa27-11652834e38f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:51.780279 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-42f73857-4ae8-4f44-aa27-11652834e38f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:51.781082 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-42f73857-4ae8-4f44-aa27-11652834e38f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:51.781518 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-42f73857-4ae8-4f44-aa27-11652834e38f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:51.895738 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-42f73857-4ae8-4f44-aa27-11652834e38f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.126348 Jan 11 15:11:51.897017 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 104/197] 10.222.0.52 () {60 vars in 1315 bytes} [Tue Jan 11 15:11:51 2022] GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:11:52.165790 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2eabeafa-e32c-49c9-89d7-02508112b357 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:52.167113 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2eabeafa-e32c-49c9-89d7-02508112b357 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:52.172940 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2eabeafa-e32c-49c9-89d7-02508112b357 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:52.173380 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2eabeafa-e32c-49c9-89d7-02508112b357 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:52.174154 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2eabeafa-e32c-49c9-89d7-02508112b357 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:52.174594 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2eabeafa-e32c-49c9-89d7-02508112b357 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:52.578558 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-2eabeafa-e32c-49c9-89d7-02508112b357 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:52.585909 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2eabeafa-e32c-49c9-89d7-02508112b357 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1321 microversion: 2.1 time: 0.423871 Jan 11 15:11:52.586599 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 105/198] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:52 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1321 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:11:52.593117 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-66ac2014-8b75-4d3c-8aeb-fe6adcb1e0a3 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:52.594565 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-66ac2014-8b75-4d3c-8aeb-fe6adcb1e0a3 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:52.601490 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-66ac2014-8b75-4d3c-8aeb-fe6adcb1e0a3 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:52.602161 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-66ac2014-8b75-4d3c-8aeb-fe6adcb1e0a3 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:52.603011 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-66ac2014-8b75-4d3c-8aeb-fe6adcb1e0a3 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:52.603556 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-66ac2014-8b75-4d3c-8aeb-fe6adcb1e0a3 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:52.810749 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-66ac2014-8b75-4d3c-8aeb-fe6adcb1e0a3 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:52.818137 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-66ac2014-8b75-4d3c-8aeb-fe6adcb1e0a3 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 200 len: 1363 microversion: 2.1 time: 0.230400 Jan 11 15:11:52.819867 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 106/199] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:52 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:53.343956 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-27f92f19-14f1-483d-a798-a8981a3116ec tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:11:53.346779 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-27f92f19-14f1-483d-a798-a8981a3116ec tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:53.351431 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-27f92f19-14f1-483d-a798-a8981a3116ec tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:53.351889 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-27f92f19-14f1-483d-a798-a8981a3116ec tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:53.353057 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-27f92f19-14f1-483d-a798-a8981a3116ec tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:53.353504 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-27f92f19-14f1-483d-a798-a8981a3116ec tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:56.501093 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-27f92f19-14f1-483d-a798-a8981a3116ec tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 14 microversion: 2.20 time: 3.161128 Jan 11 15:11:56.501847 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 107/200] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:11:53 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 14 bytes in 3163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:11:56.507112 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [req-65c7e36c-a5fe-4698-8e37-e3b200eb5d63 req-831684f5-38f6-4239-8e87-9bea1428b8db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdd2d856-37d5-436b-b0c4-9874da364cda", "tag": "cdf915de-7c8e-41e0-bca7-ba954f5c9fed"}]} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:11:56.508687 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:11:56.508687 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: warnings.warn(msg) Jan 11 15:11:56.518838 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-65c7e36c-a5fe-4698-8e37-e3b200eb5d63 req-831684f5-38f6-4239-8e87-9bea1428b8db service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:56.518838 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-65c7e36c-a5fe-4698-8e37-e3b200eb5d63 req-831684f5-38f6-4239-8e87-9bea1428b8db service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:56.528436 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.compute.server_external_events [req-65c7e36c-a5fe-4698-8e37-e3b200eb5d63 req-831684f5-38f6-4239-8e87-9bea1428b8db service nova] Creating event network-changed:cdf915de-7c8e-41e0-bca7-ba954f5c9fed for instance bdd2d856-37d5-436b-b0c4-9874da364cda on hv-cinder-82418 Jan 11 15:11:56.533400 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [req-65c7e36c-a5fe-4698-8e37-e3b200eb5d63 req-831684f5-38f6-4239-8e87-9bea1428b8db service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029981 Jan 11 15:11:56.533988 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 108/201] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:11:56.539146 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d876016f-103f-4750-a31d-9f5de284f207 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:56.539867 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d876016f-103f-4750-a31d-9f5de284f207 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:56.545778 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d876016f-103f-4750-a31d-9f5de284f207 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:56.546237 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d876016f-103f-4750-a31d-9f5de284f207 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:56.547014 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d876016f-103f-4750-a31d-9f5de284f207 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:56.547486 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d876016f-103f-4750-a31d-9f5de284f207 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:56.749418 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-d876016f-103f-4750-a31d-9f5de284f207 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:56.760286 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d876016f-103f-4750-a31d-9f5de284f207 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1321 microversion: 2.1 time: 0.224635 Jan 11 15:11:56.781194 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 109/202] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:56 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:56.784946 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a5d387ea-b49c-4852-b957-760906f352fd tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:56.785403 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a5d387ea-b49c-4852-b957-760906f352fd tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:56.793483 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a5d387ea-b49c-4852-b957-760906f352fd tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:56.794114 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a5d387ea-b49c-4852-b957-760906f352fd tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:56.795701 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a5d387ea-b49c-4852-b957-760906f352fd tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:56.796132 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a5d387ea-b49c-4852-b957-760906f352fd tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:57.026741 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-a5d387ea-b49c-4852-b957-760906f352fd tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:57.044589 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a5d387ea-b49c-4852-b957-760906f352fd tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 200 len: 1363 microversion: 2.1 time: 0.265558 Jan 11 15:11:57.045173 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 110/203] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:56 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 1363 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:57.060879 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e698ab27-ded7-4cd4-82ae-d7fb1dcd5cac tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cfc75782-440a-4b85-b353-d0a9852bb99c"}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:11:57.064745 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e698ab27-ded7-4cd4-82ae-d7fb1dcd5cac tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:57.078864 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e698ab27-ded7-4cd4-82ae-d7fb1dcd5cac tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:57.078864 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e698ab27-ded7-4cd4-82ae-d7fb1dcd5cac tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:57.078864 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e698ab27-ded7-4cd4-82ae-d7fb1dcd5cac tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:57.079127 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e698ab27-ded7-4cd4-82ae-d7fb1dcd5cac tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:57.396091 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-193da514-2ba2-4dd8-9da2-0cd91044bc15 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "POST /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.973568 Jan 11 15:11:57.396912 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 94/204] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jan 11 15:11:51 2022] POST /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be/os-volume_attachments => generated 194 bytes in 5975 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:11:57.512609 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5dcef477-5402-4472-8135-1a9ee6c5ee7c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:11:57.513739 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5dcef477-5402-4472-8135-1a9ee6c5ee7c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:57.519999 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5dcef477-5402-4472-8135-1a9ee6c5ee7c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:57.520888 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5dcef477-5402-4472-8135-1a9ee6c5ee7c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:57.522535 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5dcef477-5402-4472-8135-1a9ee6c5ee7c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:57.526775 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5dcef477-5402-4472-8135-1a9ee6c5ee7c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:57.893954 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5dcef477-5402-4472-8135-1a9ee6c5ee7c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 14 microversion: 2.20 time: 0.385211 Jan 11 15:11:57.895278 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 95/205] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:11:57 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 14 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:11:57.907047 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-fcd06207-363b-47a5-9b8a-a2b67b74761e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:57.907844 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-fcd06207-363b-47a5-9b8a-a2b67b74761e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:57.915690 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fcd06207-363b-47a5-9b8a-a2b67b74761e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:57.921189 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fcd06207-363b-47a5-9b8a-a2b67b74761e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:57.921189 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fcd06207-363b-47a5-9b8a-a2b67b74761e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:57.921189 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fcd06207-363b-47a5-9b8a-a2b67b74761e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:58.069321 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-fcd06207-363b-47a5-9b8a-a2b67b74761e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:58.076398 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e698ab27-ded7-4cd4-82ae-d7fb1dcd5cac tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "POST /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.029979 Jan 11 15:11:58.076898 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-fcd06207-363b-47a5-9b8a-a2b67b74761e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1321 microversion: 2.1 time: 0.180242 Jan 11 15:11:58.077133 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 111/206] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jan 11 15:11:57 2022] POST /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3/os-volume_attachments => generated 194 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:11:58.077689 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 96/207] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:57 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:58.082341 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-89b17faa-452e-4976-a7f9-ed4498e3ad64 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:58.083265 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-89b17faa-452e-4976-a7f9-ed4498e3ad64 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:58.090244 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-89b17faa-452e-4976-a7f9-ed4498e3ad64 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:58.090783 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-89b17faa-452e-4976-a7f9-ed4498e3ad64 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:58.091944 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-89b17faa-452e-4976-a7f9-ed4498e3ad64 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:58.092475 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-89b17faa-452e-4976-a7f9-ed4498e3ad64 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:58.230075 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-89b17faa-452e-4976-a7f9-ed4498e3ad64 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:58.239154 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-89b17faa-452e-4976-a7f9-ed4498e3ad64 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 200 len: 1363 microversion: 2.1 time: 0.159845 Jan 11 15:11:58.242674 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 112/208] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:58 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:58.905581 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d359153a-6c0b-4363-a8e8-3dfcc9262de1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:11:58.906548 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d359153a-6c0b-4363-a8e8-3dfcc9262de1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:58.913399 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d359153a-6c0b-4363-a8e8-3dfcc9262de1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:58.913849 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d359153a-6c0b-4363-a8e8-3dfcc9262de1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:58.914626 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d359153a-6c0b-4363-a8e8-3dfcc9262de1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:58.915068 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d359153a-6c0b-4363-a8e8-3dfcc9262de1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:58.988569 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d359153a-6c0b-4363-a8e8-3dfcc9262de1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 14 microversion: 2.20 time: 0.086476 Jan 11 15:11:58.989232 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 97/209] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:11:58 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:11:59.098236 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-9f73ca5a-482e-4232-a4e7-7a23250a2cec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:59.098236 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-9f73ca5a-482e-4232-a4e7-7a23250a2cec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:59.101662 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9f73ca5a-482e-4232-a4e7-7a23250a2cec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:59.102253 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9f73ca5a-482e-4232-a4e7-7a23250a2cec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:59.102964 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9f73ca5a-482e-4232-a4e7-7a23250a2cec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:59.103456 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9f73ca5a-482e-4232-a4e7-7a23250a2cec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:59.233125 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-9f73ca5a-482e-4232-a4e7-7a23250a2cec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:59.240532 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-9f73ca5a-482e-4232-a4e7-7a23250a2cec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1515 microversion: 2.1 time: 0.150352 Jan 11 15:11:59.241107 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 113/210] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:59 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:59.257223 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-85c392a1-4650-4508-9f76-01bc757be964 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:11:59.257449 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7478a49c-e404-4145-8637-63bd36580b7f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:59.257913 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-7478a49c-e404-4145-8637-63bd36580b7f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:59.258251 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-85c392a1-4650-4508-9f76-01bc757be964 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:59.264674 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-85c392a1-4650-4508-9f76-01bc757be964 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:59.265130 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-85c392a1-4650-4508-9f76-01bc757be964 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:59.265948 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-85c392a1-4650-4508-9f76-01bc757be964 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:59.266404 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-85c392a1-4650-4508-9f76-01bc757be964 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:59.268867 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7478a49c-e404-4145-8637-63bd36580b7f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:59.271361 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7478a49c-e404-4145-8637-63bd36580b7f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:59.271361 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7478a49c-e404-4145-8637-63bd36580b7f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:59.271361 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7478a49c-e404-4145-8637-63bd36580b7f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:59.292346 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.objects.instance [None req-85c392a1-4650-4508-9f76-01bc757be964 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lazy-loading 'flavor' on Instance uuid 2127507f-81ad-406d-a9fa-9e4c615184ba {{(pid=116903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 15:11:59.405455 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-7478a49c-e404-4145-8637-63bd36580b7f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:59.412804 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7478a49c-e404-4145-8637-63bd36580b7f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 200 len: 1549 microversion: 2.1 time: 0.159566 Jan 11 15:11:59.413371 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 98/211] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:59 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:11:59.428950 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-81522e7a-0fc7-4e2d-abc8-c17780e75cb7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:59.429498 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-81522e7a-0fc7-4e2d-abc8-c17780e75cb7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:59.435327 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-81522e7a-0fc7-4e2d-abc8-c17780e75cb7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:59.435787 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-81522e7a-0fc7-4e2d-abc8-c17780e75cb7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:59.436572 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-81522e7a-0fc7-4e2d-abc8-c17780e75cb7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:59.437013 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-81522e7a-0fc7-4e2d-abc8-c17780e75cb7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:59.517697 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-81522e7a-0fc7-4e2d-abc8-c17780e75cb7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092132 Jan 11 15:11:59.518294 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 99/212] 10.222.0.52 () {58 vars in 1274 bytes} [Tue Jan 11 15:11:59 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:11:59.619848 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-85c392a1-4650-4508-9f76-01bc757be964 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "POST /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba/action" status: 200 len: 32 microversion: 2.1 time: 0.366055 Jan 11 15:11:59.620752 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 114/213] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:11:59 2022] POST /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba/action => generated 32 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 11 15:11:59.630952 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a99dea18-4c9c-4ef1-adcc-45ce172b486c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:11:59.631641 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a99dea18-4c9c-4ef1-adcc-45ce172b486c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:11:59.637796 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a99dea18-4c9c-4ef1-adcc-45ce172b486c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:59.638466 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a99dea18-4c9c-4ef1-adcc-45ce172b486c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:59.639640 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a99dea18-4c9c-4ef1-adcc-45ce172b486c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:11:59.640276 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a99dea18-4c9c-4ef1-adcc-45ce172b486c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:11:59.858382 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a99dea18-4c9c-4ef1-adcc-45ce172b486c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:11:59.870399 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a99dea18-4c9c-4ef1-adcc-45ce172b486c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.243858 Jan 11 15:11:59.874608 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 100/214] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:11:59 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:00.000991 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3cd8b045-975c-4681-9169-132fc14b8fdd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:00.001968 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3cd8b045-975c-4681-9169-132fc14b8fdd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:00.020432 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3cd8b045-975c-4681-9169-132fc14b8fdd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:00.023275 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3cd8b045-975c-4681-9169-132fc14b8fdd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:00.026134 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3cd8b045-975c-4681-9169-132fc14b8fdd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:00.026904 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3cd8b045-975c-4681-9169-132fc14b8fdd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:00.138250 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3cd8b045-975c-4681-9169-132fc14b8fdd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 14 microversion: 2.20 time: 0.142074 Jan 11 15:12:00.140242 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 115/215] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:11:59 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:00.887147 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8914347d-4f78-4d77-b2d1-ce90bebb4a21 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:00.888082 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8914347d-4f78-4d77-b2d1-ce90bebb4a21 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:00.894159 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8914347d-4f78-4d77-b2d1-ce90bebb4a21 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:00.894616 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8914347d-4f78-4d77-b2d1-ce90bebb4a21 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:00.895431 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8914347d-4f78-4d77-b2d1-ce90bebb4a21 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:00.895876 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8914347d-4f78-4d77-b2d1-ce90bebb4a21 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:01.045125 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-8914347d-4f78-4d77-b2d1-ce90bebb4a21 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:01.047071 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b49f2fff-bb26-4ec4-b606-55abdb696c2a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:01.048429 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b49f2fff-bb26-4ec4-b606-55abdb696c2a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:01.054826 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8914347d-4f78-4d77-b2d1-ce90bebb4a21 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.171399 Jan 11 15:12:01.058387 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b49f2fff-bb26-4ec4-b606-55abdb696c2a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:01.059110 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b49f2fff-bb26-4ec4-b606-55abdb696c2a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:01.060306 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b49f2fff-bb26-4ec4-b606-55abdb696c2a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:01.061847 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b49f2fff-bb26-4ec4-b606-55abdb696c2a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:01.064992 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 101/216] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:00 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:01.069985 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-00d7eb75-e619-4217-851c-c31c5d3f9ecd req-89691133-85b6-494f-8246-44d8e3b8e018 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "556650b4-5ee6-4ed5-ad51-cb3c36cca0b4", "tag": "3c3557a2-ffc2-4330-a17d-f0701fba5be9"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:01.071805 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:12:01.071805 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:12:01.079483 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-00d7eb75-e619-4217-851c-c31c5d3f9ecd req-89691133-85b6-494f-8246-44d8e3b8e018 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:01.080243 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-00d7eb75-e619-4217-851c-c31c5d3f9ecd req-89691133-85b6-494f-8246-44d8e3b8e018 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:01.097769 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-00d7eb75-e619-4217-851c-c31c5d3f9ecd req-89691133-85b6-494f-8246-44d8e3b8e018 service nova] Creating event network-changed:3c3557a2-ffc2-4330-a17d-f0701fba5be9 for instance 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 on hv-cinder-82418 Jan 11 15:12:01.107432 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [req-00d7eb75-e619-4217-851c-c31c5d3f9ecd req-89691133-85b6-494f-8246-44d8e3b8e018 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040959 Jan 11 15:12:01.108542 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 102/217] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:12:01.147982 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b49f2fff-bb26-4ec4-b606-55abdb696c2a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 14 microversion: 2.1 time: 0.105042 Jan 11 15:12:01.149010 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 116/218] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:01 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 15:12:01.153719 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d3d9297a-60b0-43e3-82f4-6b9fd5dab498 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:01.154741 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d3d9297a-60b0-43e3-82f4-6b9fd5dab498 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:01.161004 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d3d9297a-60b0-43e3-82f4-6b9fd5dab498 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:01.161459 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d3d9297a-60b0-43e3-82f4-6b9fd5dab498 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:01.163161 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d3d9297a-60b0-43e3-82f4-6b9fd5dab498 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:01.163658 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d3d9297a-60b0-43e3-82f4-6b9fd5dab498 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:01.249431 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d3d9297a-60b0-43e3-82f4-6b9fd5dab498 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 14 microversion: 2.20 time: 0.102657 Jan 11 15:12:01.250651 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 103/219] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:01 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:12:02.076878 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b3074cfb-29e4-4168-ba7e-0640ab63579c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:02.079278 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b3074cfb-29e4-4168-ba7e-0640ab63579c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:02.088925 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b3074cfb-29e4-4168-ba7e-0640ab63579c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:02.093023 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b3074cfb-29e4-4168-ba7e-0640ab63579c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:02.093023 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b3074cfb-29e4-4168-ba7e-0640ab63579c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:02.093023 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b3074cfb-29e4-4168-ba7e-0640ab63579c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:02.169578 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-77d028b8-6c4f-4b8a-8db1-2a265007fcd5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:02.181885 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-77d028b8-6c4f-4b8a-8db1-2a265007fcd5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:02.231082 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-77d028b8-6c4f-4b8a-8db1-2a265007fcd5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:02.231082 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-77d028b8-6c4f-4b8a-8db1-2a265007fcd5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:02.237872 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-77d028b8-6c4f-4b8a-8db1-2a265007fcd5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:02.238342 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-77d028b8-6c4f-4b8a-8db1-2a265007fcd5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:02.410494 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-77d028b8-6c4f-4b8a-8db1-2a265007fcd5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 14 microversion: 2.1 time: 0.254593 Jan 11 15:12:02.414525 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 104/220] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:02 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 14 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 11 15:12:02.420280 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6cce1315-b325-4011-9d02-7ec2d58b8bc4 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:02.421305 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6cce1315-b325-4011-9d02-7ec2d58b8bc4 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:02.433115 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6cce1315-b325-4011-9d02-7ec2d58b8bc4 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:02.433572 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6cce1315-b325-4011-9d02-7ec2d58b8bc4 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:02.434364 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6cce1315-b325-4011-9d02-7ec2d58b8bc4 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:02.441424 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6cce1315-b325-4011-9d02-7ec2d58b8bc4 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:02.555561 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6cce1315-b325-4011-9d02-7ec2d58b8bc4 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 14 microversion: 2.20 time: 0.139462 Jan 11 15:12:02.559711 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 105/221] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:02 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:02.573845 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-b3074cfb-29e4-4168-ba7e-0640ab63579c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:02.589208 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b3074cfb-29e4-4168-ba7e-0640ab63579c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.520125 Jan 11 15:12:02.590047 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 117/222] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:02 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:03.422151 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f92c3bda-d0d2-4d8b-a3a2-276030f5a74c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:03.423189 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f92c3bda-d0d2-4d8b-a3a2-276030f5a74c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:03.430678 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f92c3bda-d0d2-4d8b-a3a2-276030f5a74c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:03.431130 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f92c3bda-d0d2-4d8b-a3a2-276030f5a74c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:03.431939 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f92c3bda-d0d2-4d8b-a3a2-276030f5a74c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:03.432374 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f92c3bda-d0d2-4d8b-a3a2-276030f5a74c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:03.517648 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f92c3bda-d0d2-4d8b-a3a2-276030f5a74c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 14 microversion: 2.1 time: 0.099279 Jan 11 15:12:03.518277 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 106/223] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:03 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 15:12:03.570576 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d65a3e38-0c34-41da-90b7-14ed1b19ec1c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:03.571536 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d65a3e38-0c34-41da-90b7-14ed1b19ec1c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:03.577740 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d65a3e38-0c34-41da-90b7-14ed1b19ec1c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:03.578334 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d65a3e38-0c34-41da-90b7-14ed1b19ec1c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:03.578949 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d65a3e38-0c34-41da-90b7-14ed1b19ec1c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:03.579425 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d65a3e38-0c34-41da-90b7-14ed1b19ec1c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:03.612819 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e2ae3646-19e8-46ac-8875-c4a6d4f52e17 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:03.614081 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e2ae3646-19e8-46ac-8875-c4a6d4f52e17 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:03.621672 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e2ae3646-19e8-46ac-8875-c4a6d4f52e17 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:03.622272 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e2ae3646-19e8-46ac-8875-c4a6d4f52e17 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:03.623281 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e2ae3646-19e8-46ac-8875-c4a6d4f52e17 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:03.623856 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e2ae3646-19e8-46ac-8875-c4a6d4f52e17 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:03.673799 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d65a3e38-0c34-41da-90b7-14ed1b19ec1c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 14 microversion: 2.20 time: 0.107410 Jan 11 15:12:03.674435 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 118/224] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:03 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:03.801567 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e2ae3646-19e8-46ac-8875-c4a6d4f52e17 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:03.809710 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e2ae3646-19e8-46ac-8875-c4a6d4f52e17 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.206443 Jan 11 15:12:03.810286 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 107/225] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:03 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:04.530631 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-776cca83-77c9-4c64-86b9-5cf0109ccd28 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:04.532250 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-776cca83-77c9-4c64-86b9-5cf0109ccd28 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:04.540512 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-776cca83-77c9-4c64-86b9-5cf0109ccd28 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:04.541027 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-776cca83-77c9-4c64-86b9-5cf0109ccd28 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:04.542159 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-776cca83-77c9-4c64-86b9-5cf0109ccd28 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:04.542657 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-776cca83-77c9-4c64-86b9-5cf0109ccd28 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:04.623544 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-776cca83-77c9-4c64-86b9-5cf0109ccd28 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 14 microversion: 2.1 time: 0.098311 Jan 11 15:12:04.624307 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 119/226] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:04 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 11 15:12:04.684039 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f6cc77e3-595e-41cb-9cb6-027c736f2b09 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:04.684974 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f6cc77e3-595e-41cb-9cb6-027c736f2b09 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:04.694371 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f6cc77e3-595e-41cb-9cb6-027c736f2b09 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:04.705781 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f6cc77e3-595e-41cb-9cb6-027c736f2b09 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:04.705781 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f6cc77e3-595e-41cb-9cb6-027c736f2b09 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:04.705781 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f6cc77e3-595e-41cb-9cb6-027c736f2b09 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:04.782822 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f6cc77e3-595e-41cb-9cb6-027c736f2b09 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 14 microversion: 2.20 time: 0.102512 Jan 11 15:12:04.786162 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 108/227] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:04 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:04.827956 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-cdb8a111-2272-4cf4-b269-5bb04127ee27 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:04.828653 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-cdb8a111-2272-4cf4-b269-5bb04127ee27 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:04.836165 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cdb8a111-2272-4cf4-b269-5bb04127ee27 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:04.836615 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cdb8a111-2272-4cf4-b269-5bb04127ee27 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:04.837391 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cdb8a111-2272-4cf4-b269-5bb04127ee27 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:04.837830 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cdb8a111-2272-4cf4-b269-5bb04127ee27 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:04.974251 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-cdb8a111-2272-4cf4-b269-5bb04127ee27 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:04.981979 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-cdb8a111-2272-4cf4-b269-5bb04127ee27 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.157974 Jan 11 15:12:04.992679 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 120/228] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:04 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:05.634805 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-223978f8-f2bd-4ddf-9a51-017b69fa5049 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:05.635831 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-223978f8-f2bd-4ddf-9a51-017b69fa5049 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:05.642479 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-223978f8-f2bd-4ddf-9a51-017b69fa5049 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:05.642926 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-223978f8-f2bd-4ddf-9a51-017b69fa5049 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:05.643725 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-223978f8-f2bd-4ddf-9a51-017b69fa5049 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:05.644157 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-223978f8-f2bd-4ddf-9a51-017b69fa5049 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:05.794131 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a5a2d8f6-33a0-4ba7-99b6-26a05620e641 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:05.795305 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a5a2d8f6-33a0-4ba7-99b6-26a05620e641 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:05.801554 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a5a2d8f6-33a0-4ba7-99b6-26a05620e641 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:05.802053 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a5a2d8f6-33a0-4ba7-99b6-26a05620e641 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:05.802783 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a5a2d8f6-33a0-4ba7-99b6-26a05620e641 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:05.803215 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a5a2d8f6-33a0-4ba7-99b6-26a05620e641 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:05.968602 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a5a2d8f6-33a0-4ba7-99b6-26a05620e641 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 14 microversion: 2.20 time: 0.177933 Jan 11 15:12:05.971692 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 121/229] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:05 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 14 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:12:05.978090 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-223978f8-f2bd-4ddf-9a51-017b69fa5049 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 14 microversion: 2.1 time: 0.347145 Jan 11 15:12:05.979005 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 109/230] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:05 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 14 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 15:12:06.000406 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-8f7449b9-f4cf-4437-98c2-000904aef309 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:06.001097 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-8f7449b9-f4cf-4437-98c2-000904aef309 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:06.007266 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8f7449b9-f4cf-4437-98c2-000904aef309 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:06.007736 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8f7449b9-f4cf-4437-98c2-000904aef309 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:06.008518 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8f7449b9-f4cf-4437-98c2-000904aef309 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:06.008984 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8f7449b9-f4cf-4437-98c2-000904aef309 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:06.194064 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-8f7449b9-f4cf-4437-98c2-000904aef309 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:06.202225 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-8f7449b9-f4cf-4437-98c2-000904aef309 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.206249 Jan 11 15:12:06.202796 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 122/231] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:05 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:06.980589 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a0c75380-5212-42b1-9769-04673ce53b1f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:06.981625 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a0c75380-5212-42b1-9769-04673ce53b1f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:06.987566 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a98db9e8-afc1-4ddf-a088-73a1533034a7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:06.988475 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a98db9e8-afc1-4ddf-a088-73a1533034a7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:06.988600 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a0c75380-5212-42b1-9769-04673ce53b1f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:06.988959 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a0c75380-5212-42b1-9769-04673ce53b1f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:06.989739 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a0c75380-5212-42b1-9769-04673ce53b1f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:06.990218 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a0c75380-5212-42b1-9769-04673ce53b1f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:06.995216 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a98db9e8-afc1-4ddf-a088-73a1533034a7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:06.995710 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a98db9e8-afc1-4ddf-a088-73a1533034a7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:06.996492 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a98db9e8-afc1-4ddf-a088-73a1533034a7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:06.996930 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a98db9e8-afc1-4ddf-a088-73a1533034a7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:10.723762 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a98db9e8-afc1-4ddf-a088-73a1533034a7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 14 microversion: 2.1 time: 3.739624 Jan 11 15:12:10.726280 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 123/232] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:06 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 14 bytes in 3743 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 11 15:12:10.731085 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3e151bf8-d2bb-469c-9c9c-1e1f299333ee tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:10.731808 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3e151bf8-d2bb-469c-9c9c-1e1f299333ee tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:10.738559 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3e151bf8-d2bb-469c-9c9c-1e1f299333ee tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:10.739009 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3e151bf8-d2bb-469c-9c9c-1e1f299333ee tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:10.739827 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3e151bf8-d2bb-469c-9c9c-1e1f299333ee tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:10.740859 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3e151bf8-d2bb-469c-9c9c-1e1f299333ee tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:10.742865 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a0c75380-5212-42b1-9769-04673ce53b1f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 17844 microversion: 2.20 time: 3.766239 Jan 11 15:12:10.744354 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 110/233] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:06 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 17844 bytes in 3768 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:12:10.877844 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-3e151bf8-d2bb-469c-9c9c-1e1f299333ee tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:10.885348 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3e151bf8-d2bb-469c-9c9c-1e1f299333ee tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.157960 Jan 11 15:12:10.885908 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 124/234] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:10 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:11.734978 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0d3266b5-4a58-4571-9086-a0c966d6052d tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:11.736020 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0d3266b5-4a58-4571-9086-a0c966d6052d tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:11.743389 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0d3266b5-4a58-4571-9086-a0c966d6052d tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:11.743960 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0d3266b5-4a58-4571-9086-a0c966d6052d tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:11.744706 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0d3266b5-4a58-4571-9086-a0c966d6052d tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:11.745149 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0d3266b5-4a58-4571-9086-a0c966d6052d tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:11.754131 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-5fce0258-5865-449d-a333-2f13388713fe tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:11.755336 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-5fce0258-5865-449d-a333-2f13388713fe tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:11.761890 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5fce0258-5865-449d-a333-2f13388713fe tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:11.762346 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5fce0258-5865-449d-a333-2f13388713fe tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:11.763148 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5fce0258-5865-449d-a333-2f13388713fe tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:11.763625 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5fce0258-5865-449d-a333-2f13388713fe tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:11.832005 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0d3266b5-4a58-4571-9086-a0c966d6052d tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 14 microversion: 2.1 time: 0.100964 Jan 11 15:12:11.832633 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 111/235] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:11 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 11 15:12:11.864610 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-5fce0258-5865-449d-a333-2f13388713fe tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 17861 microversion: 2.20 time: 0.114154 Jan 11 15:12:11.865228 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 125/236] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:11 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 17861 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:12:11.902662 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0a5415ad-0dc8-40f8-9e92-98dc25cc0a96 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:11.903384 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0a5415ad-0dc8-40f8-9e92-98dc25cc0a96 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:11.910298 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0a5415ad-0dc8-40f8-9e92-98dc25cc0a96 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:11.910748 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0a5415ad-0dc8-40f8-9e92-98dc25cc0a96 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:11.911550 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0a5415ad-0dc8-40f8-9e92-98dc25cc0a96 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:11.912649 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0a5415ad-0dc8-40f8-9e92-98dc25cc0a96 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:12.042745 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0a5415ad-0dc8-40f8-9e92-98dc25cc0a96 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:12.050554 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0a5415ad-0dc8-40f8-9e92-98dc25cc0a96 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.151854 Jan 11 15:12:12.051122 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 112/237] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:11 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:12.857096 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-5f9798e0-87a1-4c24-8f41-e334fd3b7e27 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:12.858656 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-5f9798e0-87a1-4c24-8f41-e334fd3b7e27 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:12.860023 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ce5cdb6c-459f-4051-a248-ded28af86345 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-34931518", "imageRef": "d0ce98ab-06a2-4e75-9f37-288864a22cb9", "flavorRef": "452", "networks": [{"uuid": "76369959-3647-4f73-a129-60ab7e24f3af"}]}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:12.865387 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5f9798e0-87a1-4c24-8f41-e334fd3b7e27 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:12.865835 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5f9798e0-87a1-4c24-8f41-e334fd3b7e27 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:12.867431 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5f9798e0-87a1-4c24-8f41-e334fd3b7e27 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:12.867431 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5f9798e0-87a1-4c24-8f41-e334fd3b7e27 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:12.926668 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.network.neutron [None req-ce5cdb6c-459f-4051-a248-ded28af86345 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] validate_networks() for [('76369959-3647-4f73-a129-60ab7e24f3af', None, None, None, None, None)] {{(pid=116902) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 15:12:12.940366 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-5f9798e0-87a1-4c24-8f41-e334fd3b7e27 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 14 microversion: 2.1 time: 0.100393 Jan 11 15:12:12.941003 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 126/238] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:12 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 15:12:12.946999 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c046d057-99f6-479e-99d6-1588364efb2f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:12.948006 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c046d057-99f6-479e-99d6-1588364efb2f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:12.954415 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c046d057-99f6-479e-99d6-1588364efb2f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:12.954784 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c046d057-99f6-479e-99d6-1588364efb2f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:12.955617 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c046d057-99f6-479e-99d6-1588364efb2f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:12.958437 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c046d057-99f6-479e-99d6-1588364efb2f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:13.053639 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c046d057-99f6-479e-99d6-1588364efb2f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 19342 microversion: 2.20 time: 0.111036 Jan 11 15:12:13.057413 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 127/239] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:12 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 19342 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:12:13.068526 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-46be990b-be4a-42cb-a91b-610a9480a9ca tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:13.073203 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-46be990b-be4a-42cb-a91b-610a9480a9ca tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:13.076608 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-46be990b-be4a-42cb-a91b-610a9480a9ca tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:13.077072 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-46be990b-be4a-42cb-a91b-610a9480a9ca tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:13.077867 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-46be990b-be4a-42cb-a91b-610a9480a9ca tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:13.078313 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-46be990b-be4a-42cb-a91b-610a9480a9ca tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:13.525077 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-46be990b-be4a-42cb-a91b-610a9480a9ca tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:13.532399 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-46be990b-be4a-42cb-a91b-610a9480a9ca tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.468469 Jan 11 15:12:13.533257 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 128/240] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:13 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:12:13.567442 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-ce5cdb6c-459f-4051-a248-ded28af86345 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Flavor limits 0:0:0 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 15:12:13.567982 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-ce5cdb6c-459f-4051-a248-ded28af86345 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Image limits 0:0:0 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 15:12:13.568487 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-ce5cdb6c-459f-4051-a248-ded28af86345 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Flavor pref 0:0:0 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 15:12:13.568894 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-ce5cdb6c-459f-4051-a248-ded28af86345 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Image pref 0:0:0 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 15:12:13.569306 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-ce5cdb6c-459f-4051-a248-ded28af86345 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 15:12:13.578705 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ce5cdb6c-459f-4051-a248-ded28af86345 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:13.581827 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ce5cdb6c-459f-4051-a248-ded28af86345 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:13.581827 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ce5cdb6c-459f-4051-a248-ded28af86345 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:13.581827 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ce5cdb6c-459f-4051-a248-ded28af86345 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:13.597371 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.quota [None req-ce5cdb6c-459f-4051-a248-ded28af86345 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Getting quotas for project 2ed51a96e66d44ca9c02bbe820c68180. Resources: {'instances', 'cores', 'ram'} {{(pid=116902) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 15:12:13.601773 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.quota [None req-ce5cdb6c-459f-4051-a248-ded28af86345 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Getting quotas for user 13f0a933d4d34f8984292406266866a0 and project 2ed51a96e66d44ca9c02bbe820c68180. Resources: {'instances', 'cores', 'ram'} {{(pid=116902) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 15:12:13.612415 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ce5cdb6c-459f-4051-a248-ded28af86345 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Going to run 1 instances... {{(pid=116902) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 15:12:13.614709 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ce5cdb6c-459f-4051-a248-ded28af86345 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 32a717c2-da7f-4685-813a-20f4149ce104] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0ce98ab-06a2-4e75-9f37-288864a22cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 15:12:13.767377 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ce5cdb6c-459f-4051-a248-ded28af86345 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.910859 Jan 11 15:12:13.768039 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 113/241] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jan 11 15:12:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 11 15:12:13.777790 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4628a176-773d-4cba-b47a-cdf5b21fb918 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:13.778403 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4628a176-773d-4cba-b47a-cdf5b21fb918 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 32a717c2-da7f-4685-813a-20f4149ce104] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:13.836415 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-4628a176-773d-4cba-b47a-cdf5b21fb918 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:13.852616 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4628a176-773d-4cba-b47a-cdf5b21fb918 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104" status: 200 len: 1216 microversion: 2.1 time: 0.078432 Jan 11 15:12:13.853187 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 129/242] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:13 2022] GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104 => generated 1216 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:13.951715 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-eea1701f-ef1b-4c94-8668-21d3543698f9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:13.952721 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-eea1701f-ef1b-4c94-8668-21d3543698f9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:13.959569 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-eea1701f-ef1b-4c94-8668-21d3543698f9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:13.960037 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-eea1701f-ef1b-4c94-8668-21d3543698f9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:13.960849 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-eea1701f-ef1b-4c94-8668-21d3543698f9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:13.961283 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-eea1701f-ef1b-4c94-8668-21d3543698f9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:14.043634 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-eea1701f-ef1b-4c94-8668-21d3543698f9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 14 microversion: 2.1 time: 0.095407 Jan 11 15:12:14.044278 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 114/243] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:13 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 15:12:14.064769 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-011c4f4a-458a-426f-b318-5ace135a3021 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:14.065695 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-011c4f4a-458a-426f-b318-5ace135a3021 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:14.071698 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-011c4f4a-458a-426f-b318-5ace135a3021 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:14.072155 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-011c4f4a-458a-426f-b318-5ace135a3021 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:14.072940 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-011c4f4a-458a-426f-b318-5ace135a3021 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:14.073386 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-011c4f4a-458a-426f-b318-5ace135a3021 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:14.163343 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-011c4f4a-458a-426f-b318-5ace135a3021 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 20984 microversion: 2.20 time: 0.102035 Jan 11 15:12:14.163918 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 130/244] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:14 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 20984 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:12:14.550625 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d41221b9-34a8-483d-aaf7-f31cbb88477e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:14.551439 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d41221b9-34a8-483d-aaf7-f31cbb88477e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:14.559056 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d41221b9-34a8-483d-aaf7-f31cbb88477e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:14.559538 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d41221b9-34a8-483d-aaf7-f31cbb88477e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:14.562629 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d41221b9-34a8-483d-aaf7-f31cbb88477e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:14.562629 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d41221b9-34a8-483d-aaf7-f31cbb88477e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:14.706017 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d41221b9-34a8-483d-aaf7-f31cbb88477e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:14.713917 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d41221b9-34a8-483d-aaf7-f31cbb88477e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.167547 Jan 11 15:12:14.714486 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 115/245] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:14 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:14.869888 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-8294c149-e61c-48c2-8ecb-41a7eecacf3e tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:14.870587 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-8294c149-e61c-48c2-8ecb-41a7eecacf3e tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 32a717c2-da7f-4685-813a-20f4149ce104] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:14.877183 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8294c149-e61c-48c2-8ecb-41a7eecacf3e tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:14.877634 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8294c149-e61c-48c2-8ecb-41a7eecacf3e tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:14.878444 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8294c149-e61c-48c2-8ecb-41a7eecacf3e tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:14.878887 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8294c149-e61c-48c2-8ecb-41a7eecacf3e tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:14.944405 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-8294c149-e61c-48c2-8ecb-41a7eecacf3e tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:14.952133 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-8294c149-e61c-48c2-8ecb-41a7eecacf3e tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104" status: 200 len: 1220 microversion: 2.1 time: 0.086691 Jan 11 15:12:14.952852 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 131/246] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:14 2022] GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:15.054079 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-93ac7d0d-4356-45f7-9b39-e471d6897f5f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:15.055038 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-93ac7d0d-4356-45f7-9b39-e471d6897f5f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:15.061646 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-93ac7d0d-4356-45f7-9b39-e471d6897f5f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:15.062091 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-93ac7d0d-4356-45f7-9b39-e471d6897f5f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:15.062969 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-93ac7d0d-4356-45f7-9b39-e471d6897f5f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:15.063431 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-93ac7d0d-4356-45f7-9b39-e471d6897f5f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:15.154282 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-93ac7d0d-4356-45f7-9b39-e471d6897f5f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 14 microversion: 2.1 time: 0.103755 Jan 11 15:12:15.154953 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 116/247] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:15 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 15:12:15.175090 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a66d78a9-b03b-4011-9d50-28fd544741e1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:15.176046 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a66d78a9-b03b-4011-9d50-28fd544741e1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:15.182323 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a66d78a9-b03b-4011-9d50-28fd544741e1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:15.182764 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a66d78a9-b03b-4011-9d50-28fd544741e1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:15.185484 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a66d78a9-b03b-4011-9d50-28fd544741e1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:15.185484 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a66d78a9-b03b-4011-9d50-28fd544741e1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:15.284243 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a66d78a9-b03b-4011-9d50-28fd544741e1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 22155 microversion: 2.20 time: 0.112794 Jan 11 15:12:15.284887 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 132/248] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:15 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 22155 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:12:15.730672 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4f959b8c-346a-4283-a434-ea4c432d9b46 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:15.731417 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-4f959b8c-346a-4283-a434-ea4c432d9b46 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:15.740865 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4f959b8c-346a-4283-a434-ea4c432d9b46 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:15.741469 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4f959b8c-346a-4283-a434-ea4c432d9b46 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:15.742427 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4f959b8c-346a-4283-a434-ea4c432d9b46 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:15.742946 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4f959b8c-346a-4283-a434-ea4c432d9b46 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:15.893366 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-4f959b8c-346a-4283-a434-ea4c432d9b46 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:15.901085 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4f959b8c-346a-4283-a434-ea4c432d9b46 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.174809 Jan 11 15:12:15.901857 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 117/249] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:15 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:12:15.970278 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-61ac520f-a8fd-4543-96a2-a46231978347 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:15.970894 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-61ac520f-a8fd-4543-96a2-a46231978347 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 32a717c2-da7f-4685-813a-20f4149ce104] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:15.978597 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-61ac520f-a8fd-4543-96a2-a46231978347 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:15.979041 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-61ac520f-a8fd-4543-96a2-a46231978347 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:15.979895 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-61ac520f-a8fd-4543-96a2-a46231978347 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:15.981082 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-61ac520f-a8fd-4543-96a2-a46231978347 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:16.046579 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-61ac520f-a8fd-4543-96a2-a46231978347 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:16.055962 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-61ac520f-a8fd-4543-96a2-a46231978347 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104" status: 200 len: 1276 microversion: 2.1 time: 0.089768 Jan 11 15:12:16.056796 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 133/250] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:15 2022] GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104 => generated 1276 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:16.165754 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-75606e3f-d5cf-47b5-80b8-e812332c17cf tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:16.166744 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-75606e3f-d5cf-47b5-80b8-e812332c17cf tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:16.173451 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-75606e3f-d5cf-47b5-80b8-e812332c17cf tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:16.173906 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-75606e3f-d5cf-47b5-80b8-e812332c17cf tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:16.174697 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-75606e3f-d5cf-47b5-80b8-e812332c17cf tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:16.175133 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-75606e3f-d5cf-47b5-80b8-e812332c17cf tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:16.250986 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-75606e3f-d5cf-47b5-80b8-e812332c17cf tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 14 microversion: 2.1 time: 0.088603 Jan 11 15:12:16.254464 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 118/251] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:16 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 15:12:16.299535 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c5eab90e-6a91-4929-be1e-6772c2f9ac85 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:16.300571 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c5eab90e-6a91-4929-be1e-6772c2f9ac85 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:16.308048 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c5eab90e-6a91-4929-be1e-6772c2f9ac85 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:16.308569 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c5eab90e-6a91-4929-be1e-6772c2f9ac85 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:16.309436 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c5eab90e-6a91-4929-be1e-6772c2f9ac85 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:16.309895 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c5eab90e-6a91-4929-be1e-6772c2f9ac85 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:16.411862 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c5eab90e-6a91-4929-be1e-6772c2f9ac85 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 23028 microversion: 2.20 time: 0.119369 Jan 11 15:12:16.416268 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 134/252] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:16 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 23028 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:12:16.919001 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a272cf71-cc99-41c6-b785-dd1d342abdb1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:16.919763 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a272cf71-cc99-41c6-b785-dd1d342abdb1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:16.926629 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a272cf71-cc99-41c6-b785-dd1d342abdb1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:16.927493 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a272cf71-cc99-41c6-b785-dd1d342abdb1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:16.931106 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a272cf71-cc99-41c6-b785-dd1d342abdb1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:16.931591 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a272cf71-cc99-41c6-b785-dd1d342abdb1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:17.077647 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-82620eee-54e7-473c-bc29-78ac8075b361 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:17.078523 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-82620eee-54e7-473c-bc29-78ac8075b361 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 32a717c2-da7f-4685-813a-20f4149ce104] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:17.085825 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-82620eee-54e7-473c-bc29-78ac8075b361 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:17.086498 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-82620eee-54e7-473c-bc29-78ac8075b361 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:17.087576 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-82620eee-54e7-473c-bc29-78ac8075b361 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:17.088162 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-82620eee-54e7-473c-bc29-78ac8075b361 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:17.105864 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a272cf71-cc99-41c6-b785-dd1d342abdb1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:17.127018 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a272cf71-cc99-41c6-b785-dd1d342abdb1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.211937 Jan 11 15:12:17.127825 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 119/253] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:16 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:17.265106 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2934b84e-72ca-48c1-a577-1004b38aa249 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:17.266155 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2934b84e-72ca-48c1-a577-1004b38aa249 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:17.274353 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2934b84e-72ca-48c1-a577-1004b38aa249 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:17.275072 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2934b84e-72ca-48c1-a577-1004b38aa249 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:17.276118 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2934b84e-72ca-48c1-a577-1004b38aa249 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:17.276554 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2934b84e-72ca-48c1-a577-1004b38aa249 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:17.323146 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-82620eee-54e7-473c-bc29-78ac8075b361 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:17.331730 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-82620eee-54e7-473c-bc29-78ac8075b361 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104" status: 200 len: 1316 microversion: 2.1 time: 0.257957 Jan 11 15:12:17.332340 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 135/254] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:17 2022] GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104 => generated 1316 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:12:17.424923 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-cfc1b472-1945-473d-b0b5-7fb61a2672f6 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:17.425909 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-cfc1b472-1945-473d-b0b5-7fb61a2672f6 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:17.432713 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cfc1b472-1945-473d-b0b5-7fb61a2672f6 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:17.433157 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cfc1b472-1945-473d-b0b5-7fb61a2672f6 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:17.433959 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cfc1b472-1945-473d-b0b5-7fb61a2672f6 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:17.435760 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cfc1b472-1945-473d-b0b5-7fb61a2672f6 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:17.445036 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2934b84e-72ca-48c1-a577-1004b38aa249 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 14 microversion: 2.1 time: 0.184356 Jan 11 15:12:17.445836 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 120/255] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:17 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 14 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 15:12:17.524620 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-cfc1b472-1945-473d-b0b5-7fb61a2672f6 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 23785 microversion: 2.20 time: 0.104035 Jan 11 15:12:17.528608 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 136/256] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:17 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 23785 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:12:17.730138 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-7d8598f9-722d-4f55-a2c2-b7ebfb9975d7 req-10d4a13c-ac5a-4479-b5b0-ea51f16cb0e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32a717c2-da7f-4685-813a-20f4149ce104", "tag": "94ba84f2-19a7-465d-a25a-5495304a6ac2"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:17.735530 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:12:17.735530 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:12:17.747912 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-7d8598f9-722d-4f55-a2c2-b7ebfb9975d7 req-10d4a13c-ac5a-4479-b5b0-ea51f16cb0e2 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:17.748361 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-7d8598f9-722d-4f55-a2c2-b7ebfb9975d7 req-10d4a13c-ac5a-4479-b5b0-ea51f16cb0e2 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:17.761751 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-7d8598f9-722d-4f55-a2c2-b7ebfb9975d7 req-10d4a13c-ac5a-4479-b5b0-ea51f16cb0e2 service nova] Creating event network-changed:94ba84f2-19a7-465d-a25a-5495304a6ac2 for instance 32a717c2-da7f-4685-813a-20f4149ce104 on hv-cinder-82418 Jan 11 15:12:17.766487 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [req-7d8598f9-722d-4f55-a2c2-b7ebfb9975d7 req-10d4a13c-ac5a-4479-b5b0-ea51f16cb0e2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046798 Jan 11 15:12:17.767066 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 121/257] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:12:18.144834 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-0005af57-71f8-4f38-9ae9-7ee2846de512 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:18.145537 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-0005af57-71f8-4f38-9ae9-7ee2846de512 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:18.152881 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0005af57-71f8-4f38-9ae9-7ee2846de512 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:18.153329 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0005af57-71f8-4f38-9ae9-7ee2846de512 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:18.154112 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0005af57-71f8-4f38-9ae9-7ee2846de512 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:18.154549 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0005af57-71f8-4f38-9ae9-7ee2846de512 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:18.313246 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-0005af57-71f8-4f38-9ae9-7ee2846de512 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:18.323145 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-0005af57-71f8-4f38-9ae9-7ee2846de512 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.182192 Jan 11 15:12:18.323774 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 137/258] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:18 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:18.355560 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-af7e506c-f112-4e23-93fa-81f887cfd201 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:18.357002 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-af7e506c-f112-4e23-93fa-81f887cfd201 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 32a717c2-da7f-4685-813a-20f4149ce104] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:18.368609 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-af7e506c-f112-4e23-93fa-81f887cfd201 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:18.369371 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-af7e506c-f112-4e23-93fa-81f887cfd201 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:18.370563 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-af7e506c-f112-4e23-93fa-81f887cfd201 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:18.371457 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-af7e506c-f112-4e23-93fa-81f887cfd201 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:18.460292 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ac8de0c0-9002-45e5-a3d1-3d2102d5c619 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:18.462181 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-ac8de0c0-9002-45e5-a3d1-3d2102d5c619 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:18.472087 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ac8de0c0-9002-45e5-a3d1-3d2102d5c619 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:18.473148 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ac8de0c0-9002-45e5-a3d1-3d2102d5c619 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:18.476131 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ac8de0c0-9002-45e5-a3d1-3d2102d5c619 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:18.477125 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ac8de0c0-9002-45e5-a3d1-3d2102d5c619 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:18.553866 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-af7e506c-f112-4e23-93fa-81f887cfd201 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:18.563427 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-af7e506c-f112-4e23-93fa-81f887cfd201 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104" status: 200 len: 1316 microversion: 2.1 time: 0.212585 Jan 11 15:12:18.564533 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 122/259] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:18 2022] GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104 => generated 1316 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:18.581228 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-aea7d643-15a3-47ec-b282-6cb96be94481 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:18.582211 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-aea7d643-15a3-47ec-b282-6cb96be94481 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:18.589113 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aea7d643-15a3-47ec-b282-6cb96be94481 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:18.589746 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aea7d643-15a3-47ec-b282-6cb96be94481 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:18.591136 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aea7d643-15a3-47ec-b282-6cb96be94481 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:18.591657 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aea7d643-15a3-47ec-b282-6cb96be94481 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:18.607486 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-ac8de0c0-9002-45e5-a3d1-3d2102d5c619 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 14 microversion: 2.1 time: 0.153444 Jan 11 15:12:18.611361 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 138/260] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:18 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 15:12:18.696163 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-aea7d643-15a3-47ec-b282-6cb96be94481 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 24175 microversion: 2.20 time: 0.129997 Jan 11 15:12:18.696981 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 123/261] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:18 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 24175 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:12:19.341434 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-41a39746-d55a-451e-8ca0-19dc74db9928 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:19.342194 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-41a39746-d55a-451e-8ca0-19dc74db9928 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:19.349460 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-41a39746-d55a-451e-8ca0-19dc74db9928 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:19.350513 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-41a39746-d55a-451e-8ca0-19dc74db9928 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:19.351333 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-41a39746-d55a-451e-8ca0-19dc74db9928 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:19.351802 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-41a39746-d55a-451e-8ca0-19dc74db9928 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:19.483008 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-41a39746-d55a-451e-8ca0-19dc74db9928 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:19.490885 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-41a39746-d55a-451e-8ca0-19dc74db9928 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.154366 Jan 11 15:12:19.491476 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 139/262] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:19 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:19.585273 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6ef2ad34-5e3b-45cd-ad99-56bebd6c5bca tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:19.585837 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6ef2ad34-5e3b-45cd-ad99-56bebd6c5bca tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 32a717c2-da7f-4685-813a-20f4149ce104] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:19.593171 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6ef2ad34-5e3b-45cd-ad99-56bebd6c5bca tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:19.593675 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6ef2ad34-5e3b-45cd-ad99-56bebd6c5bca tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:19.594517 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6ef2ad34-5e3b-45cd-ad99-56bebd6c5bca tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:19.595024 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6ef2ad34-5e3b-45cd-ad99-56bebd6c5bca tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:19.620012 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-5c72cb7a-ef60-4f0a-b121-d87e1a852d4e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:19.620920 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-5c72cb7a-ef60-4f0a-b121-d87e1a852d4e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:19.627250 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5c72cb7a-ef60-4f0a-b121-d87e1a852d4e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:19.627742 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5c72cb7a-ef60-4f0a-b121-d87e1a852d4e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:19.628518 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5c72cb7a-ef60-4f0a-b121-d87e1a852d4e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:19.628952 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5c72cb7a-ef60-4f0a-b121-d87e1a852d4e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:19.734548 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6ef2ad34-5e3b-45cd-ad99-56bebd6c5bca tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:19.743077 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6ef2ad34-5e3b-45cd-ad99-56bebd6c5bca tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104" status: 200 len: 1316 microversion: 2.1 time: 0.162438 Jan 11 15:12:19.743772 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 124/263] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:19 2022] GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:19.750178 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d75d12cf-cee1-4577-a17d-41bffa38f909 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:19.751396 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d75d12cf-cee1-4577-a17d-41bffa38f909 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:19.757471 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d75d12cf-cee1-4577-a17d-41bffa38f909 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:19.757923 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d75d12cf-cee1-4577-a17d-41bffa38f909 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:19.758710 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d75d12cf-cee1-4577-a17d-41bffa38f909 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:19.759163 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d75d12cf-cee1-4577-a17d-41bffa38f909 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:19.825287 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-5c72cb7a-ef60-4f0a-b121-d87e1a852d4e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 6225 microversion: 2.1 time: 0.208990 Jan 11 15:12:19.826048 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 140/264] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:19 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 6225 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:12:19.883353 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d75d12cf-cee1-4577-a17d-41bffa38f909 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 24620 microversion: 2.20 time: 0.138247 Jan 11 15:12:19.883934 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 125/265] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:19 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 24620 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:12:20.508201 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3cceede0-da70-42da-a34a-561981d09a53 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:20.508966 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3cceede0-da70-42da-a34a-561981d09a53 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:20.516642 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3cceede0-da70-42da-a34a-561981d09a53 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:20.517104 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3cceede0-da70-42da-a34a-561981d09a53 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:20.517945 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3cceede0-da70-42da-a34a-561981d09a53 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:20.518431 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3cceede0-da70-42da-a34a-561981d09a53 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:20.659765 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-3cceede0-da70-42da-a34a-561981d09a53 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:20.667226 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3cceede0-da70-42da-a34a-561981d09a53 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.163700 Jan 11 15:12:20.667822 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 141/266] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:20 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:20.760462 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3c1cfad0-041b-476a-9531-abf5fb0d965b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:20.761160 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3c1cfad0-041b-476a-9531-abf5fb0d965b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 32a717c2-da7f-4685-813a-20f4149ce104] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:20.769074 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c1cfad0-041b-476a-9531-abf5fb0d965b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:20.769529 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c1cfad0-041b-476a-9531-abf5fb0d965b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:20.770461 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c1cfad0-041b-476a-9531-abf5fb0d965b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:20.770909 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c1cfad0-041b-476a-9531-abf5fb0d965b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:20.801340 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-6e8c50cb-2683-494c-b5f3-6f4e62b803f0 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:20.807908 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-6e8c50cb-2683-494c-b5f3-6f4e62b803f0 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:20.808181 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6e8c50cb-2683-494c-b5f3-6f4e62b803f0 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:20.808637 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6e8c50cb-2683-494c-b5f3-6f4e62b803f0 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:20.809428 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6e8c50cb-2683-494c-b5f3-6f4e62b803f0 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:20.809873 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6e8c50cb-2683-494c-b5f3-6f4e62b803f0 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:20.836943 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-6e8c50cb-2683-494c-b5f3-6f4e62b803f0 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Going to try to terminate instance {{(pid=116903) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 15:12:20.910098 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3c1cfad0-041b-476a-9531-abf5fb0d965b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:20.918114 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3c1cfad0-041b-476a-9531-abf5fb0d965b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104" status: 200 len: 1316 microversion: 2.1 time: 0.162255 Jan 11 15:12:20.918878 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 126/267] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:20 2022] GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:20.929950 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a4beaa5a-d659-4515-908f-d8d42465cb53 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:20.930932 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a4beaa5a-d659-4515-908f-d8d42465cb53 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:20.937595 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a4beaa5a-d659-4515-908f-d8d42465cb53 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:20.938049 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a4beaa5a-d659-4515-908f-d8d42465cb53 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:20.938825 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a4beaa5a-d659-4515-908f-d8d42465cb53 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:20.939261 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a4beaa5a-d659-4515-908f-d8d42465cb53 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:21.104295 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a4beaa5a-d659-4515-908f-d8d42465cb53 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 9658 microversion: 2.1 time: 0.184027 Jan 11 15:12:21.104999 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 127/268] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:20 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 9658 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:21.109848 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3a718e20-611a-4c53-b88b-484160fab779 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:21.110830 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3a718e20-611a-4c53-b88b-484160fab779 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:21.118285 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3a718e20-611a-4c53-b88b-484160fab779 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:21.118734 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3a718e20-611a-4c53-b88b-484160fab779 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:21.119534 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3a718e20-611a-4c53-b88b-484160fab779 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:21.119973 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3a718e20-611a-4c53-b88b-484160fab779 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:21.143177 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-6e8c50cb-2683-494c-b5f3-6f4e62b803f0 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "DELETE /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 204 len: 0 microversion: 2.1 time: 0.345099 Jan 11 15:12:21.143867 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 142/269] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jan 11 15:12:20 2022] DELETE /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 11 15:12:21.152351 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-365cbb05-d61a-40ec-81f7-bcede13d054a tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:21.153148 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-365cbb05-d61a-40ec-81f7-bcede13d054a tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:21.159157 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-365cbb05-d61a-40ec-81f7-bcede13d054a tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:21.159655 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-365cbb05-d61a-40ec-81f7-bcede13d054a tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:21.160545 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-365cbb05-d61a-40ec-81f7-bcede13d054a tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:21.161047 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-365cbb05-d61a-40ec-81f7-bcede13d054a tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:21.478011 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-365cbb05-d61a-40ec-81f7-bcede13d054a tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:21.478835 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3a718e20-611a-4c53-b88b-484160fab779 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 25518 microversion: 2.20 time: 0.224509 Jan 11 15:12:21.478835 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 128/270] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:21 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 25518 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:12:21.479364 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-365cbb05-d61a-40ec-81f7-bcede13d054a tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1555 microversion: 2.1 time: 0.184089 Jan 11 15:12:21.479364 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 143/271] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:21 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1555 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:12:21.684303 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f385a226-e2d6-4e29-85aa-bd112826079b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:21.684987 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f385a226-e2d6-4e29-85aa-bd112826079b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:21.691901 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f385a226-e2d6-4e29-85aa-bd112826079b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:21.692358 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f385a226-e2d6-4e29-85aa-bd112826079b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:21.693142 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f385a226-e2d6-4e29-85aa-bd112826079b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:21.693583 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f385a226-e2d6-4e29-85aa-bd112826079b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:21.829553 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f385a226-e2d6-4e29-85aa-bd112826079b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:21.837730 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f385a226-e2d6-4e29-85aa-bd112826079b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.157357 Jan 11 15:12:21.838289 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 129/272] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:21 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:21.934692 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-cda6ca47-10b7-4ed6-bd1b-3fa741f74bdc tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:21.935444 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-cda6ca47-10b7-4ed6-bd1b-3fa741f74bdc tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 32a717c2-da7f-4685-813a-20f4149ce104] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:21.942078 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cda6ca47-10b7-4ed6-bd1b-3fa741f74bdc tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:21.942605 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cda6ca47-10b7-4ed6-bd1b-3fa741f74bdc tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:21.943981 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cda6ca47-10b7-4ed6-bd1b-3fa741f74bdc tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:21.944493 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cda6ca47-10b7-4ed6-bd1b-3fa741f74bdc tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:22.075869 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-cda6ca47-10b7-4ed6-bd1b-3fa741f74bdc tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:22.083172 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-cda6ca47-10b7-4ed6-bd1b-3fa741f74bdc tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104" status: 200 len: 1316 microversion: 2.1 time: 0.152150 Jan 11 15:12:22.083834 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 144/273] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:21 2022] GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104 => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:22.114582 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7b588f33-cad9-4669-b86c-f07c344598ec tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:22.116161 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-7b588f33-cad9-4669-b86c-f07c344598ec tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:22.122312 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7b588f33-cad9-4669-b86c-f07c344598ec tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:22.122761 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7b588f33-cad9-4669-b86c-f07c344598ec tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:22.123559 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7b588f33-cad9-4669-b86c-f07c344598ec tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:22.124000 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7b588f33-cad9-4669-b86c-f07c344598ec tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:22.282068 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7b588f33-cad9-4669-b86c-f07c344598ec tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 14203 microversion: 2.1 time: 0.170914 Jan 11 15:12:22.282714 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 130/274] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:22 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 14203 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:12:22.389974 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-23466f01-2f52-485c-ab74-ca65479ecdd2 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:22.391008 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-23466f01-2f52-485c-ab74-ca65479ecdd2 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:22.395843 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-76f977d2-67ca-4947-b235-7ca4014337e7 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:22.397170 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-76f977d2-67ca-4947-b235-7ca4014337e7 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:22.397523 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-23466f01-2f52-485c-ab74-ca65479ecdd2 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:22.398029 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-23466f01-2f52-485c-ab74-ca65479ecdd2 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:22.398808 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-23466f01-2f52-485c-ab74-ca65479ecdd2 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:22.399251 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-23466f01-2f52-485c-ab74-ca65479ecdd2 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:22.404397 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-76f977d2-67ca-4947-b235-7ca4014337e7 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:22.404885 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-76f977d2-67ca-4947-b235-7ca4014337e7 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:22.405732 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-76f977d2-67ca-4947-b235-7ca4014337e7 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:22.406254 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-76f977d2-67ca-4947-b235-7ca4014337e7 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:22.518789 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-23466f01-2f52-485c-ab74-ca65479ecdd2 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 26206 microversion: 2.20 time: 0.132348 Jan 11 15:12:22.519473 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 145/275] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:22 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 26206 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:12:22.540972 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-76f977d2-67ca-4947-b235-7ca4014337e7 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:22.548215 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-76f977d2-67ca-4947-b235-7ca4014337e7 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1555 microversion: 2.1 time: 0.156467 Jan 11 15:12:22.549510 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 131/276] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:22 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:12:22.854587 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-6313478e-0fb9-4093-98b1-ca176deb00fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:22.855308 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-6313478e-0fb9-4093-98b1-ca176deb00fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:22.862854 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6313478e-0fb9-4093-98b1-ca176deb00fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:22.863547 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6313478e-0fb9-4093-98b1-ca176deb00fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:22.864344 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6313478e-0fb9-4093-98b1-ca176deb00fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:22.864787 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6313478e-0fb9-4093-98b1-ca176deb00fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:22.998748 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-6313478e-0fb9-4093-98b1-ca176deb00fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:23.007383 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-6313478e-0fb9-4093-98b1-ca176deb00fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.156659 Jan 11 15:12:23.008030 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 146/277] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:22 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:23.100346 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e1f0bd9e-4cbc-49cb-afe7-5d55d769cbaa tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:23.100981 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e1f0bd9e-4cbc-49cb-afe7-5d55d769cbaa tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 32a717c2-da7f-4685-813a-20f4149ce104] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:23.107368 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e1f0bd9e-4cbc-49cb-afe7-5d55d769cbaa tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:23.107819 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e1f0bd9e-4cbc-49cb-afe7-5d55d769cbaa tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:23.108629 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e1f0bd9e-4cbc-49cb-afe7-5d55d769cbaa tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:23.109064 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e1f0bd9e-4cbc-49cb-afe7-5d55d769cbaa tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:23.235435 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e1f0bd9e-4cbc-49cb-afe7-5d55d769cbaa tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:23.242713 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e1f0bd9e-4cbc-49cb-afe7-5d55d769cbaa tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104" status: 200 len: 1316 microversion: 2.1 time: 0.146583 Jan 11 15:12:23.243322 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 132/278] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:23 2022] GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104 => generated 1316 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:23.293677 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-77fdb506-3f95-4215-b7f6-dd478e2eb951 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:23.294588 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-77fdb506-3f95-4215-b7f6-dd478e2eb951 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:23.301048 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-77fdb506-3f95-4215-b7f6-dd478e2eb951 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:23.301492 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-77fdb506-3f95-4215-b7f6-dd478e2eb951 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:23.302269 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-77fdb506-3f95-4215-b7f6-dd478e2eb951 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:23.302762 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-77fdb506-3f95-4215-b7f6-dd478e2eb951 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:23.392919 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-77fdb506-3f95-4215-b7f6-dd478e2eb951 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 16120 microversion: 2.1 time: 0.102636 Jan 11 15:12:23.393575 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 147/279] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:23 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 16120 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:12:23.530392 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3ebba904-854e-4134-a96d-b92a6df3b614 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:23.531501 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3ebba904-854e-4134-a96d-b92a6df3b614 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:23.537791 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3ebba904-854e-4134-a96d-b92a6df3b614 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:23.538234 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3ebba904-854e-4134-a96d-b92a6df3b614 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:23.539010 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3ebba904-854e-4134-a96d-b92a6df3b614 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:23.539478 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3ebba904-854e-4134-a96d-b92a6df3b614 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:23.567027 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-616c386c-59b3-4691-a974-5c745c5ce622 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:23.567907 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-616c386c-59b3-4691-a974-5c745c5ce622 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:23.575593 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-616c386c-59b3-4691-a974-5c745c5ce622 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:23.576055 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-616c386c-59b3-4691-a974-5c745c5ce622 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:23.576847 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-616c386c-59b3-4691-a974-5c745c5ce622 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:23.577292 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-616c386c-59b3-4691-a974-5c745c5ce622 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:23.717809 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-616c386c-59b3-4691-a974-5c745c5ce622 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:23.725692 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-616c386c-59b3-4691-a974-5c745c5ce622 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1555 microversion: 2.1 time: 0.163179 Jan 11 15:12:23.726387 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 148/280] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:23 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:12:23.759333 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3ebba904-854e-4134-a96d-b92a6df3b614 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 26756 microversion: 2.20 time: 0.232499 Jan 11 15:12:23.759959 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 133/281] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:23 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 26756 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:12:24.024107 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-244d21a3-431c-498d-816c-9b7c2ca6801d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:24.024720 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-244d21a3-431c-498d-816c-9b7c2ca6801d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:24.031011 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-244d21a3-431c-498d-816c-9b7c2ca6801d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:24.031511 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-244d21a3-431c-498d-816c-9b7c2ca6801d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:24.032290 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-244d21a3-431c-498d-816c-9b7c2ca6801d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:24.032729 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-244d21a3-431c-498d-816c-9b7c2ca6801d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:24.160677 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-244d21a3-431c-498d-816c-9b7c2ca6801d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:24.168278 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-244d21a3-431c-498d-816c-9b7c2ca6801d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.147875 Jan 11 15:12:24.168848 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 149/282] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:24 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:24.259834 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-90fcca52-d271-4499-8e6c-5b310fd1241d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:24.260532 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-90fcca52-d271-4499-8e6c-5b310fd1241d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 32a717c2-da7f-4685-813a-20f4149ce104] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:24.267408 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-90fcca52-d271-4499-8e6c-5b310fd1241d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:24.267858 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-90fcca52-d271-4499-8e6c-5b310fd1241d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:24.268670 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-90fcca52-d271-4499-8e6c-5b310fd1241d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:24.269113 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-90fcca52-d271-4499-8e6c-5b310fd1241d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:24.398907 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-90fcca52-d271-4499-8e6c-5b310fd1241d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:24.404957 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-23c0ed76-cb67-400e-90c1-a30a0d053c79 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:24.405964 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-23c0ed76-cb67-400e-90c1-a30a0d053c79 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:24.413020 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-23c0ed76-cb67-400e-90c1-a30a0d053c79 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:24.413473 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-23c0ed76-cb67-400e-90c1-a30a0d053c79 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:24.414458 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-23c0ed76-cb67-400e-90c1-a30a0d053c79 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:24.414895 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-23c0ed76-cb67-400e-90c1-a30a0d053c79 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:24.422129 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-90fcca52-d271-4499-8e6c-5b310fd1241d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104" status: 200 len: 1316 microversion: 2.1 time: 0.164627 Jan 11 15:12:24.426059 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 134/283] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:24 2022] GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104 => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:24.514113 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-23c0ed76-cb67-400e-90c1-a30a0d053c79 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 17602 microversion: 2.1 time: 0.112524 Jan 11 15:12:24.521088 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 150/284] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:24 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 17602 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:12:24.743610 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-44fa327c-25ee-4733-8bf7-1eb225e9c8c2 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:24.744228 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-44fa327c-25ee-4733-8bf7-1eb225e9c8c2 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:24.750534 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-44fa327c-25ee-4733-8bf7-1eb225e9c8c2 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:24.751222 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-44fa327c-25ee-4733-8bf7-1eb225e9c8c2 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:24.752112 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-44fa327c-25ee-4733-8bf7-1eb225e9c8c2 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:24.752530 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-44fa327c-25ee-4733-8bf7-1eb225e9c8c2 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:24.770759 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-87ba7f32-9560-4b0a-9f80-d2b9a48ddb55 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:24.772623 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-87ba7f32-9560-4b0a-9f80-d2b9a48ddb55 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:24.779519 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-87ba7f32-9560-4b0a-9f80-d2b9a48ddb55 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:24.779968 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-87ba7f32-9560-4b0a-9f80-d2b9a48ddb55 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:24.783862 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-87ba7f32-9560-4b0a-9f80-d2b9a48ddb55 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:24.783862 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-87ba7f32-9560-4b0a-9f80-d2b9a48ddb55 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:24.898011 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-44fa327c-25ee-4733-8bf7-1eb225e9c8c2 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:24.905876 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-44fa327c-25ee-4733-8bf7-1eb225e9c8c2 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1555 microversion: 2.1 time: 0.166341 Jan 11 15:12:24.906445 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 135/285] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:24 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:24.969377 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-87ba7f32-9560-4b0a-9f80-d2b9a48ddb55 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 27055 microversion: 2.20 time: 0.202761 Jan 11 15:12:24.973285 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 151/286] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:24 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 27055 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:12:25.184920 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-43e8a48b-759e-4edc-b326-904a91ba703e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:25.185530 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-43e8a48b-759e-4edc-b326-904a91ba703e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:25.191850 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-43e8a48b-759e-4edc-b326-904a91ba703e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:25.192304 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-43e8a48b-759e-4edc-b326-904a91ba703e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:25.193932 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-43e8a48b-759e-4edc-b326-904a91ba703e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:25.194535 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-43e8a48b-759e-4edc-b326-904a91ba703e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:25.278329 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [req-3fb75830-d6cb-433e-a8be-de830970c6d4 req-4acc0f5f-5de1-49c4-bced-3b8397c874c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "065bfd29-b195-45d4-88ea-e77e18bed4e3", "name": "network-vif-deleted", "tag": "3b4e6a20-fb1b-4615-a0a3-b94c10947846"}]} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:25.280724 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:12:25.280724 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: warnings.warn(msg) Jan 11 15:12:25.288534 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-3fb75830-d6cb-433e-a8be-de830970c6d4 req-4acc0f5f-5de1-49c4-bced-3b8397c874c9 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:25.288972 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-3fb75830-d6cb-433e-a8be-de830970c6d4 req-4acc0f5f-5de1-49c4-bced-3b8397c874c9 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:25.299258 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.compute.server_external_events [req-3fb75830-d6cb-433e-a8be-de830970c6d4 req-4acc0f5f-5de1-49c4-bced-3b8397c874c9 service nova] Creating event network-vif-deleted:3b4e6a20-fb1b-4615-a0a3-b94c10947846 for instance 065bfd29-b195-45d4-88ea-e77e18bed4e3 on hv-cinder-82418 Jan 11 15:12:25.304559 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [req-3fb75830-d6cb-433e-a8be-de830970c6d4 req-4acc0f5f-5de1-49c4-bced-3b8397c874c9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030211 Jan 11 15:12:25.305127 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 152/287] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:12:25.348476 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-43e8a48b-759e-4edc-b326-904a91ba703e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:25.356008 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-43e8a48b-759e-4edc-b326-904a91ba703e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.174826 Jan 11 15:12:25.356575 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 136/288] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:25 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:25.443049 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ad5d2a7d-2e09-4af3-b899-f300fecc6445 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:25.444279 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-ad5d2a7d-2e09-4af3-b899-f300fecc6445 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 32a717c2-da7f-4685-813a-20f4149ce104] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:25.450350 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ad5d2a7d-2e09-4af3-b899-f300fecc6445 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:25.450813 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ad5d2a7d-2e09-4af3-b899-f300fecc6445 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:25.451621 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ad5d2a7d-2e09-4af3-b899-f300fecc6445 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:25.452077 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ad5d2a7d-2e09-4af3-b899-f300fecc6445 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:25.525876 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d652d7aa-0728-4996-9874-b4d9ce49624c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:25.526973 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d652d7aa-0728-4996-9874-b4d9ce49624c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:25.533042 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d652d7aa-0728-4996-9874-b4d9ce49624c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:25.533773 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d652d7aa-0728-4996-9874-b4d9ce49624c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:25.534569 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d652d7aa-0728-4996-9874-b4d9ce49624c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:25.535017 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d652d7aa-0728-4996-9874-b4d9ce49624c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:25.588264 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-ad5d2a7d-2e09-4af3-b899-f300fecc6445 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:25.595868 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-ad5d2a7d-2e09-4af3-b899-f300fecc6445 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104" status: 200 len: 1316 microversion: 2.1 time: 0.157550 Jan 11 15:12:25.596434 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 153/289] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:25 2022] GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104 => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:25.641134 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d652d7aa-0728-4996-9874-b4d9ce49624c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 17602 microversion: 2.1 time: 0.118862 Jan 11 15:12:25.641806 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 137/290] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:25 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 17602 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:12:25.922453 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-6e2c290f-216c-4c86-a279-0bcb416456fe tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:25.925818 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-6e2c290f-216c-4c86-a279-0bcb416456fe tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:25.929548 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6e2c290f-216c-4c86-a279-0bcb416456fe tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:25.930000 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6e2c290f-216c-4c86-a279-0bcb416456fe tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:25.930773 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6e2c290f-216c-4c86-a279-0bcb416456fe tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:25.931204 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6e2c290f-216c-4c86-a279-0bcb416456fe tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:25.983402 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c7568af6-48b3-4054-855d-28b142036c36 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:25.984616 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c7568af6-48b3-4054-855d-28b142036c36 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:25.992485 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c7568af6-48b3-4054-855d-28b142036c36 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:25.993084 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c7568af6-48b3-4054-855d-28b142036c36 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:25.993926 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c7568af6-48b3-4054-855d-28b142036c36 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:25.994605 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c7568af6-48b3-4054-855d-28b142036c36 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:26.003161 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-6e2c290f-216c-4c86-a279-0bcb416456fe tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68a09e5be614bb5afb475a3d0f67c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e00f3a1e834285a367b73021a37cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:26.015758 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-6e2c290f-216c-4c86-a279-0bcb416456fe tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 200 len: 1346 microversion: 2.1 time: 0.092655 Jan 11 15:12:26.015758 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 154/291] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:25 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 1346 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:26.075523 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c7568af6-48b3-4054-855d-28b142036c36 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 27445 microversion: 2.20 time: 0.097372 Jan 11 15:12:26.076189 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 138/292] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:25 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 27445 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:12:26.376877 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-8582ad2e-cba1-40cd-a2bf-2d00423ee5ac tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:26.377484 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-8582ad2e-cba1-40cd-a2bf-2d00423ee5ac tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:26.384250 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8582ad2e-cba1-40cd-a2bf-2d00423ee5ac tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:26.384698 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8582ad2e-cba1-40cd-a2bf-2d00423ee5ac tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:26.385493 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8582ad2e-cba1-40cd-a2bf-2d00423ee5ac tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:26.385927 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8582ad2e-cba1-40cd-a2bf-2d00423ee5ac tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:26.523569 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-8582ad2e-cba1-40cd-a2bf-2d00423ee5ac tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:26.531056 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-8582ad2e-cba1-40cd-a2bf-2d00423ee5ac tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.157831 Jan 11 15:12:26.531729 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 155/293] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:26 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:26.613260 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d2ac8a1e-05b7-4619-a79a-08de01ca4f72 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:26.613971 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d2ac8a1e-05b7-4619-a79a-08de01ca4f72 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 32a717c2-da7f-4685-813a-20f4149ce104] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:26.620917 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d2ac8a1e-05b7-4619-a79a-08de01ca4f72 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:26.629079 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d2ac8a1e-05b7-4619-a79a-08de01ca4f72 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:26.629079 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d2ac8a1e-05b7-4619-a79a-08de01ca4f72 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:26.629079 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d2ac8a1e-05b7-4619-a79a-08de01ca4f72 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:26.658703 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ffb7a267-8060-4176-98fb-16d63cccec8f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:26.659770 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-ffb7a267-8060-4176-98fb-16d63cccec8f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:26.665642 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ffb7a267-8060-4176-98fb-16d63cccec8f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:26.666168 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ffb7a267-8060-4176-98fb-16d63cccec8f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:26.667000 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ffb7a267-8060-4176-98fb-16d63cccec8f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:26.667463 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ffb7a267-8060-4176-98fb-16d63cccec8f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:26.750601 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-ffb7a267-8060-4176-98fb-16d63cccec8f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 18772 microversion: 2.1 time: 0.095268 Jan 11 15:12:26.756744 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 156/294] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:26 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 18772 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:12:26.761322 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d2ac8a1e-05b7-4619-a79a-08de01ca4f72 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:26.765794 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d2ac8a1e-05b7-4619-a79a-08de01ca4f72 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104" status: 200 len: 1316 microversion: 2.1 time: 0.156564 Jan 11 15:12:26.766378 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 139/295] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:26 2022] GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:12:27.027726 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-538e9a15-fde0-4767-a3e3-bb6d3e06cf93 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:27.028427 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-538e9a15-fde0-4767-a3e3-bb6d3e06cf93 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:27.035116 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-538e9a15-fde0-4767-a3e3-bb6d3e06cf93 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:27.037164 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-538e9a15-fde0-4767-a3e3-bb6d3e06cf93 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:27.037164 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-538e9a15-fde0-4767-a3e3-bb6d3e06cf93 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:27.037336 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-538e9a15-fde0-4767-a3e3-bb6d3e06cf93 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:27.053161 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.wsgi [None req-538e9a15-fde0-4767-a3e3-bb6d3e06cf93 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] HTTP exception thrown: Instance 065bfd29-b195-45d4-88ea-e77e18bed4e3 could not be found. Jan 11 15:12:27.053670 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-538e9a15-fde0-4767-a3e3-bb6d3e06cf93 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Returning 404 to user: Instance 065bfd29-b195-45d4-88ea-e77e18bed4e3 could not be found. {{(pid=116903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:12:27.054473 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-538e9a15-fde0-4767-a3e3-bb6d3e06cf93 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 404 len: 111 microversion: 2.1 time: 0.030839 Jan 11 15:12:27.055057 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 157/296] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:27 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 15:12:27.088490 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3c4dc4c5-6b77-478b-8cc2-bb29a38d1ee3 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:27.088490 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3c4dc4c5-6b77-478b-8cc2-bb29a38d1ee3 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:27.095584 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c4dc4c5-6b77-478b-8cc2-bb29a38d1ee3 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:27.096058 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c4dc4c5-6b77-478b-8cc2-bb29a38d1ee3 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:27.096847 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c4dc4c5-6b77-478b-8cc2-bb29a38d1ee3 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:27.097282 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c4dc4c5-6b77-478b-8cc2-bb29a38d1ee3 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:27.154838 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f13acdc7-5d27-4d3d-86bc-224d5857f367 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:27.155789 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f13acdc7-5d27-4d3d-86bc-224d5857f367 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:27.162764 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f13acdc7-5d27-4d3d-86bc-224d5857f367 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:27.163316 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f13acdc7-5d27-4d3d-86bc-224d5857f367 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:27.164098 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f13acdc7-5d27-4d3d-86bc-224d5857f367 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:27.164530 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f13acdc7-5d27-4d3d-86bc-224d5857f367 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:27.177031 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.wsgi [None req-f13acdc7-5d27-4d3d-86bc-224d5857f367 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] HTTP exception thrown: Instance 065bfd29-b195-45d4-88ea-e77e18bed4e3 could not be found. Jan 11 15:12:27.179451 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f13acdc7-5d27-4d3d-86bc-224d5857f367 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Returning 404 to user: Instance 065bfd29-b195-45d4-88ea-e77e18bed4e3 could not be found. {{(pid=116903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:12:27.179451 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f13acdc7-5d27-4d3d-86bc-224d5857f367 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.027932 Jan 11 15:12:27.179789 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 158/297] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:12:27 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3/os-volume_attachments => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 11 15:12:27.195642 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3c4dc4c5-6b77-478b-8cc2-bb29a38d1ee3 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 27563 microversion: 2.20 time: 0.112046 Jan 11 15:12:27.199608 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 140/298] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:27 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 27563 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:12:27.548897 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-292da9bf-fc7d-4918-b5e5-672c96ff3f72 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:27.548897 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-292da9bf-fc7d-4918-b5e5-672c96ff3f72 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:27.559631 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-292da9bf-fc7d-4918-b5e5-672c96ff3f72 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:27.560106 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-292da9bf-fc7d-4918-b5e5-672c96ff3f72 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:27.560920 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-292da9bf-fc7d-4918-b5e5-672c96ff3f72 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:27.561361 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-292da9bf-fc7d-4918-b5e5-672c96ff3f72 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:27.618726 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-305d11df-9cb9-4b89-95cb-4101e417bbf5 req-9b5ee23f-ec7b-4310-aceb-31056e2bc823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a717c2-da7f-4685-813a-20f4149ce104", "name": "network-vif-plugged", "status": "completed", "tag": "94ba84f2-19a7-465d-a25a-5495304a6ac2"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:27.620988 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:12:27.620988 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:12:27.630058 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-305d11df-9cb9-4b89-95cb-4101e417bbf5 req-9b5ee23f-ec7b-4310-aceb-31056e2bc823 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:27.632356 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-305d11df-9cb9-4b89-95cb-4101e417bbf5 req-9b5ee23f-ec7b-4310-aceb-31056e2bc823 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:27.641356 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-305d11df-9cb9-4b89-95cb-4101e417bbf5 req-9b5ee23f-ec7b-4310-aceb-31056e2bc823 service nova] Creating event network-vif-plugged:94ba84f2-19a7-465d-a25a-5495304a6ac2 for instance 32a717c2-da7f-4685-813a-20f4149ce104 on hv-cinder-82418 Jan 11 15:12:27.646859 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [req-305d11df-9cb9-4b89-95cb-4101e417bbf5 req-9b5ee23f-ec7b-4310-aceb-31056e2bc823 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032670 Jan 11 15:12:27.647665 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 141/299] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:12:27.709100 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-292da9bf-fc7d-4918-b5e5-672c96ff3f72 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:27.717186 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-292da9bf-fc7d-4918-b5e5-672c96ff3f72 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.172920 Jan 11 15:12:27.717832 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 159/300] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:27 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:27.769103 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-11dc379c-2212-493e-a98c-f25b12c8a4cc tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:27.770662 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-11dc379c-2212-493e-a98c-f25b12c8a4cc tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:27.782915 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-08e6c036-c1f9-489e-966e-f5b06cfc06a2 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:27.785060 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-08e6c036-c1f9-489e-966e-f5b06cfc06a2 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 32a717c2-da7f-4685-813a-20f4149ce104] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:27.793189 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-11dc379c-2212-493e-a98c-f25b12c8a4cc tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:27.793561 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-11dc379c-2212-493e-a98c-f25b12c8a4cc tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:27.794371 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-11dc379c-2212-493e-a98c-f25b12c8a4cc tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:27.794896 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-11dc379c-2212-493e-a98c-f25b12c8a4cc tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:27.797210 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-08e6c036-c1f9-489e-966e-f5b06cfc06a2 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:27.797575 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-08e6c036-c1f9-489e-966e-f5b06cfc06a2 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:27.798448 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-08e6c036-c1f9-489e-966e-f5b06cfc06a2 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:27.798810 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-08e6c036-c1f9-489e-966e-f5b06cfc06a2 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:27.922912 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-11dc379c-2212-493e-a98c-f25b12c8a4cc tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 20511 microversion: 2.1 time: 0.158257 Jan 11 15:12:27.923591 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 142/301] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:27 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 20511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:12:27.968152 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-08e6c036-c1f9-489e-966e-f5b06cfc06a2 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:27.975690 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-08e6c036-c1f9-489e-966e-f5b06cfc06a2 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104" status: 200 len: 1316 microversion: 2.1 time: 0.197163 Jan 11 15:12:27.976256 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 160/302] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:27 2022] GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104 => generated 1316 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:28.207673 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-05fe33c8-988f-4a23-b75a-b0c550d73612 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:28.208676 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-05fe33c8-988f-4a23-b75a-b0c550d73612 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:28.215727 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-05fe33c8-988f-4a23-b75a-b0c550d73612 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:28.216181 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-05fe33c8-988f-4a23-b75a-b0c550d73612 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:28.216960 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-05fe33c8-988f-4a23-b75a-b0c550d73612 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:28.217427 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-05fe33c8-988f-4a23-b75a-b0c550d73612 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:28.496206 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-05fe33c8-988f-4a23-b75a-b0c550d73612 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 27729 microversion: 2.20 time: 0.292381 Jan 11 15:12:28.500114 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 143/303] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:28 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 27729 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:12:28.560688 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ecc12f09-673f-4874-8160-976e6168cb69 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:28.561181 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-ecc12f09-673f-4874-8160-976e6168cb69 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:28.567502 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ecc12f09-673f-4874-8160-976e6168cb69 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:28.567955 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ecc12f09-673f-4874-8160-976e6168cb69 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:28.568726 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ecc12f09-673f-4874-8160-976e6168cb69 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:28.569211 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ecc12f09-673f-4874-8160-976e6168cb69 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:28.582909 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.wsgi [None req-ecc12f09-673f-4874-8160-976e6168cb69 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] HTTP exception thrown: Instance 065bfd29-b195-45d4-88ea-e77e18bed4e3 could not be found. Jan 11 15:12:28.583082 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ecc12f09-673f-4874-8160-976e6168cb69 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Returning 404 to user: Instance 065bfd29-b195-45d4-88ea-e77e18bed4e3 could not be found. {{(pid=116903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:12:28.583931 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-ecc12f09-673f-4874-8160-976e6168cb69 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "DELETE /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 404 len: 111 microversion: 2.1 time: 0.026925 Jan 11 15:12:28.584615 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 161/304] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jan 11 15:12:28 2022] DELETE /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 15:12:28.592878 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8a8860aa-2507-4931-9c29-636bc6ad4212 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:28.593502 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8a8860aa-2507-4931-9c29-636bc6ad4212 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] [instance: 065bfd29-b195-45d4-88ea-e77e18bed4e3] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:28.600922 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8a8860aa-2507-4931-9c29-636bc6ad4212 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:28.601579 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8a8860aa-2507-4931-9c29-636bc6ad4212 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:28.602137 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8a8860aa-2507-4931-9c29-636bc6ad4212 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:28.602569 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8a8860aa-2507-4931-9c29-636bc6ad4212 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:28.617211 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.wsgi [None req-8a8860aa-2507-4931-9c29-636bc6ad4212 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] HTTP exception thrown: Instance 065bfd29-b195-45d4-88ea-e77e18bed4e3 could not be found. Jan 11 15:12:28.617798 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8a8860aa-2507-4931-9c29-636bc6ad4212 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] Returning 404 to user: Instance 065bfd29-b195-45d4-88ea-e77e18bed4e3 could not be found. {{(pid=116902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:12:28.618737 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8a8860aa-2507-4931-9c29-636bc6ad4212 tempest-DeleteServersTestJSON-1113316505 tempest-DeleteServersTestJSON-1113316505-project] 10.222.0.52 "GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3" status: 404 len: 111 microversion: 2.1 time: 0.030062 Jan 11 15:12:28.619196 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 144/305] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:28 2022] GET /compute/v2.1/servers/065bfd29-b195-45d4-88ea-e77e18bed4e3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 15:12:28.734084 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-8b368414-4642-4092-b676-84abdc6d1757 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:28.734695 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-8b368414-4642-4092-b676-84abdc6d1757 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:28.741268 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8b368414-4642-4092-b676-84abdc6d1757 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:28.741721 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8b368414-4642-4092-b676-84abdc6d1757 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:28.742498 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8b368414-4642-4092-b676-84abdc6d1757 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:28.742936 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8b368414-4642-4092-b676-84abdc6d1757 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:28.934391 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9f81cd85-020e-4423-aaef-1a9fb53baaf9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:28.936241 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9f81cd85-020e-4423-aaef-1a9fb53baaf9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:28.942375 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9f81cd85-020e-4423-aaef-1a9fb53baaf9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:28.943065 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9f81cd85-020e-4423-aaef-1a9fb53baaf9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:28.943955 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9f81cd85-020e-4423-aaef-1a9fb53baaf9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:28.944460 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9f81cd85-020e-4423-aaef-1a9fb53baaf9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:28.951137 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-8b368414-4642-4092-b676-84abdc6d1757 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:28.960169 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-8b368414-4642-4092-b676-84abdc6d1757 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.230152 Jan 11 15:12:28.966017 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 162/306] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:28 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:28.992593 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4e62e843-fd09-4dca-a300-1954f0daf895 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:28.993290 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4e62e843-fd09-4dca-a300-1954f0daf895 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 32a717c2-da7f-4685-813a-20f4149ce104] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:28.999610 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4e62e843-fd09-4dca-a300-1954f0daf895 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:28.999825 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4e62e843-fd09-4dca-a300-1954f0daf895 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:29.001309 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4e62e843-fd09-4dca-a300-1954f0daf895 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:29.001772 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4e62e843-fd09-4dca-a300-1954f0daf895 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:29.051474 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9f81cd85-020e-4423-aaef-1a9fb53baaf9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 22015 microversion: 2.1 time: 0.120826 Jan 11 15:12:29.055333 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 145/307] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:28 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 22015 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:12:29.145192 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-4e62e843-fd09-4dca-a300-1954f0daf895 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:29.153606 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4e62e843-fd09-4dca-a300-1954f0daf895 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104" status: 200 len: 1316 microversion: 2.1 time: 0.165120 Jan 11 15:12:29.154169 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 163/308] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:28 2022] GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104 => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:12:29.508446 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-93252eef-96cb-4445-8b7c-3699138b35a4 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:29.509495 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-93252eef-96cb-4445-8b7c-3699138b35a4 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:29.516721 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-93252eef-96cb-4445-8b7c-3699138b35a4 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:29.517334 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-93252eef-96cb-4445-8b7c-3699138b35a4 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:29.518132 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-93252eef-96cb-4445-8b7c-3699138b35a4 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:29.518782 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-93252eef-96cb-4445-8b7c-3699138b35a4 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:29.607832 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-93252eef-96cb-4445-8b7c-3699138b35a4 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 27989 microversion: 2.20 time: 0.103442 Jan 11 15:12:29.608392 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 146/309] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:29 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 27989 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:12:29.981372 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-446b0ea9-f32c-4036-8313-a37acd8fa0c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:29.982126 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-446b0ea9-f32c-4036-8313-a37acd8fa0c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:29.989056 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-446b0ea9-f32c-4036-8313-a37acd8fa0c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:29.989599 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-446b0ea9-f32c-4036-8313-a37acd8fa0c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:29.990461 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-446b0ea9-f32c-4036-8313-a37acd8fa0c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:29.990972 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-446b0ea9-f32c-4036-8313-a37acd8fa0c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:30.064925 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2c794382-dcba-4748-a1d4-faf58fcfa1c6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:30.065934 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2c794382-dcba-4748-a1d4-faf58fcfa1c6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:30.073636 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2c794382-dcba-4748-a1d4-faf58fcfa1c6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:30.074094 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2c794382-dcba-4748-a1d4-faf58fcfa1c6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:30.074893 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2c794382-dcba-4748-a1d4-faf58fcfa1c6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:30.075455 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2c794382-dcba-4748-a1d4-faf58fcfa1c6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:30.176199 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2c794382-dcba-4748-a1d4-faf58fcfa1c6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 23226 microversion: 2.1 time: 0.116729 Jan 11 15:12:30.176824 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 147/310] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:30 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 23226 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:12:30.186425 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f0ec9ae1-bb35-4718-a7a9-f827157855ef tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:30.187398 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f0ec9ae1-bb35-4718-a7a9-f827157855ef tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 32a717c2-da7f-4685-813a-20f4149ce104] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:30.196292 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f0ec9ae1-bb35-4718-a7a9-f827157855ef tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:30.196971 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f0ec9ae1-bb35-4718-a7a9-f827157855ef tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:30.202480 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f0ec9ae1-bb35-4718-a7a9-f827157855ef tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:30.202480 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f0ec9ae1-bb35-4718-a7a9-f827157855ef tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:30.222559 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-446b0ea9-f32c-4036-8313-a37acd8fa0c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:30.234710 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-446b0ea9-f32c-4036-8313-a37acd8fa0c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.256626 Jan 11 15:12:30.235450 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 164/311] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:29 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:30.356506 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f0ec9ae1-bb35-4718-a7a9-f827157855ef tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:30.363878 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f0ec9ae1-bb35-4718-a7a9-f827157855ef tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104" status: 200 len: 1316 microversion: 2.1 time: 0.185979 Jan 11 15:12:30.364557 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 148/312] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:30 2022] GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104 => generated 1316 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:30.619548 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c7d555e8-2121-4f1d-b526-065804427a7f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:30.620482 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c7d555e8-2121-4f1d-b526-065804427a7f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:30.626804 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c7d555e8-2121-4f1d-b526-065804427a7f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:30.626804 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c7d555e8-2121-4f1d-b526-065804427a7f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:30.627529 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c7d555e8-2121-4f1d-b526-065804427a7f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:30.628124 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c7d555e8-2121-4f1d-b526-065804427a7f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:30.717807 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c7d555e8-2121-4f1d-b526-065804427a7f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28106 microversion: 2.20 time: 0.102061 Jan 11 15:12:30.722380 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 165/313] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:30 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28106 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:12:31.188180 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7182ecb3-d3ae-4898-ac06-826f416db0b2 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:31.189131 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-7182ecb3-d3ae-4898-ac06-826f416db0b2 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:31.196327 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7182ecb3-d3ae-4898-ac06-826f416db0b2 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:31.196785 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7182ecb3-d3ae-4898-ac06-826f416db0b2 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:31.197580 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7182ecb3-d3ae-4898-ac06-826f416db0b2 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:31.198024 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7182ecb3-d3ae-4898-ac06-826f416db0b2 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:31.252203 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-fe9873d8-1b9d-4427-8a95-8c9288eea1be tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:31.252913 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-fe9873d8-1b9d-4427-8a95-8c9288eea1be tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:31.259987 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fe9873d8-1b9d-4427-8a95-8c9288eea1be tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:31.260469 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fe9873d8-1b9d-4427-8a95-8c9288eea1be tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:31.261254 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fe9873d8-1b9d-4427-8a95-8c9288eea1be tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:31.261694 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fe9873d8-1b9d-4427-8a95-8c9288eea1be tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:31.281850 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7182ecb3-d3ae-4898-ac06-826f416db0b2 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 24174 microversion: 2.1 time: 0.097482 Jan 11 15:12:31.283523 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 149/314] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:31 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 24174 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:12:31.383790 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2fae2287-4043-4dd5-85a3-87396748a497 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:31.384944 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2fae2287-4043-4dd5-85a3-87396748a497 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 32a717c2-da7f-4685-813a-20f4149ce104] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:31.396550 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2fae2287-4043-4dd5-85a3-87396748a497 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:31.397370 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2fae2287-4043-4dd5-85a3-87396748a497 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:31.398816 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2fae2287-4043-4dd5-85a3-87396748a497 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:31.399337 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2fae2287-4043-4dd5-85a3-87396748a497 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:31.423499 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-fe9873d8-1b9d-4427-8a95-8c9288eea1be tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:31.433259 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-fe9873d8-1b9d-4427-8a95-8c9288eea1be tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.184869 Jan 11 15:12:31.442619 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 166/315] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:31 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:12:31.540885 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-2fae2287-4043-4dd5-85a3-87396748a497 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:31.548181 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2fae2287-4043-4dd5-85a3-87396748a497 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104" status: 200 len: 1507 microversion: 2.1 time: 0.171112 Jan 11 15:12:31.548735 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 150/316] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:31 2022] GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104 => generated 1507 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:12:31.564148 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b9ce3ede-e87f-489f-84e2-a733d5a86113 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43ed0210-fa7b-4c68-a3df-34164b27365c"}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:31.565239 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b9ce3ede-e87f-489f-84e2-a733d5a86113 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 32a717c2-da7f-4685-813a-20f4149ce104] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:31.571969 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b9ce3ede-e87f-489f-84e2-a733d5a86113 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:31.572424 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b9ce3ede-e87f-489f-84e2-a733d5a86113 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:31.573203 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b9ce3ede-e87f-489f-84e2-a733d5a86113 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:31.574700 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b9ce3ede-e87f-489f-84e2-a733d5a86113 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:31.663597 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.wsgi [None req-b9ce3ede-e87f-489f-84e2-a733d5a86113 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] HTTP exception thrown: Invalid volume: volume 43ed0210-fa7b-4c68-a3df-34164b27365c is already attached to instances: 6e78f846-beb6-49c6-8f01-5cc343dbb7be Jan 11 15:12:31.664268 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b9ce3ede-e87f-489f-84e2-a733d5a86113 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Returning 400 to user: Invalid volume: volume 43ed0210-fa7b-4c68-a3df-34164b27365c is already attached to instances: 6e78f846-beb6-49c6-8f01-5cc343dbb7be {{(pid=116903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:12:31.665098 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b9ce3ede-e87f-489f-84e2-a733d5a86113 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "POST /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105051 Jan 11 15:12:31.665992 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 167/317] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jan 11 15:12:31 2022] POST /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 11 15:12:31.738875 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8d4e6833-71e4-4064-a34b-f685c56208af tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:31.740508 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8d4e6833-71e4-4064-a34b-f685c56208af tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:31.741969 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-52d2d867-ab2d-4ece-9dda-71820d8b6a08 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:31.742644 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-52d2d867-ab2d-4ece-9dda-71820d8b6a08 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:31.748946 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-52d2d867-ab2d-4ece-9dda-71820d8b6a08 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:31.749336 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8d4e6833-71e4-4064-a34b-f685c56208af tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:31.749792 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8d4e6833-71e4-4064-a34b-f685c56208af tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:31.750153 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-52d2d867-ab2d-4ece-9dda-71820d8b6a08 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:31.751087 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8d4e6833-71e4-4064-a34b-f685c56208af tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:31.751239 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-52d2d867-ab2d-4ece-9dda-71820d8b6a08 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:31.751699 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8d4e6833-71e4-4064-a34b-f685c56208af tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:31.752000 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-52d2d867-ab2d-4ece-9dda-71820d8b6a08 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:31.836477 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8d4e6833-71e4-4064-a34b-f685c56208af tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28106 microversion: 2.20 time: 0.109529 Jan 11 15:12:31.841191 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 151/318] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:31 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28106 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:12:31.873341 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.objects.instance [None req-52d2d867-ab2d-4ece-9dda-71820d8b6a08 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lazy-loading 'services' on Instance uuid 6e78f846-beb6-49c6-8f01-5cc343dbb7be {{(pid=116903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 15:12:32.178696 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-52d2d867-ab2d-4ece-9dda-71820d8b6a08 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be/os-volume_attachments/43ed0210-fa7b-4c68-a3df-34164b27365c" status: 202 len: 0 microversion: 2.1 time: 0.440084 Jan 11 15:12:32.181707 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 168/319] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jan 11 15:12:31 2022] DELETE /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be/os-volume_attachments/43ed0210-fa7b-4c68-a3df-34164b27365c => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:12:32.191213 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-65a8392d-c214-4d1c-9068-3c8116e93b14 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:32.192350 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-65a8392d-c214-4d1c-9068-3c8116e93b14 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:32.203802 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-65a8392d-c214-4d1c-9068-3c8116e93b14 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:32.204407 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-65a8392d-c214-4d1c-9068-3c8116e93b14 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:32.205207 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-65a8392d-c214-4d1c-9068-3c8116e93b14 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:32.205648 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-65a8392d-c214-4d1c-9068-3c8116e93b14 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:32.268306 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-65a8392d-c214-4d1c-9068-3c8116e93b14 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081926 Jan 11 15:12:32.269408 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 152/320] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:12:32 2022] GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:12:32.295159 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-af06556d-077e-4f60-ab59-be10cd6c16ae tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:32.296271 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-af06556d-077e-4f60-ab59-be10cd6c16ae tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:32.303753 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-af06556d-077e-4f60-ab59-be10cd6c16ae tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:32.303753 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-af06556d-077e-4f60-ab59-be10cd6c16ae tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:32.305015 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-af06556d-077e-4f60-ab59-be10cd6c16ae tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:32.305462 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-af06556d-077e-4f60-ab59-be10cd6c16ae tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:32.410463 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-af06556d-077e-4f60-ab59-be10cd6c16ae tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 25430 microversion: 2.1 time: 0.119030 Jan 11 15:12:32.411604 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 169/321] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:32 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 25430 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:12:32.449679 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1fa4f5f6-070f-4670-beac-d3156b54ea45 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:32.450287 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1fa4f5f6-070f-4670-beac-d3156b54ea45 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:32.456580 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1fa4f5f6-070f-4670-beac-d3156b54ea45 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:32.457028 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1fa4f5f6-070f-4670-beac-d3156b54ea45 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:32.457809 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1fa4f5f6-070f-4670-beac-d3156b54ea45 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:32.458245 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1fa4f5f6-070f-4670-beac-d3156b54ea45 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:32.818612 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1fa4f5f6-070f-4670-beac-d3156b54ea45 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:32.826349 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1fa4f5f6-070f-4670-beac-d3156b54ea45 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.380173 Jan 11 15:12:32.826904 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 153/322] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:32 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:32.850861 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4918dace-485b-4c4a-bbc4-f935d1d42148 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:32.852671 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4918dace-485b-4c4a-bbc4-f935d1d42148 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:32.859859 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4918dace-485b-4c4a-bbc4-f935d1d42148 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:32.860335 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4918dace-485b-4c4a-bbc4-f935d1d42148 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:32.861266 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4918dace-485b-4c4a-bbc4-f935d1d42148 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:32.861707 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4918dace-485b-4c4a-bbc4-f935d1d42148 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:32.940420 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4918dace-485b-4c4a-bbc4-f935d1d42148 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28106 microversion: 2.20 time: 0.093469 Jan 11 15:12:32.941070 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 170/323] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:32 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28106 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:12:33.280445 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-cdccc54e-7b22-4d8c-a790-d1922fe57c2e tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:33.281432 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-cdccc54e-7b22-4d8c-a790-d1922fe57c2e tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:33.288142 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cdccc54e-7b22-4d8c-a790-d1922fe57c2e tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:33.288601 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cdccc54e-7b22-4d8c-a790-d1922fe57c2e tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:33.289609 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cdccc54e-7b22-4d8c-a790-d1922fe57c2e tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:33.290047 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cdccc54e-7b22-4d8c-a790-d1922fe57c2e tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:33.319173 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-cdccc54e-7b22-4d8c-a790-d1922fe57c2e tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042710 Jan 11 15:12:33.323566 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 154/324] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:12:33 2022] GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:12:33.423162 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-9c486712-1262-4a3c-98f8-636b1645c540 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:33.424761 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-9c486712-1262-4a3c-98f8-636b1645c540 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:33.433054 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9c486712-1262-4a3c-98f8-636b1645c540 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:33.433634 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9c486712-1262-4a3c-98f8-636b1645c540 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:33.434543 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9c486712-1262-4a3c-98f8-636b1645c540 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:33.435098 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9c486712-1262-4a3c-98f8-636b1645c540 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:33.515427 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-9c486712-1262-4a3c-98f8-636b1645c540 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 26258 microversion: 2.1 time: 0.096716 Jan 11 15:12:33.517028 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 171/325] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:33 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 26258 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:12:33.842356 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3595e4f0-80d3-4293-a033-04d61476d2f6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:33.846955 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3595e4f0-80d3-4293-a033-04d61476d2f6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:33.849689 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3595e4f0-80d3-4293-a033-04d61476d2f6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:33.850147 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3595e4f0-80d3-4293-a033-04d61476d2f6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:33.850966 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3595e4f0-80d3-4293-a033-04d61476d2f6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:33.851935 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3595e4f0-80d3-4293-a033-04d61476d2f6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:33.952944 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-9014ece0-f575-432a-a689-28e6dc899493 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:33.953943 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-9014ece0-f575-432a-a689-28e6dc899493 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:33.960737 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9014ece0-f575-432a-a689-28e6dc899493 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:33.961187 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9014ece0-f575-432a-a689-28e6dc899493 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:33.962015 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9014ece0-f575-432a-a689-28e6dc899493 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:33.962461 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9014ece0-f575-432a-a689-28e6dc899493 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:33.991151 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3595e4f0-80d3-4293-a033-04d61476d2f6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:33.991151 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3595e4f0-80d3-4293-a033-04d61476d2f6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.148621 Jan 11 15:12:33.991151 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 155/326] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:33 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:34.042862 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-9014ece0-f575-432a-a689-28e6dc899493 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28106 microversion: 2.20 time: 0.093775 Jan 11 15:12:34.043543 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 172/327] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:33 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28106 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:12:34.331143 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c885beda-ffc8-4afa-a09e-49f86aeafb66 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:34.332120 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c885beda-ffc8-4afa-a09e-49f86aeafb66 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:34.344787 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c885beda-ffc8-4afa-a09e-49f86aeafb66 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:34.345241 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c885beda-ffc8-4afa-a09e-49f86aeafb66 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:34.346062 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c885beda-ffc8-4afa-a09e-49f86aeafb66 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:34.346533 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c885beda-ffc8-4afa-a09e-49f86aeafb66 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:34.375860 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c885beda-ffc8-4afa-a09e-49f86aeafb66 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048579 Jan 11 15:12:34.376429 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 156/328] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:12:34 2022] GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 15:12:34.527727 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-83bcda5d-7d63-410b-bbcf-3438aadfa1eb tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1448102569", "imageRef": "d0ce98ab-06a2-4e75-9f37-288864a22cb9", "flavorRef": "452", "networks": [{"uuid": "76369959-3647-4f73-a129-60ab7e24f3af"}]}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:34.539627 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d698e0ff-e697-47d2-8fcb-cc8884312d85 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:34.539627 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d698e0ff-e697-47d2-8fcb-cc8884312d85 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:34.550434 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d698e0ff-e697-47d2-8fcb-cc8884312d85 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:34.553261 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d698e0ff-e697-47d2-8fcb-cc8884312d85 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:34.554188 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d698e0ff-e697-47d2-8fcb-cc8884312d85 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:34.554909 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d698e0ff-e697-47d2-8fcb-cc8884312d85 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:34.584636 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.network.neutron [None req-83bcda5d-7d63-410b-bbcf-3438aadfa1eb tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] validate_networks() for [('76369959-3647-4f73-a129-60ab7e24f3af', None, None, None, None, None)] {{(pid=116903) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 15:12:34.671272 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d698e0ff-e697-47d2-8fcb-cc8884312d85 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 27075 microversion: 2.1 time: 0.142853 Jan 11 15:12:34.672575 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 157/329] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:34 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 27075 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:12:34.957821 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-83bcda5d-7d63-410b-bbcf-3438aadfa1eb tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Flavor limits 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 15:12:34.958243 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-83bcda5d-7d63-410b-bbcf-3438aadfa1eb tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Image limits 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 15:12:34.958714 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-83bcda5d-7d63-410b-bbcf-3438aadfa1eb tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Flavor pref 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 15:12:34.959153 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-83bcda5d-7d63-410b-bbcf-3438aadfa1eb tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Image pref 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 15:12:34.959612 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-83bcda5d-7d63-410b-bbcf-3438aadfa1eb tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 15:12:34.968410 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-83bcda5d-7d63-410b-bbcf-3438aadfa1eb tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:34.969400 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-83bcda5d-7d63-410b-bbcf-3438aadfa1eb tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:34.969659 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-83bcda5d-7d63-410b-bbcf-3438aadfa1eb tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:34.970095 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-83bcda5d-7d63-410b-bbcf-3438aadfa1eb tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:34.986726 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.quota [None req-83bcda5d-7d63-410b-bbcf-3438aadfa1eb tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Getting quotas for project 2ed51a96e66d44ca9c02bbe820c68180. Resources: {'instances', 'cores', 'ram'} {{(pid=116903) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 15:12:34.990617 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.quota [None req-83bcda5d-7d63-410b-bbcf-3438aadfa1eb tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Getting quotas for user 13f0a933d4d34f8984292406266866a0 and project 2ed51a96e66d44ca9c02bbe820c68180. Resources: {'instances', 'cores', 'ram'} {{(pid=116903) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 15:12:35.002269 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-83bcda5d-7d63-410b-bbcf-3438aadfa1eb tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Going to run 1 instances... {{(pid=116903) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 15:12:35.004861 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-83bcda5d-7d63-410b-bbcf-3438aadfa1eb tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 5d8b8b19-117d-4669-933b-5f86257caff6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0ce98ab-06a2-4e75-9f37-288864a22cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 15:12:35.005802 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-22085f88-d24e-4912-b141-e8e56160dec9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:35.006491 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-22085f88-d24e-4912-b141-e8e56160dec9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:35.013935 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-22085f88-d24e-4912-b141-e8e56160dec9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:35.014386 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-22085f88-d24e-4912-b141-e8e56160dec9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:35.015152 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-22085f88-d24e-4912-b141-e8e56160dec9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:35.015617 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-22085f88-d24e-4912-b141-e8e56160dec9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:35.147280 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-83bcda5d-7d63-410b-bbcf-3438aadfa1eb tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.624394 Jan 11 15:12:35.147941 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 173/330] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jan 11 15:12:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 15:12:35.152844 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c5553781-5218-4797-94b1-5acbdfd0cf9c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:35.153805 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c5553781-5218-4797-94b1-5acbdfd0cf9c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:35.159872 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c5553781-5218-4797-94b1-5acbdfd0cf9c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:35.160321 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c5553781-5218-4797-94b1-5acbdfd0cf9c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:35.161092 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c5553781-5218-4797-94b1-5acbdfd0cf9c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:35.161525 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c5553781-5218-4797-94b1-5acbdfd0cf9c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:35.162877 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-22085f88-d24e-4912-b141-e8e56160dec9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:35.171125 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-22085f88-d24e-4912-b141-e8e56160dec9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.169349 Jan 11 15:12:35.171741 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 158/331] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:35 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:12:35.185315 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-062dd70b-f39e-4f56-9746-ba987d9e8881 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:35.186016 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-062dd70b-f39e-4f56-9746-ba987d9e8881 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 5d8b8b19-117d-4669-933b-5f86257caff6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:35.249553 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c5553781-5218-4797-94b1-5acbdfd0cf9c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28106 microversion: 2.20 time: 0.100214 Jan 11 15:12:35.250189 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 174/332] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:35 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28106 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:12:35.270545 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-062dd70b-f39e-4f56-9746-ba987d9e8881 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:35.279000 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-062dd70b-f39e-4f56-9746-ba987d9e8881 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6" status: 200 len: 1218 microversion: 2.1 time: 0.097848 Jan 11 15:12:35.282066 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 159/333] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:35 2022] GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6 => generated 1218 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:35.687044 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-faa71d24-a067-4151-90da-ec11936ae93d tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:35.688163 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-faa71d24-a067-4151-90da-ec11936ae93d tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:35.695661 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-faa71d24-a067-4151-90da-ec11936ae93d tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:35.696112 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-faa71d24-a067-4151-90da-ec11936ae93d tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:35.696886 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-faa71d24-a067-4151-90da-ec11936ae93d tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:35.697317 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-faa71d24-a067-4151-90da-ec11936ae93d tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:35.801164 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-faa71d24-a067-4151-90da-ec11936ae93d tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 27648 microversion: 2.1 time: 0.118161 Jan 11 15:12:35.805593 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 175/334] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:35 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 27648 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:12:36.188653 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a497a5ca-93f3-4971-8e22-bfb74e80e4ac tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:36.189799 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a497a5ca-93f3-4971-8e22-bfb74e80e4ac tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:36.196451 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a497a5ca-93f3-4971-8e22-bfb74e80e4ac tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:36.196907 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a497a5ca-93f3-4971-8e22-bfb74e80e4ac tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:36.197702 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a497a5ca-93f3-4971-8e22-bfb74e80e4ac tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:36.198137 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a497a5ca-93f3-4971-8e22-bfb74e80e4ac tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:36.264904 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ab6d51b5-195e-4c02-a87d-643dd77a4cb5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:36.264904 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-ab6d51b5-195e-4c02-a87d-643dd77a4cb5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:36.274864 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ab6d51b5-195e-4c02-a87d-643dd77a4cb5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:36.275340 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ab6d51b5-195e-4c02-a87d-643dd77a4cb5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:36.277986 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ab6d51b5-195e-4c02-a87d-643dd77a4cb5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:36.278610 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ab6d51b5-195e-4c02-a87d-643dd77a4cb5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:36.379717 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a497a5ca-93f3-4971-8e22-bfb74e80e4ac tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:36.388983 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a497a5ca-93f3-4971-8e22-bfb74e80e4ac tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.204452 Jan 11 15:12:36.389554 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 160/335] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:36 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:12:36.393902 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a18e9f7e-3715-4f57-93a7-ea64dcbb49a9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:36.394680 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a18e9f7e-3715-4f57-93a7-ea64dcbb49a9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 5d8b8b19-117d-4669-933b-5f86257caff6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:36.405199 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a18e9f7e-3715-4f57-93a7-ea64dcbb49a9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:36.405782 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a18e9f7e-3715-4f57-93a7-ea64dcbb49a9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:36.406593 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a18e9f7e-3715-4f57-93a7-ea64dcbb49a9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:36.407011 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a18e9f7e-3715-4f57-93a7-ea64dcbb49a9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:36.470183 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a18e9f7e-3715-4f57-93a7-ea64dcbb49a9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:36.477910 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a18e9f7e-3715-4f57-93a7-ea64dcbb49a9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6" status: 200 len: 1222 microversion: 2.1 time: 0.087425 Jan 11 15:12:36.478477 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 161/336] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:36 2022] GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:36.812523 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3ddc2395-67ae-41a6-9dd1-d969f8cbbfd2 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:36.813717 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3ddc2395-67ae-41a6-9dd1-d969f8cbbfd2 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:36.820927 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3ddc2395-67ae-41a6-9dd1-d969f8cbbfd2 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:36.821373 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3ddc2395-67ae-41a6-9dd1-d969f8cbbfd2 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:36.822193 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3ddc2395-67ae-41a6-9dd1-d969f8cbbfd2 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:36.822624 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3ddc2395-67ae-41a6-9dd1-d969f8cbbfd2 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:40.094987 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3ddc2395-67ae-41a6-9dd1-d969f8cbbfd2 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 27834 microversion: 2.1 time: 3.286038 Jan 11 15:12:40.102602 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 162/337] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:36 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 27834 bytes in 3295 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:12:40.107727 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-31573304-cc61-4950-927c-0a0fa8c69dc3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:40.108422 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-31573304-cc61-4950-927c-0a0fa8c69dc3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:40.117560 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-31573304-cc61-4950-927c-0a0fa8c69dc3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:40.118006 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-31573304-cc61-4950-927c-0a0fa8c69dc3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:40.118803 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-31573304-cc61-4950-927c-0a0fa8c69dc3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:40.119238 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-31573304-cc61-4950-927c-0a0fa8c69dc3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:40.218719 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-ab6d51b5-195e-4c02-a87d-643dd77a4cb5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28106 microversion: 2.20 time: 3.959343 Jan 11 15:12:40.222272 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 176/338] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:36 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28106 bytes in 3962 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:12:40.228022 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b78ede52-c6d3-4da0-a9cc-3d54d9bcbcb9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:40.229641 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b78ede52-c6d3-4da0-a9cc-3d54d9bcbcb9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 5d8b8b19-117d-4669-933b-5f86257caff6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:40.242285 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b78ede52-c6d3-4da0-a9cc-3d54d9bcbcb9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:40.242745 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b78ede52-c6d3-4da0-a9cc-3d54d9bcbcb9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:40.243571 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b78ede52-c6d3-4da0-a9cc-3d54d9bcbcb9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:40.244099 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b78ede52-c6d3-4da0-a9cc-3d54d9bcbcb9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:40.270330 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-31573304-cc61-4950-927c-0a0fa8c69dc3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:40.270330 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-31573304-cc61-4950-927c-0a0fa8c69dc3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.163588 Jan 11 15:12:40.270330 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 163/339] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:40 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:40.309359 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-b78ede52-c6d3-4da0-a9cc-3d54d9bcbcb9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:40.319151 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b78ede52-c6d3-4da0-a9cc-3d54d9bcbcb9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6" status: 200 len: 1222 microversion: 2.1 time: 0.095212 Jan 11 15:12:40.320188 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 177/340] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:40 2022] GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6 => generated 1222 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:41.115170 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-96606ef2-fb54-43d8-9e0b-e4aa6251fb05 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:41.115170 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-96606ef2-fb54-43d8-9e0b-e4aa6251fb05 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:41.120829 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-96606ef2-fb54-43d8-9e0b-e4aa6251fb05 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:41.121289 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-96606ef2-fb54-43d8-9e0b-e4aa6251fb05 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:41.122085 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-96606ef2-fb54-43d8-9e0b-e4aa6251fb05 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:41.122610 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-96606ef2-fb54-43d8-9e0b-e4aa6251fb05 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:41.212452 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-96606ef2-fb54-43d8-9e0b-e4aa6251fb05 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 27834 microversion: 2.1 time: 0.102900 Jan 11 15:12:41.213388 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 164/341] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:41 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 27834 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:12:41.238906 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2becfdc2-0d31-4c1a-916e-0cf9819f7173 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:41.239862 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2becfdc2-0d31-4c1a-916e-0cf9819f7173 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:41.246552 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2becfdc2-0d31-4c1a-916e-0cf9819f7173 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:41.247055 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2becfdc2-0d31-4c1a-916e-0cf9819f7173 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:41.247868 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2becfdc2-0d31-4c1a-916e-0cf9819f7173 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:41.248306 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2becfdc2-0d31-4c1a-916e-0cf9819f7173 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:41.285666 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0fb44282-3687-4203-8a4c-1cfa090137bd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:41.286420 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0fb44282-3687-4203-8a4c-1cfa090137bd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:41.295837 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0fb44282-3687-4203-8a4c-1cfa090137bd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:41.300922 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0fb44282-3687-4203-8a4c-1cfa090137bd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:41.300922 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0fb44282-3687-4203-8a4c-1cfa090137bd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:41.300922 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0fb44282-3687-4203-8a4c-1cfa090137bd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:41.327264 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2becfdc2-0d31-4c1a-916e-0cf9819f7173 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28106 microversion: 2.20 time: 0.092748 Jan 11 15:12:41.331756 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 178/342] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:41 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28106 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:12:41.336669 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-bd49c017-538b-4511-98e2-62c715bf72b4 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:41.337372 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-bd49c017-538b-4511-98e2-62c715bf72b4 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 5d8b8b19-117d-4669-933b-5f86257caff6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:41.348561 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bd49c017-538b-4511-98e2-62c715bf72b4 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:41.349023 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bd49c017-538b-4511-98e2-62c715bf72b4 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:41.349826 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bd49c017-538b-4511-98e2-62c715bf72b4 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:41.350269 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bd49c017-538b-4511-98e2-62c715bf72b4 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:41.441022 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-bd49c017-538b-4511-98e2-62c715bf72b4 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:41.449508 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-bd49c017-538b-4511-98e2-62c715bf72b4 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6" status: 200 len: 1278 microversion: 2.1 time: 0.116697 Jan 11 15:12:41.450196 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 179/343] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:41 2022] GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6 => generated 1278 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:41.471356 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0fb44282-3687-4203-8a4c-1cfa090137bd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:41.479179 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0fb44282-3687-4203-8a4c-1cfa090137bd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.197583 Jan 11 15:12:41.479780 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 165/344] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:41 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:42.207588 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a4a163e1-90b1-4c91-bdbf-b45c17f79387 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-627373624", "imageRef": "d0ce98ab-06a2-4e75-9f37-288864a22cb9", "flavorRef": "452", "networks": [{"uuid": "9d94c25d-58e1-44a7-9c50-85c32db9bd52"}]}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:42.224077 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2ba49b3d-8297-47df-9e7a-b35daeeb2396 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:42.224982 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2ba49b3d-8297-47df-9e7a-b35daeeb2396 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:42.232369 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2ba49b3d-8297-47df-9e7a-b35daeeb2396 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:42.237818 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2ba49b3d-8297-47df-9e7a-b35daeeb2396 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:42.243229 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2ba49b3d-8297-47df-9e7a-b35daeeb2396 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:42.243229 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2ba49b3d-8297-47df-9e7a-b35daeeb2396 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:42.298444 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.network.neutron [None req-a4a163e1-90b1-4c91-bdbf-b45c17f79387 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] validate_networks() for [('9d94c25d-58e1-44a7-9c50-85c32db9bd52', None, None, None, None, None)] {{(pid=116903) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 15:12:42.657930 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-a4a163e1-90b1-4c91-bdbf-b45c17f79387 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Flavor limits 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 15:12:42.658344 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-a4a163e1-90b1-4c91-bdbf-b45c17f79387 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Image limits 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 15:12:42.658806 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-a4a163e1-90b1-4c91-bdbf-b45c17f79387 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Flavor pref 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 15:12:42.659232 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-a4a163e1-90b1-4c91-bdbf-b45c17f79387 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Image pref 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 15:12:42.659636 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-a4a163e1-90b1-4c91-bdbf-b45c17f79387 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 15:12:42.669150 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a4a163e1-90b1-4c91-bdbf-b45c17f79387 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:42.674050 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a4a163e1-90b1-4c91-bdbf-b45c17f79387 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:42.674050 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a4a163e1-90b1-4c91-bdbf-b45c17f79387 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:42.674050 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a4a163e1-90b1-4c91-bdbf-b45c17f79387 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:42.690857 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.quota [None req-a4a163e1-90b1-4c91-bdbf-b45c17f79387 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Getting quotas for project 1c371bd15cae4827a44612b4cd273a42. Resources: {'instances', 'cores', 'ram'} {{(pid=116903) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 15:12:42.695003 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.quota [None req-a4a163e1-90b1-4c91-bdbf-b45c17f79387 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Getting quotas for user 44478a3f9c404ce1bbc35c1f904b87be and project 1c371bd15cae4827a44612b4cd273a42. Resources: {'instances', 'cores', 'ram'} {{(pid=116903) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 15:12:42.706765 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a4a163e1-90b1-4c91-bdbf-b45c17f79387 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Going to run 1 instances... {{(pid=116903) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 15:12:42.709321 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a4a163e1-90b1-4c91-bdbf-b45c17f79387 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: 7ccfb598-d95c-4312-8c81-457b98804ce5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0ce98ab-06a2-4e75-9f37-288864a22cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 15:12:42.857362 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a4a163e1-90b1-4c91-bdbf-b45c17f79387 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653788 Jan 11 15:12:42.858008 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 180/345] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jan 11 15:12:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 15:12:42.868552 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b73cc60c-3fc6-4b67-a34f-672c213bc6aa tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:42.869744 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b73cc60c-3fc6-4b67-a34f-672c213bc6aa tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:42.878142 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b73cc60c-3fc6-4b67-a34f-672c213bc6aa tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:42.878622 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b73cc60c-3fc6-4b67-a34f-672c213bc6aa tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:42.879901 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b73cc60c-3fc6-4b67-a34f-672c213bc6aa tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:42.880911 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b73cc60c-3fc6-4b67-a34f-672c213bc6aa tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:46.654099 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2ba49b3d-8297-47df-9e7a-b35daeeb2396 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 27900 microversion: 2.1 time: 4.433406 Jan 11 15:12:46.654741 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 166/346] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:42 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 27900 bytes in 4435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:12:46.659803 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-20b332e3-87d8-47db-a410-da42e7932bf0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:46.660439 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-20b332e3-87d8-47db-a410-da42e7932bf0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 5d8b8b19-117d-4669-933b-5f86257caff6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:46.663360 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b73cc60c-3fc6-4b67-a34f-672c213bc6aa tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28106 microversion: 2.20 time: 3.803825 Jan 11 15:12:46.667405 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 181/347] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:42 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28106 bytes in 3805 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:12:46.669628 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-9556fdff-a45e-40c7-a52f-9b0163ec1dac tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:46.669802 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-20b332e3-87d8-47db-a410-da42e7932bf0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:46.670278 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-20b332e3-87d8-47db-a410-da42e7932bf0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:46.670397 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-9556fdff-a45e-40c7-a52f-9b0163ec1dac tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:46.671085 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-20b332e3-87d8-47db-a410-da42e7932bf0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:46.671557 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-20b332e3-87d8-47db-a410-da42e7932bf0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:46.681612 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9556fdff-a45e-40c7-a52f-9b0163ec1dac tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:46.682457 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9556fdff-a45e-40c7-a52f-9b0163ec1dac tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:46.683311 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9556fdff-a45e-40c7-a52f-9b0163ec1dac tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:46.683757 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9556fdff-a45e-40c7-a52f-9b0163ec1dac tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:46.888090 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-9556fdff-a45e-40c7-a52f-9b0163ec1dac tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:46.896131 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-9556fdff-a45e-40c7-a52f-9b0163ec1dac tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.231000 Jan 11 15:12:46.905724 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-20b332e3-87d8-47db-a410-da42e7932bf0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:46.923784 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-20b332e3-87d8-47db-a410-da42e7932bf0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6" status: 200 len: 1318 microversion: 2.1 time: 0.255191 Jan 11 15:12:46.923784 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 167/348] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:46 2022] GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6 => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:46.924829 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 182/349] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:46 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:46.924829 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [req-75e44db0-fea6-41b0-bb4d-59b6a74ec358 req-796a7fe2-8b2d-4950-b3b8-06403e3a310f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d8b8b19-117d-4669-933b-5f86257caff6", "tag": "3ca6f955-8c4f-4a77-b65d-c28221580f8e"}]} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:46.924829 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:12:46.924829 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: warnings.warn(msg) Jan 11 15:12:46.925165 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d2602e0a-2ae0-4388-bda3-9e9eee8bcb5f tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:46.925165 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d2602e0a-2ae0-4388-bda3-9e9eee8bcb5f tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: 7ccfb598-d95c-4312-8c81-457b98804ce5] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:46.930649 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-75e44db0-fea6-41b0-bb4d-59b6a74ec358 req-796a7fe2-8b2d-4950-b3b8-06403e3a310f service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:46.931329 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-75e44db0-fea6-41b0-bb4d-59b6a74ec358 req-796a7fe2-8b2d-4950-b3b8-06403e3a310f service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:46.933547 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d2602e0a-2ae0-4388-bda3-9e9eee8bcb5f tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:46.934177 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d2602e0a-2ae0-4388-bda3-9e9eee8bcb5f tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:46.935255 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d2602e0a-2ae0-4388-bda3-9e9eee8bcb5f tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:46.935928 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d2602e0a-2ae0-4388-bda3-9e9eee8bcb5f tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:46.946716 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.compute.server_external_events [req-75e44db0-fea6-41b0-bb4d-59b6a74ec358 req-796a7fe2-8b2d-4950-b3b8-06403e3a310f service nova] Creating event network-changed:3ca6f955-8c4f-4a77-b65d-c28221580f8e for instance 5d8b8b19-117d-4669-933b-5f86257caff6 on hv-cinder-82418 Jan 11 15:12:46.951383 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [req-75e44db0-fea6-41b0-bb4d-59b6a74ec358 req-796a7fe2-8b2d-4950-b3b8-06403e3a310f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036477 Jan 11 15:12:46.952583 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 183/350] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:12:46.996455 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d2602e0a-2ae0-4388-bda3-9e9eee8bcb5f tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:47.003651 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d2602e0a-2ae0-4388-bda3-9e9eee8bcb5f tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5" status: 200 len: 1209 microversion: 2.1 time: 0.090830 Jan 11 15:12:47.004212 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 168/351] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:46 2022] GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5 => generated 1209 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:47.667413 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3cf63921-9d64-4b5f-a300-ebfd28a67316 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:47.669877 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3cf63921-9d64-4b5f-a300-ebfd28a67316 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:47.674514 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e0b19afc-1e4a-4380-a2fe-b6e88d3e2199 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:47.678097 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e0b19afc-1e4a-4380-a2fe-b6e88d3e2199 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:47.678210 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3cf63921-9d64-4b5f-a300-ebfd28a67316 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:47.678210 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3cf63921-9d64-4b5f-a300-ebfd28a67316 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:47.678210 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3cf63921-9d64-4b5f-a300-ebfd28a67316 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:47.678210 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3cf63921-9d64-4b5f-a300-ebfd28a67316 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:47.682754 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e0b19afc-1e4a-4380-a2fe-b6e88d3e2199 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:47.683217 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e0b19afc-1e4a-4380-a2fe-b6e88d3e2199 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:47.684200 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e0b19afc-1e4a-4380-a2fe-b6e88d3e2199 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:47.684732 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e0b19afc-1e4a-4380-a2fe-b6e88d3e2199 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:47.919611 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3cf63921-9d64-4b5f-a300-ebfd28a67316 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28079 microversion: 2.1 time: 0.257147 Jan 11 15:12:47.923529 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 184/352] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:47 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28079 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:12:47.926191 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e0b19afc-1e4a-4380-a2fe-b6e88d3e2199 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28106 microversion: 2.20 time: 0.254380 Jan 11 15:12:47.926191 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 169/353] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:47 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28106 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:12:47.930421 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-36f84a84-4d08-4fa3-a769-0bc57bc2d9a1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:47.931116 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-36f84a84-4d08-4fa3-a769-0bc57bc2d9a1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:47.935135 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-587be7a4-7b93-43f2-8bc1-d9cd0e6eaeac tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:47.935873 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-587be7a4-7b93-43f2-8bc1-d9cd0e6eaeac tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 5d8b8b19-117d-4669-933b-5f86257caff6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:47.938608 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-36f84a84-4d08-4fa3-a769-0bc57bc2d9a1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:47.939069 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-36f84a84-4d08-4fa3-a769-0bc57bc2d9a1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:47.939906 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-36f84a84-4d08-4fa3-a769-0bc57bc2d9a1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:47.940351 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-36f84a84-4d08-4fa3-a769-0bc57bc2d9a1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:47.943344 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-587be7a4-7b93-43f2-8bc1-d9cd0e6eaeac tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:47.943774 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-587be7a4-7b93-43f2-8bc1-d9cd0e6eaeac tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:47.944602 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-587be7a4-7b93-43f2-8bc1-d9cd0e6eaeac tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:47.945062 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-587be7a4-7b93-43f2-8bc1-d9cd0e6eaeac tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:48.160556 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-587be7a4-7b93-43f2-8bc1-d9cd0e6eaeac tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:48.164668 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-36f84a84-4d08-4fa3-a769-0bc57bc2d9a1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:48.167986 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-587be7a4-7b93-43f2-8bc1-d9cd0e6eaeac tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6" status: 200 len: 1318 microversion: 2.1 time: 0.236739 Jan 11 15:12:48.168574 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 170/354] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:47 2022] GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:48.182294 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8df06980-4e60-476c-b03b-3c23697f142c tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:48.182903 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8df06980-4e60-476c-b03b-3c23697f142c tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: 7ccfb598-d95c-4312-8c81-457b98804ce5] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:48.187070 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-36f84a84-4d08-4fa3-a769-0bc57bc2d9a1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.265165 Jan 11 15:12:48.187700 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 185/355] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:47 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:48.189574 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8df06980-4e60-476c-b03b-3c23697f142c tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:48.190216 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8df06980-4e60-476c-b03b-3c23697f142c tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:48.191130 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8df06980-4e60-476c-b03b-3c23697f142c tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:48.191561 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8df06980-4e60-476c-b03b-3c23697f142c tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:48.264560 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-8df06980-4e60-476c-b03b-3c23697f142c tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:48.272022 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8df06980-4e60-476c-b03b-3c23697f142c tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5" status: 200 len: 1265 microversion: 2.1 time: 0.093298 Jan 11 15:12:48.272592 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 171/356] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:48 2022] GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5 => generated 1265 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:48.932068 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7ccd12c2-6333-4ddf-bfa4-f473c3892294 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:48.932990 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7ccd12c2-6333-4ddf-bfa4-f473c3892294 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:48.937848 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8aff25d2-0602-4ca1-8e6c-0e21e846189a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:48.938763 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8aff25d2-0602-4ca1-8e6c-0e21e846189a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:48.939646 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7ccd12c2-6333-4ddf-bfa4-f473c3892294 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:48.940102 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7ccd12c2-6333-4ddf-bfa4-f473c3892294 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:48.940958 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7ccd12c2-6333-4ddf-bfa4-f473c3892294 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:48.941400 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7ccd12c2-6333-4ddf-bfa4-f473c3892294 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:48.944802 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8aff25d2-0602-4ca1-8e6c-0e21e846189a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:48.945253 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8aff25d2-0602-4ca1-8e6c-0e21e846189a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:48.946274 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8aff25d2-0602-4ca1-8e6c-0e21e846189a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:48.946718 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8aff25d2-0602-4ca1-8e6c-0e21e846189a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:49.075626 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8aff25d2-0602-4ca1-8e6c-0e21e846189a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28106 microversion: 2.20 time: 0.141314 Jan 11 15:12:49.079606 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 172/357] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:48 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28106 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:12:49.165594 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7ccd12c2-6333-4ddf-bfa4-f473c3892294 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28196 microversion: 2.1 time: 0.237779 Jan 11 15:12:49.166251 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 186/358] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:48 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28196 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:12:49.187515 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-57cd1644-d056-40b8-9cb9-2c869b2d34fa tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:49.189048 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-57cd1644-d056-40b8-9cb9-2c869b2d34fa tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 5d8b8b19-117d-4669-933b-5f86257caff6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:49.197902 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-57cd1644-d056-40b8-9cb9-2c869b2d34fa tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:49.199630 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-57cd1644-d056-40b8-9cb9-2c869b2d34fa tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:49.204487 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-57cd1644-d056-40b8-9cb9-2c869b2d34fa tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:49.205057 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-57cd1644-d056-40b8-9cb9-2c869b2d34fa tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:49.213624 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-465879ad-a36c-4ac3-a608-96377c5518b5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:49.214508 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-465879ad-a36c-4ac3-a608-96377c5518b5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:49.225932 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-465879ad-a36c-4ac3-a608-96377c5518b5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:49.227504 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-465879ad-a36c-4ac3-a608-96377c5518b5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:49.228569 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-465879ad-a36c-4ac3-a608-96377c5518b5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:49.229578 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-465879ad-a36c-4ac3-a608-96377c5518b5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:49.442760 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-57cd1644-d056-40b8-9cb9-2c869b2d34fa tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:49.455942 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-57cd1644-d056-40b8-9cb9-2c869b2d34fa tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6" status: 200 len: 1318 microversion: 2.1 time: 0.273417 Jan 11 15:12:49.457765 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 173/359] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:49 2022] GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6 => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:49.460179 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-465879ad-a36c-4ac3-a608-96377c5518b5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:49.465057 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1c65e919-beb2-49c9-9db8-c28f81492aeb tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:49.465938 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1c65e919-beb2-49c9-9db8-c28f81492aeb tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: 7ccfb598-d95c-4312-8c81-457b98804ce5] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:49.469309 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-465879ad-a36c-4ac3-a608-96377c5518b5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.263568 Jan 11 15:12:49.476496 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 187/360] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:49 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:49.476676 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1c65e919-beb2-49c9-9db8-c28f81492aeb tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:49.476676 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1c65e919-beb2-49c9-9db8-c28f81492aeb tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:49.476676 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1c65e919-beb2-49c9-9db8-c28f81492aeb tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:49.476676 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1c65e919-beb2-49c9-9db8-c28f81492aeb tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:49.549482 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1c65e919-beb2-49c9-9db8-c28f81492aeb tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:49.559035 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1c65e919-beb2-49c9-9db8-c28f81492aeb tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5" status: 200 len: 1283 microversion: 2.1 time: 0.099927 Jan 11 15:12:49.560118 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 174/361] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:49 2022] GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5 => generated 1283 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:50.087206 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-133809ed-3fc3-42a5-bdf9-63acce3e9fce tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:50.088711 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-133809ed-3fc3-42a5-bdf9-63acce3e9fce tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:50.096063 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-133809ed-3fc3-42a5-bdf9-63acce3e9fce tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:50.096519 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-133809ed-3fc3-42a5-bdf9-63acce3e9fce tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:50.097321 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-133809ed-3fc3-42a5-bdf9-63acce3e9fce tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:50.097925 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-133809ed-3fc3-42a5-bdf9-63acce3e9fce tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:50.178878 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9004bd83-ab5d-4184-9098-82b4e3a27bc2 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:50.180431 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9004bd83-ab5d-4184-9098-82b4e3a27bc2 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:50.186763 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9004bd83-ab5d-4184-9098-82b4e3a27bc2 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:50.187214 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9004bd83-ab5d-4184-9098-82b4e3a27bc2 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:50.188049 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9004bd83-ab5d-4184-9098-82b4e3a27bc2 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:50.188492 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9004bd83-ab5d-4184-9098-82b4e3a27bc2 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:50.353659 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-133809ed-3fc3-42a5-bdf9-63acce3e9fce tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28106 microversion: 2.20 time: 0.270040 Jan 11 15:12:50.356335 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 188/362] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:50 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28106 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:12:50.358206 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9004bd83-ab5d-4184-9098-82b4e3a27bc2 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28196 microversion: 2.1 time: 0.183641 Jan 11 15:12:50.358870 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 175/363] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:50 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28196 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:12:50.475100 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b644cf16-d272-47c6-a2fb-3c99d296c638 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:50.476028 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b644cf16-d272-47c6-a2fb-3c99d296c638 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 5d8b8b19-117d-4669-933b-5f86257caff6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:50.487526 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-08cb31ea-a299-48a3-a5c7-655f8d9637f8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:50.488523 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-08cb31ea-a299-48a3-a5c7-655f8d9637f8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:50.496220 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b644cf16-d272-47c6-a2fb-3c99d296c638 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:50.496664 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b644cf16-d272-47c6-a2fb-3c99d296c638 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:50.514879 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-08cb31ea-a299-48a3-a5c7-655f8d9637f8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:50.515609 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-08cb31ea-a299-48a3-a5c7-655f8d9637f8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:50.518718 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b644cf16-d272-47c6-a2fb-3c99d296c638 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:50.519493 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-08cb31ea-a299-48a3-a5c7-655f8d9637f8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:50.520192 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b644cf16-d272-47c6-a2fb-3c99d296c638 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:50.520902 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-08cb31ea-a299-48a3-a5c7-655f8d9637f8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:50.952584 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-b644cf16-d272-47c6-a2fb-3c99d296c638 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:50.960714 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-08cb31ea-a299-48a3-a5c7-655f8d9637f8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:50.961480 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b644cf16-d272-47c6-a2fb-3c99d296c638 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6" status: 200 len: 1318 microversion: 2.1 time: 0.488809 Jan 11 15:12:50.961480 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 189/364] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:50 2022] GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6 => generated 1318 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:50.966051 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-df94bf22-34f1-4661-afb3-3f9006f6e394 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:50.971918 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-df94bf22-34f1-4661-afb3-3f9006f6e394 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: 7ccfb598-d95c-4312-8c81-457b98804ce5] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:50.972701 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-df94bf22-34f1-4661-afb3-3f9006f6e394 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:50.973132 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-df94bf22-34f1-4661-afb3-3f9006f6e394 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:50.973927 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-df94bf22-34f1-4661-afb3-3f9006f6e394 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:50.974381 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-df94bf22-34f1-4661-afb3-3f9006f6e394 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:50.977991 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-08cb31ea-a299-48a3-a5c7-655f8d9637f8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.495121 Jan 11 15:12:50.978567 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 176/365] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:50 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:12:50.984506 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-4410f975-e6fc-4ed6-86c3-59a3fa00d74e req-732121c6-fa5e-4520-935c-76bc9012d241 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ccfb598-d95c-4312-8c81-457b98804ce5", "tag": "f9687aef-ab44-4d69-a169-382a09e4d697"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:50.986007 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:12:50.986007 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:12:50.996039 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-4410f975-e6fc-4ed6-86c3-59a3fa00d74e req-732121c6-fa5e-4520-935c-76bc9012d241 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:50.996542 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-4410f975-e6fc-4ed6-86c3-59a3fa00d74e req-732121c6-fa5e-4520-935c-76bc9012d241 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:51.022925 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-4410f975-e6fc-4ed6-86c3-59a3fa00d74e req-732121c6-fa5e-4520-935c-76bc9012d241 service nova] Creating event network-changed:f9687aef-ab44-4d69-a169-382a09e4d697 for instance 7ccfb598-d95c-4312-8c81-457b98804ce5 on hv-cinder-82418 Jan 11 15:12:51.022925 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [req-4410f975-e6fc-4ed6-86c3-59a3fa00d74e req-732121c6-fa5e-4520-935c-76bc9012d241 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032874 Jan 11 15:12:51.022925 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 177/366] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:12:51.112122 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-df94bf22-34f1-4661-afb3-3f9006f6e394 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:51.119768 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-df94bf22-34f1-4661-afb3-3f9006f6e394 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5" status: 200 len: 1313 microversion: 2.1 time: 0.157429 Jan 11 15:12:51.120325 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 190/367] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:50 2022] GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:51.366600 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6176b053-4b22-407b-a925-ecbcfa1a3c9b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:51.368029 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6176b053-4b22-407b-a925-ecbcfa1a3c9b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:51.369983 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c55c4acf-839b-44fd-8d39-f1417b3e8930 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:51.370973 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c55c4acf-839b-44fd-8d39-f1417b3e8930 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:51.374255 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6176b053-4b22-407b-a925-ecbcfa1a3c9b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:51.374705 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6176b053-4b22-407b-a925-ecbcfa1a3c9b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:51.375520 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6176b053-4b22-407b-a925-ecbcfa1a3c9b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:51.375957 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6176b053-4b22-407b-a925-ecbcfa1a3c9b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:51.376645 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c55c4acf-839b-44fd-8d39-f1417b3e8930 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:51.377088 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c55c4acf-839b-44fd-8d39-f1417b3e8930 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:51.377952 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c55c4acf-839b-44fd-8d39-f1417b3e8930 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:51.378387 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c55c4acf-839b-44fd-8d39-f1417b3e8930 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:55.119091 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c55c4acf-839b-44fd-8d39-f1417b3e8930 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28196 microversion: 2.1 time: 3.752989 Jan 11 15:12:55.121469 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 191/368] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:51 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28196 bytes in 3756 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:12:55.122809 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6176b053-4b22-407b-a925-ecbcfa1a3c9b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28106 microversion: 2.20 time: 3.760594 Jan 11 15:12:55.127251 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 178/369] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:51 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28106 bytes in 3763 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:12:55.127436 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-39cb8e0b-796a-4435-b8b5-f27b91a2ba09 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:55.127525 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-39cb8e0b-796a-4435-b8b5-f27b91a2ba09 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 5d8b8b19-117d-4669-933b-5f86257caff6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:55.134379 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-fb49bc01-0f03-4f4b-a543-d027608ee0c6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:55.135502 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-fb49bc01-0f03-4f4b-a543-d027608ee0c6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:55.140596 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-39cb8e0b-796a-4435-b8b5-f27b91a2ba09 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:55.141374 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-39cb8e0b-796a-4435-b8b5-f27b91a2ba09 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:55.142400 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-39cb8e0b-796a-4435-b8b5-f27b91a2ba09 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:55.142856 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-39cb8e0b-796a-4435-b8b5-f27b91a2ba09 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:55.144646 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fb49bc01-0f03-4f4b-a543-d027608ee0c6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:55.144976 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fb49bc01-0f03-4f4b-a543-d027608ee0c6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:55.145765 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fb49bc01-0f03-4f4b-a543-d027608ee0c6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:55.146197 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fb49bc01-0f03-4f4b-a543-d027608ee0c6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:55.359912 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-fb49bc01-0f03-4f4b-a543-d027608ee0c6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:55.364282 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-39cb8e0b-796a-4435-b8b5-f27b91a2ba09 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:55.368089 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-fb49bc01-0f03-4f4b-a543-d027608ee0c6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.237929 Jan 11 15:12:55.369911 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 179/370] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:55 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:55.371976 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-39cb8e0b-796a-4435-b8b5-f27b91a2ba09 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6" status: 200 len: 1318 microversion: 2.1 time: 0.249902 Jan 11 15:12:55.372689 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 192/371] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:55 2022] GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:55.374866 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b33ef5df-d813-48ea-abe0-102644559957 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:55.375511 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b33ef5df-d813-48ea-abe0-102644559957 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: 7ccfb598-d95c-4312-8c81-457b98804ce5] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:55.381768 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b33ef5df-d813-48ea-abe0-102644559957 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:55.382224 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b33ef5df-d813-48ea-abe0-102644559957 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:55.383715 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b33ef5df-d813-48ea-abe0-102644559957 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:55.384190 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b33ef5df-d813-48ea-abe0-102644559957 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:55.510083 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b33ef5df-d813-48ea-abe0-102644559957 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:55.517206 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b33ef5df-d813-48ea-abe0-102644559957 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5" status: 200 len: 1313 microversion: 2.1 time: 0.146199 Jan 11 15:12:55.517771 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 180/372] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:55 2022] GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:56.132011 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d5454705-27a8-4ee5-8c41-17ad80bc2c7f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:56.132922 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d5454705-27a8-4ee5-8c41-17ad80bc2c7f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:56.133851 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-04959e07-bee2-48df-b4d3-ba318cbda752 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:56.134824 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-04959e07-bee2-48df-b4d3-ba318cbda752 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:56.139348 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d5454705-27a8-4ee5-8c41-17ad80bc2c7f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:56.139798 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d5454705-27a8-4ee5-8c41-17ad80bc2c7f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:56.140765 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d5454705-27a8-4ee5-8c41-17ad80bc2c7f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:56.141205 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d5454705-27a8-4ee5-8c41-17ad80bc2c7f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:56.141430 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-04959e07-bee2-48df-b4d3-ba318cbda752 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:56.141886 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-04959e07-bee2-48df-b4d3-ba318cbda752 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:56.142672 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-04959e07-bee2-48df-b4d3-ba318cbda752 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:56.143118 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-04959e07-bee2-48df-b4d3-ba318cbda752 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:56.215768 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d5454705-27a8-4ee5-8c41-17ad80bc2c7f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28196 microversion: 2.1 time: 0.084474 Jan 11 15:12:56.219318 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 193/373] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:56 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28196 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:12:56.240235 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-04959e07-bee2-48df-b4d3-ba318cbda752 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28106 microversion: 2.20 time: 0.109921 Jan 11 15:12:56.241015 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 181/374] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:56 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28106 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:12:56.385800 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b02a317c-13a7-40b9-9e42-0b72cb16e435 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:56.386595 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b02a317c-13a7-40b9-9e42-0b72cb16e435 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:56.393616 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b02a317c-13a7-40b9-9e42-0b72cb16e435 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:56.394109 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b02a317c-13a7-40b9-9e42-0b72cb16e435 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:56.394885 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b02a317c-13a7-40b9-9e42-0b72cb16e435 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:56.395396 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b02a317c-13a7-40b9-9e42-0b72cb16e435 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:56.399332 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3404c1ec-34a2-4db0-aff9-1b9e3c632105 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:56.400983 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3404c1ec-34a2-4db0-aff9-1b9e3c632105 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 5d8b8b19-117d-4669-933b-5f86257caff6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:56.407582 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3404c1ec-34a2-4db0-aff9-1b9e3c632105 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:56.408098 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3404c1ec-34a2-4db0-aff9-1b9e3c632105 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:56.408897 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3404c1ec-34a2-4db0-aff9-1b9e3c632105 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:56.409338 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3404c1ec-34a2-4db0-aff9-1b9e3c632105 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:56.604428 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-b02a317c-13a7-40b9-9e42-0b72cb16e435 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:56.608780 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3404c1ec-34a2-4db0-aff9-1b9e3c632105 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:56.612948 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b02a317c-13a7-40b9-9e42-0b72cb16e435 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.231644 Jan 11 15:12:56.613691 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 194/375] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:56 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:56.618656 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7bf16c49-ac35-402c-86b1-de7610ba48d2 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:12:56.619271 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7bf16c49-ac35-402c-86b1-de7610ba48d2 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: 7ccfb598-d95c-4312-8c81-457b98804ce5] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:56.620284 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3404c1ec-34a2-4db0-aff9-1b9e3c632105 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6" status: 200 len: 1318 microversion: 2.1 time: 0.234499 Jan 11 15:12:56.621031 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 182/376] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:56 2022] GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:56.630114 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7bf16c49-ac35-402c-86b1-de7610ba48d2 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:56.630630 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7bf16c49-ac35-402c-86b1-de7610ba48d2 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:56.631455 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7bf16c49-ac35-402c-86b1-de7610ba48d2 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:56.631898 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7bf16c49-ac35-402c-86b1-de7610ba48d2 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:56.759846 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-7bf16c49-ac35-402c-86b1-de7610ba48d2 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:12:56.766940 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7bf16c49-ac35-402c-86b1-de7610ba48d2 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5" status: 200 len: 1313 microversion: 2.1 time: 0.152565 Jan 11 15:12:56.767533 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 195/377] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:12:56 2022] GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:12:57.227344 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9c1c2d23-af39-4b34-9a2d-72571e525c3f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:57.228267 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9c1c2d23-af39-4b34-9a2d-72571e525c3f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:57.234588 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9c1c2d23-af39-4b34-9a2d-72571e525c3f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:57.235040 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9c1c2d23-af39-4b34-9a2d-72571e525c3f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:57.238387 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9c1c2d23-af39-4b34-9a2d-72571e525c3f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:57.238387 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9c1c2d23-af39-4b34-9a2d-72571e525c3f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:57.252482 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d87bc3ce-aa7d-4851-a28e-5e0269f39686 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:12:57.253540 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d87bc3ce-aa7d-4851-a28e-5e0269f39686 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:12:57.260774 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d87bc3ce-aa7d-4851-a28e-5e0269f39686 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:57.261311 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d87bc3ce-aa7d-4851-a28e-5e0269f39686 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:12:57.262145 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d87bc3ce-aa7d-4851-a28e-5e0269f39686 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:12:57.262653 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d87bc3ce-aa7d-4851-a28e-5e0269f39686 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:01.641107 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d87bc3ce-aa7d-4851-a28e-5e0269f39686 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28106 microversion: 2.20 time: 4.392047 Jan 11 15:13:01.642135 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 196/378] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:12:57 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28106 bytes in 4394 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:13:01.647409 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e764bbbf-bf84-437e-9922-04b9dd59e44e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:01.648106 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e764bbbf-bf84-437e-9922-04b9dd59e44e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:01.655225 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e764bbbf-bf84-437e-9922-04b9dd59e44e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:01.655500 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e764bbbf-bf84-437e-9922-04b9dd59e44e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:01.656289 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e764bbbf-bf84-437e-9922-04b9dd59e44e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:01.656726 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e764bbbf-bf84-437e-9922-04b9dd59e44e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:01.658638 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9c1c2d23-af39-4b34-9a2d-72571e525c3f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28196 microversion: 2.1 time: 4.435413 Jan 11 15:13:01.660542 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 183/379] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:12:57 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28196 bytes in 4437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:13:01.665711 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f1e2d3d1-b617-4c12-838d-996109379f89 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:01.666573 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f1e2d3d1-b617-4c12-838d-996109379f89 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 5d8b8b19-117d-4669-933b-5f86257caff6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:01.677401 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f1e2d3d1-b617-4c12-838d-996109379f89 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:01.677836 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f1e2d3d1-b617-4c12-838d-996109379f89 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:01.678619 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f1e2d3d1-b617-4c12-838d-996109379f89 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:01.679113 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f1e2d3d1-b617-4c12-838d-996109379f89 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:01.890721 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f1e2d3d1-b617-4c12-838d-996109379f89 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:01.899915 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f1e2d3d1-b617-4c12-838d-996109379f89 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6" status: 200 len: 1318 microversion: 2.1 time: 0.238673 Jan 11 15:13:01.909494 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 184/380] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:01 2022] GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:01.914563 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-e764bbbf-bf84-437e-9922-04b9dd59e44e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:01.915846 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-86e8f419-d121-49e9-974d-ade799a9aa0b tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:01.916699 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-86e8f419-d121-49e9-974d-ade799a9aa0b tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: 7ccfb598-d95c-4312-8c81-457b98804ce5] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:01.924804 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-86e8f419-d121-49e9-974d-ade799a9aa0b tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:01.926754 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-86e8f419-d121-49e9-974d-ade799a9aa0b tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:01.926896 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e764bbbf-bf84-437e-9922-04b9dd59e44e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.282409 Jan 11 15:13:01.926986 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-86e8f419-d121-49e9-974d-ade799a9aa0b tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:01.927061 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 197/381] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:01 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:01.927140 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-86e8f419-d121-49e9-974d-ade799a9aa0b tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:02.059409 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-86e8f419-d121-49e9-974d-ade799a9aa0b tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:02.066691 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-86e8f419-d121-49e9-974d-ade799a9aa0b tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5" status: 200 len: 1313 microversion: 2.1 time: 0.155764 Jan 11 15:13:02.067255 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 185/382] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:01 2022] GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:02.652844 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f09a5341-8d7e-46dc-9ef7-dbb0e7e4e2c6 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:02.653758 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f09a5341-8d7e-46dc-9ef7-dbb0e7e4e2c6 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:02.660216 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f09a5341-8d7e-46dc-9ef7-dbb0e7e4e2c6 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:02.660663 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f09a5341-8d7e-46dc-9ef7-dbb0e7e4e2c6 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:02.661442 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f09a5341-8d7e-46dc-9ef7-dbb0e7e4e2c6 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:02.661886 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f09a5341-8d7e-46dc-9ef7-dbb0e7e4e2c6 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:02.680748 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c33f68c1-870a-40ca-958c-a542dc9ba6f0 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:02.681898 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c33f68c1-870a-40ca-958c-a542dc9ba6f0 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:02.688310 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c33f68c1-870a-40ca-958c-a542dc9ba6f0 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:02.689589 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c33f68c1-870a-40ca-958c-a542dc9ba6f0 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:02.690458 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c33f68c1-870a-40ca-958c-a542dc9ba6f0 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:02.690904 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c33f68c1-870a-40ca-958c-a542dc9ba6f0 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:02.893220 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c33f68c1-870a-40ca-958c-a542dc9ba6f0 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28196 microversion: 2.1 time: 0.216245 Jan 11 15:13:02.893791 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 186/383] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:02 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28196 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:13:02.896954 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f09a5341-8d7e-46dc-9ef7-dbb0e7e4e2c6 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28106 microversion: 2.20 time: 0.247823 Jan 11 15:13:02.897583 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 198/384] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:13:02 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28106 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:13:02.916683 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-868b2900-e570-47c5-871b-6503b86af9b4 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:02.917370 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-868b2900-e570-47c5-871b-6503b86af9b4 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 5d8b8b19-117d-4669-933b-5f86257caff6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:02.924275 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-868b2900-e570-47c5-871b-6503b86af9b4 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:02.924724 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-868b2900-e570-47c5-871b-6503b86af9b4 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:02.925496 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-868b2900-e570-47c5-871b-6503b86af9b4 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:02.925935 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-868b2900-e570-47c5-871b-6503b86af9b4 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:02.941986 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-787ea1fe-a26d-43ff-aab9-0aeb145407c7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:02.942718 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-787ea1fe-a26d-43ff-aab9-0aeb145407c7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:02.950491 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-787ea1fe-a26d-43ff-aab9-0aeb145407c7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:02.950943 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-787ea1fe-a26d-43ff-aab9-0aeb145407c7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:02.951761 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-787ea1fe-a26d-43ff-aab9-0aeb145407c7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:02.952203 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-787ea1fe-a26d-43ff-aab9-0aeb145407c7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:03.126350 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-868b2900-e570-47c5-871b-6503b86af9b4 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:03.129543 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-787ea1fe-a26d-43ff-aab9-0aeb145407c7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:03.134102 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-868b2900-e570-47c5-871b-6503b86af9b4 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6" status: 200 len: 1318 microversion: 2.1 time: 0.221161 Jan 11 15:13:03.135015 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 187/385] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:02 2022] GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:03.136720 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-787ea1fe-a26d-43ff-aab9-0aeb145407c7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1521 microversion: 2.1 time: 0.198601 Jan 11 15:13:03.137273 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 199/386] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:02 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:13:03.139801 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2bcc4301-7cc9-4645-a4b2-cded01a2504f tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:03.140466 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2bcc4301-7cc9-4645-a4b2-cded01a2504f tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: 7ccfb598-d95c-4312-8c81-457b98804ce5] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:03.146531 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2bcc4301-7cc9-4645-a4b2-cded01a2504f tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:03.150999 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2bcc4301-7cc9-4645-a4b2-cded01a2504f tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:03.151872 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2bcc4301-7cc9-4645-a4b2-cded01a2504f tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:03.152328 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2bcc4301-7cc9-4645-a4b2-cded01a2504f tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:03.298558 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-2bcc4301-7cc9-4645-a4b2-cded01a2504f tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:03.298975 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2bcc4301-7cc9-4645-a4b2-cded01a2504f tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5" status: 200 len: 1313 microversion: 2.1 time: 0.162771 Jan 11 15:13:03.299583 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 188/387] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:03 2022] GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:03.910316 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4e0394b3-37bd-4cb5-8a53-e2eee4f4433e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:03.910316 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4e0394b3-37bd-4cb5-8a53-e2eee4f4433e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:03.910844 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f769ad9d-374d-40d3-ac2e-2b52ee430087 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:03.910844 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f769ad9d-374d-40d3-ac2e-2b52ee430087 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:03.912301 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4e0394b3-37bd-4cb5-8a53-e2eee4f4433e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:03.912748 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4e0394b3-37bd-4cb5-8a53-e2eee4f4433e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:03.913580 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4e0394b3-37bd-4cb5-8a53-e2eee4f4433e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:03.914230 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4e0394b3-37bd-4cb5-8a53-e2eee4f4433e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:03.915156 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f769ad9d-374d-40d3-ac2e-2b52ee430087 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:03.915641 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f769ad9d-374d-40d3-ac2e-2b52ee430087 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:03.916485 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f769ad9d-374d-40d3-ac2e-2b52ee430087 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:03.916903 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f769ad9d-374d-40d3-ac2e-2b52ee430087 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:08.320432 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f769ad9d-374d-40d3-ac2e-2b52ee430087 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28106 microversion: 2.20 time: 4.415221 Jan 11 15:13:08.321093 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 189/388] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:13:03 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28106 bytes in 4417 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:13:08.323075 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4e0394b3-37bd-4cb5-8a53-e2eee4f4433e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28196 microversion: 2.1 time: 4.421613 Jan 11 15:13:08.327325 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 200/389] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:03 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28196 bytes in 4423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:13:08.327485 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1936f555-7da3-44fa-8ebc-9b412fa8adc8 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:08.327485 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1936f555-7da3-44fa-8ebc-9b412fa8adc8 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 5d8b8b19-117d-4669-933b-5f86257caff6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:08.329917 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-367d43e8-e9d6-4b12-a2ee-f1bf8eb3aa80 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:08.331200 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-367d43e8-e9d6-4b12-a2ee-f1bf8eb3aa80 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:08.334067 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1936f555-7da3-44fa-8ebc-9b412fa8adc8 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:08.334518 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1936f555-7da3-44fa-8ebc-9b412fa8adc8 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:08.336002 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1936f555-7da3-44fa-8ebc-9b412fa8adc8 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:08.336450 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1936f555-7da3-44fa-8ebc-9b412fa8adc8 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:08.342115 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-367d43e8-e9d6-4b12-a2ee-f1bf8eb3aa80 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:08.342560 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-367d43e8-e9d6-4b12-a2ee-f1bf8eb3aa80 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:08.343386 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-367d43e8-e9d6-4b12-a2ee-f1bf8eb3aa80 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:08.343827 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-367d43e8-e9d6-4b12-a2ee-f1bf8eb3aa80 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:08.547145 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1936f555-7da3-44fa-8ebc-9b412fa8adc8 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:08.554669 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-367d43e8-e9d6-4b12-a2ee-f1bf8eb3aa80 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:08.555027 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1936f555-7da3-44fa-8ebc-9b412fa8adc8 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6" status: 200 len: 1318 microversion: 2.1 time: 0.232822 Jan 11 15:13:08.555802 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 190/390] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:08 2022] GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:08.560952 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8ff520e1-5ed4-4204-a81f-09978f5cb7d5 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:08.561555 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8ff520e1-5ed4-4204-a81f-09978f5cb7d5 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: 7ccfb598-d95c-4312-8c81-457b98804ce5] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:08.562463 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-367d43e8-e9d6-4b12-a2ee-f1bf8eb3aa80 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1501 microversion: 2.1 time: 0.237524 Jan 11 15:13:08.563318 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 201/391] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:08 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1501 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:08.571973 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8ff520e1-5ed4-4204-a81f-09978f5cb7d5 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:08.572427 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8ff520e1-5ed4-4204-a81f-09978f5cb7d5 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:08.573218 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8ff520e1-5ed4-4204-a81f-09978f5cb7d5 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:08.573905 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8ff520e1-5ed4-4204-a81f-09978f5cb7d5 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:08.579052 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e13b0328-f3a4-4fbc-ac50-7ba0ac1e38d1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:08.579691 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e13b0328-f3a4-4fbc-ac50-7ba0ac1e38d1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:08.585678 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e13b0328-f3a4-4fbc-ac50-7ba0ac1e38d1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:08.586132 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e13b0328-f3a4-4fbc-ac50-7ba0ac1e38d1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:08.586918 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e13b0328-f3a4-4fbc-ac50-7ba0ac1e38d1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:08.587382 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e13b0328-f3a4-4fbc-ac50-7ba0ac1e38d1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:08.768532 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-8ff520e1-5ed4-4204-a81f-09978f5cb7d5 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:08.775762 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-e13b0328-f3a4-4fbc-ac50-7ba0ac1e38d1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:08.776485 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8ff520e1-5ed4-4204-a81f-09978f5cb7d5 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5" status: 200 len: 1313 microversion: 2.1 time: 0.219760 Jan 11 15:13:08.777134 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 191/392] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:08 2022] GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:08.788494 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e13b0328-f3a4-4fbc-ac50-7ba0ac1e38d1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1516 microversion: 2.1 time: 0.212900 Jan 11 15:13:08.789061 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 202/393] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:08 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1516 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:09.332079 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-03867fdc-a921-4286-bb29-31e3eed2c4fa tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:09.333125 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-03867fdc-a921-4286-bb29-31e3eed2c4fa tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:09.333747 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-55aef0e5-7d53-4367-9e3d-00f30c575d81 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:09.334655 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-55aef0e5-7d53-4367-9e3d-00f30c575d81 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:09.340249 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-03867fdc-a921-4286-bb29-31e3eed2c4fa tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:09.340704 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-03867fdc-a921-4286-bb29-31e3eed2c4fa tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:09.341489 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-03867fdc-a921-4286-bb29-31e3eed2c4fa tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:09.341585 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-55aef0e5-7d53-4367-9e3d-00f30c575d81 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:09.341931 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-03867fdc-a921-4286-bb29-31e3eed2c4fa tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:09.342039 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-55aef0e5-7d53-4367-9e3d-00f30c575d81 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:09.342734 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-55aef0e5-7d53-4367-9e3d-00f30c575d81 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:09.343166 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-55aef0e5-7d53-4367-9e3d-00f30c575d81 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:09.473120 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-03867fdc-a921-4286-bb29-31e3eed2c4fa tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28106 microversion: 2.20 time: 0.144544 Jan 11 15:13:09.473759 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 192/394] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:13:09 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28106 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:13:09.486284 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-55aef0e5-7d53-4367-9e3d-00f30c575d81 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28196 microversion: 2.1 time: 0.155913 Jan 11 15:13:09.486926 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 203/395] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:09 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28196 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:13:09.572598 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-12610116-efb1-4e91-bf4c-7b3c8bcc1eca tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:09.573301 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-12610116-efb1-4e91-bf4c-7b3c8bcc1eca tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 5d8b8b19-117d-4669-933b-5f86257caff6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:09.580161 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-12610116-efb1-4e91-bf4c-7b3c8bcc1eca tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:09.580613 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-12610116-efb1-4e91-bf4c-7b3c8bcc1eca tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:09.581395 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-12610116-efb1-4e91-bf4c-7b3c8bcc1eca tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:09.581838 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-12610116-efb1-4e91-bf4c-7b3c8bcc1eca tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:09.714290 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-12610116-efb1-4e91-bf4c-7b3c8bcc1eca tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:09.722045 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-12610116-efb1-4e91-bf4c-7b3c8bcc1eca tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6" status: 200 len: 1318 microversion: 2.1 time: 0.153525 Jan 11 15:13:09.722601 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 193/396] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:09 2022] GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:09.794559 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-50f46e23-5c7d-4a24-bd61-90a6f9c5bb58 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:09.795360 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-50f46e23-5c7d-4a24-bd61-90a6f9c5bb58 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: 7ccfb598-d95c-4312-8c81-457b98804ce5] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:09.803662 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-50f46e23-5c7d-4a24-bd61-90a6f9c5bb58 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:09.804200 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-50f46e23-5c7d-4a24-bd61-90a6f9c5bb58 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:09.805221 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-50f46e23-5c7d-4a24-bd61-90a6f9c5bb58 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:09.805749 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-50f46e23-5c7d-4a24-bd61-90a6f9c5bb58 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:09.935312 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-50f46e23-5c7d-4a24-bd61-90a6f9c5bb58 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:09.943162 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-50f46e23-5c7d-4a24-bd61-90a6f9c5bb58 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5" status: 200 len: 1313 microversion: 2.1 time: 0.153643 Jan 11 15:13:09.943771 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 204/397] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:09 2022] GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:10.485603 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a9e680b1-08fc-48c3-b20a-538b0a303c9f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:10.486509 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a9e680b1-08fc-48c3-b20a-538b0a303c9f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:10.493271 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a9e680b1-08fc-48c3-b20a-538b0a303c9f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:10.493726 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a9e680b1-08fc-48c3-b20a-538b0a303c9f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:10.494509 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a9e680b1-08fc-48c3-b20a-538b0a303c9f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:10.494948 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a9e680b1-08fc-48c3-b20a-538b0a303c9f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:10.498199 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-57c36ee1-752a-4a07-9afa-113faaddd4dc tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:10.499107 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-57c36ee1-752a-4a07-9afa-113faaddd4dc tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:10.505304 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-57c36ee1-752a-4a07-9afa-113faaddd4dc tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:10.505754 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-57c36ee1-752a-4a07-9afa-113faaddd4dc tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:10.506528 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-57c36ee1-752a-4a07-9afa-113faaddd4dc tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:10.506961 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-57c36ee1-752a-4a07-9afa-113faaddd4dc tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:10.564790 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a9e680b1-08fc-48c3-b20a-538b0a303c9f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28106 microversion: 2.20 time: 0.082760 Jan 11 15:13:10.565448 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 194/398] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:13:10 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28106 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:13:10.597293 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-57c36ee1-752a-4a07-9afa-113faaddd4dc tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28196 microversion: 2.1 time: 0.102508 Jan 11 15:13:10.597943 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 205/399] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:10 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28196 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:13:10.738172 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6ab06ae3-b117-40e9-91bf-d76338d743ab tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:10.738860 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6ab06ae3-b117-40e9-91bf-d76338d743ab tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 5d8b8b19-117d-4669-933b-5f86257caff6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:10.746272 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6ab06ae3-b117-40e9-91bf-d76338d743ab tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:10.746714 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6ab06ae3-b117-40e9-91bf-d76338d743ab tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:10.747512 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6ab06ae3-b117-40e9-91bf-d76338d743ab tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:10.747948 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6ab06ae3-b117-40e9-91bf-d76338d743ab tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:10.880726 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6ab06ae3-b117-40e9-91bf-d76338d743ab tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:10.887910 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6ab06ae3-b117-40e9-91bf-d76338d743ab tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6" status: 200 len: 1318 microversion: 2.1 time: 0.153773 Jan 11 15:13:10.888485 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 195/400] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:10 2022] GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:10.961263 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-25462872-e743-424e-8431-f56c9b094ae0 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:10.961954 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-25462872-e743-424e-8431-f56c9b094ae0 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: 7ccfb598-d95c-4312-8c81-457b98804ce5] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:10.969097 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-25462872-e743-424e-8431-f56c9b094ae0 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:10.969546 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-25462872-e743-424e-8431-f56c9b094ae0 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:10.970311 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-25462872-e743-424e-8431-f56c9b094ae0 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:10.970743 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-25462872-e743-424e-8431-f56c9b094ae0 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:11.101815 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-25462872-e743-424e-8431-f56c9b094ae0 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:11.109521 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-25462872-e743-424e-8431-f56c9b094ae0 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5" status: 200 len: 1313 microversion: 2.1 time: 0.152813 Jan 11 15:13:11.110067 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 206/401] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:10 2022] GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:11.576135 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b4a1f459-17ad-4da4-9ed6-09a7e7c1a072 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:11.577089 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b4a1f459-17ad-4da4-9ed6-09a7e7c1a072 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:11.583250 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b4a1f459-17ad-4da4-9ed6-09a7e7c1a072 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:11.583901 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b4a1f459-17ad-4da4-9ed6-09a7e7c1a072 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:11.584686 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b4a1f459-17ad-4da4-9ed6-09a7e7c1a072 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:11.585662 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b4a1f459-17ad-4da4-9ed6-09a7e7c1a072 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:11.609613 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-40103201-97e1-4957-a01c-3308b8764a57 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:11.610648 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-40103201-97e1-4957-a01c-3308b8764a57 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:11.618429 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-40103201-97e1-4957-a01c-3308b8764a57 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:11.618886 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-40103201-97e1-4957-a01c-3308b8764a57 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:11.619721 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-40103201-97e1-4957-a01c-3308b8764a57 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:11.620161 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-40103201-97e1-4957-a01c-3308b8764a57 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:14.821375 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b4a1f459-17ad-4da4-9ed6-09a7e7c1a072 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28106 microversion: 2.20 time: 3.248626 Jan 11 15:13:14.822020 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 196/402] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:13:11 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28106 bytes in 3250 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:13:14.825181 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-40103201-97e1-4957-a01c-3308b8764a57 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28196 microversion: 2.1 time: 3.219346 Jan 11 15:13:14.826008 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 207/403] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:11 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28196 bytes in 3221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:13:14.830337 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c8af452c-1463-4046-866b-cd255a13be9c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:14.830806 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-34aa1651-709c-43d6-9b5d-2033897c5987 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:14.831360 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c8af452c-1463-4046-866b-cd255a13be9c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:14.831532 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-34aa1651-709c-43d6-9b5d-2033897c5987 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 5d8b8b19-117d-4669-933b-5f86257caff6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:14.838447 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c8af452c-1463-4046-866b-cd255a13be9c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:14.838612 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-34aa1651-709c-43d6-9b5d-2033897c5987 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:14.838887 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c8af452c-1463-4046-866b-cd255a13be9c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:14.839033 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-34aa1651-709c-43d6-9b5d-2033897c5987 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:14.839684 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c8af452c-1463-4046-866b-cd255a13be9c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:14.839841 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-34aa1651-709c-43d6-9b5d-2033897c5987 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:14.840117 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c8af452c-1463-4046-866b-cd255a13be9c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:14.840282 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-34aa1651-709c-43d6-9b5d-2033897c5987 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:14.862936 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.objects.instance [None req-c8af452c-1463-4046-866b-cd255a13be9c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lazy-loading 'flavor' on Instance uuid 3b978091-0bf4-4e69-8053-76e49154df4c {{(pid=116902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 15:13:14.970071 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-34aa1651-709c-43d6-9b5d-2033897c5987 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:14.978183 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-34aa1651-709c-43d6-9b5d-2033897c5987 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6" status: 200 len: 1318 microversion: 2.1 time: 0.151044 Jan 11 15:13:14.978734 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 208/404] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:14 2022] GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:14.982832 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-5d801dc1-7cb1-44a4-8018-185eac657605 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:14.983456 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-5d801dc1-7cb1-44a4-8018-185eac657605 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: 7ccfb598-d95c-4312-8c81-457b98804ce5] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:14.990159 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5d801dc1-7cb1-44a4-8018-185eac657605 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:14.990608 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5d801dc1-7cb1-44a4-8018-185eac657605 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:14.992013 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5d801dc1-7cb1-44a4-8018-185eac657605 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:14.992454 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5d801dc1-7cb1-44a4-8018-185eac657605 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:15.119011 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-5d801dc1-7cb1-44a4-8018-185eac657605 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:15.126321 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-5d801dc1-7cb1-44a4-8018-185eac657605 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5" status: 200 len: 1313 microversion: 2.1 time: 0.146658 Jan 11 15:13:15.126878 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 209/405] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:14 2022] GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:15.131106 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [req-7b3e8572-8536-49ee-a780-046272ad10a2 req-bbde0d40-82d8-49b4-af0e-d291d59e1a2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d8b8b19-117d-4669-933b-5f86257caff6", "name": "network-vif-plugged", "status": "completed", "tag": "3ca6f955-8c4f-4a77-b65d-c28221580f8e"}]} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:15.132864 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:13:15.132864 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: warnings.warn(msg) Jan 11 15:13:15.139441 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-7b3e8572-8536-49ee-a780-046272ad10a2 req-bbde0d40-82d8-49b4-af0e-d291d59e1a2a service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:15.139902 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-7b3e8572-8536-49ee-a780-046272ad10a2 req-bbde0d40-82d8-49b4-af0e-d291d59e1a2a service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:15.150323 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.compute.server_external_events [req-7b3e8572-8536-49ee-a780-046272ad10a2 req-bbde0d40-82d8-49b4-af0e-d291d59e1a2a service nova] Creating event network-vif-plugged:3ca6f955-8c4f-4a77-b65d-c28221580f8e for instance 5d8b8b19-117d-4669-933b-5f86257caff6 on hv-cinder-82418 Jan 11 15:13:15.154898 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [req-7b3e8572-8536-49ee-a780-046272ad10a2 req-bbde0d40-82d8-49b4-af0e-d291d59e1a2a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.026925 Jan 11 15:13:15.155480 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 210/406] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:13:15.215077 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c8af452c-1463-4046-866b-cd255a13be9c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "POST /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/action" status: 200 len: 32 microversion: 2.1 time: 0.388496 Jan 11 15:13:15.219641 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 197/407] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:14 2022] POST /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/action => generated 32 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 15:13:15.228253 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-cd47d671-2e4f-4d46-907e-046b6437e78f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:15.228935 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-cd47d671-2e4f-4d46-907e-046b6437e78f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:15.239612 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cd47d671-2e4f-4d46-907e-046b6437e78f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:15.240092 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cd47d671-2e4f-4d46-907e-046b6437e78f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:15.242102 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cd47d671-2e4f-4d46-907e-046b6437e78f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:15.242102 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cd47d671-2e4f-4d46-907e-046b6437e78f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:15.377527 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-cd47d671-2e4f-4d46-907e-046b6437e78f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:15.384984 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-cd47d671-2e4f-4d46-907e-046b6437e78f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1522 microversion: 2.1 time: 0.161613 Jan 11 15:13:15.385806 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 211/408] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:15 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:15.833961 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-655e595c-bb89-4ad4-b0cc-10b01a089aab tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:15.834971 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-655e595c-bb89-4ad4-b0cc-10b01a089aab tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:15.836349 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-950a3493-a8df-4da9-8b55-f9a8f7695c64 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:15.837476 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-950a3493-a8df-4da9-8b55-f9a8f7695c64 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:15.841337 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-655e595c-bb89-4ad4-b0cc-10b01a089aab tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:15.841783 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-655e595c-bb89-4ad4-b0cc-10b01a089aab tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:15.842555 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-655e595c-bb89-4ad4-b0cc-10b01a089aab tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:15.843021 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-655e595c-bb89-4ad4-b0cc-10b01a089aab tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:15.843629 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-950a3493-a8df-4da9-8b55-f9a8f7695c64 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:15.848251 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-950a3493-a8df-4da9-8b55-f9a8f7695c64 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:15.848251 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-950a3493-a8df-4da9-8b55-f9a8f7695c64 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:15.848251 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-950a3493-a8df-4da9-8b55-f9a8f7695c64 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:20.293375 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-950a3493-a8df-4da9-8b55-f9a8f7695c64 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28196 microversion: 2.1 time: 4.460401 Jan 11 15:13:20.294000 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 212/409] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:15 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28196 bytes in 4462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:13:20.301533 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-212d2634-01d2-4e73-b579-b48cc6c652b9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:20.302241 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-212d2634-01d2-4e73-b579-b48cc6c652b9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 5d8b8b19-117d-4669-933b-5f86257caff6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:20.303922 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-655e595c-bb89-4ad4-b0cc-10b01a089aab tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28106 microversion: 2.20 time: 4.474484 Jan 11 15:13:20.308921 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 198/410] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:13:15 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28106 bytes in 4477 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:13:20.310640 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-fec44c39-c803-4e46-95d5-5f327d59cc30 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:20.311611 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-fec44c39-c803-4e46-95d5-5f327d59cc30 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: 7ccfb598-d95c-4312-8c81-457b98804ce5] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:20.318907 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fec44c39-c803-4e46-95d5-5f327d59cc30 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:20.319376 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fec44c39-c803-4e46-95d5-5f327d59cc30 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:20.320339 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fec44c39-c803-4e46-95d5-5f327d59cc30 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:20.320889 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fec44c39-c803-4e46-95d5-5f327d59cc30 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:20.324758 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-212d2634-01d2-4e73-b579-b48cc6c652b9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:20.325173 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-212d2634-01d2-4e73-b579-b48cc6c652b9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:20.326048 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-212d2634-01d2-4e73-b579-b48cc6c652b9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:20.326555 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-212d2634-01d2-4e73-b579-b48cc6c652b9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:20.511802 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-212d2634-01d2-4e73-b579-b48cc6c652b9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:20.519130 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-fec44c39-c803-4e46-95d5-5f327d59cc30 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:20.520342 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-212d2634-01d2-4e73-b579-b48cc6c652b9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6" status: 200 len: 1318 microversion: 2.1 time: 0.224947 Jan 11 15:13:20.521137 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 213/411] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:20 2022] GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:20.526127 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4ea7c910-7f14-4236-bd16-2da49802a906 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:20.526723 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4ea7c910-7f14-4236-bd16-2da49802a906 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:20.526980 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-fec44c39-c803-4e46-95d5-5f327d59cc30 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5" status: 200 len: 1313 microversion: 2.1 time: 0.220551 Jan 11 15:13:20.529165 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 199/412] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:20 2022] GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:20.532645 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4ea7c910-7f14-4236-bd16-2da49802a906 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:20.533167 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4ea7c910-7f14-4236-bd16-2da49802a906 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:20.534014 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4ea7c910-7f14-4236-bd16-2da49802a906 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:20.534531 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4ea7c910-7f14-4236-bd16-2da49802a906 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:20.662667 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-4ea7c910-7f14-4236-bd16-2da49802a906 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:20.670520 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4ea7c910-7f14-4236-bd16-2da49802a906 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1522 microversion: 2.1 time: 0.148402 Jan 11 15:13:20.671312 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 214/413] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:20 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:21.306102 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c8e7fddc-77a7-4337-9077-ec38247d7735 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:21.307018 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c8e7fddc-77a7-4337-9077-ec38247d7735 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:21.313248 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c8e7fddc-77a7-4337-9077-ec38247d7735 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:21.319668 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c8e7fddc-77a7-4337-9077-ec38247d7735 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:21.319668 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c8e7fddc-77a7-4337-9077-ec38247d7735 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:21.319668 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c8e7fddc-77a7-4337-9077-ec38247d7735 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:21.320446 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-752e3396-e3dc-411a-b5fa-9ec0a59640a3 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:21.320446 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-752e3396-e3dc-411a-b5fa-9ec0a59640a3 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:21.324305 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-752e3396-e3dc-411a-b5fa-9ec0a59640a3 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:21.324855 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-752e3396-e3dc-411a-b5fa-9ec0a59640a3 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:21.325691 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-752e3396-e3dc-411a-b5fa-9ec0a59640a3 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:21.326220 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-752e3396-e3dc-411a-b5fa-9ec0a59640a3 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:21.414932 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-752e3396-e3dc-411a-b5fa-9ec0a59640a3 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28106 microversion: 2.20 time: 0.103074 Jan 11 15:13:21.415614 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 215/414] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:13:21 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28106 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:13:21.430326 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c8e7fddc-77a7-4337-9077-ec38247d7735 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28196 microversion: 2.1 time: 0.128263 Jan 11 15:13:21.430961 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 200/415] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:21 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28196 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:13:21.537971 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-45f3c6af-79fb-4293-92ef-e967b6f8f180 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:21.538635 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-45f3c6af-79fb-4293-92ef-e967b6f8f180 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 5d8b8b19-117d-4669-933b-5f86257caff6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:21.544197 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-46397bad-f456-4d8c-a54f-856e17c704ed tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:21.544976 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-46397bad-f456-4d8c-a54f-856e17c704ed tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: 7ccfb598-d95c-4312-8c81-457b98804ce5] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:21.545486 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-45f3c6af-79fb-4293-92ef-e967b6f8f180 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:21.545949 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-45f3c6af-79fb-4293-92ef-e967b6f8f180 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:21.546881 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-45f3c6af-79fb-4293-92ef-e967b6f8f180 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:21.547348 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-45f3c6af-79fb-4293-92ef-e967b6f8f180 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:21.553787 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-46397bad-f456-4d8c-a54f-856e17c704ed tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:21.554885 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-46397bad-f456-4d8c-a54f-856e17c704ed tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:21.555728 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-46397bad-f456-4d8c-a54f-856e17c704ed tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:21.556172 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-46397bad-f456-4d8c-a54f-856e17c704ed tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:21.744714 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-46397bad-f456-4d8c-a54f-856e17c704ed tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:21.752334 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-45f3c6af-79fb-4293-92ef-e967b6f8f180 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:21.753931 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-46397bad-f456-4d8c-a54f-856e17c704ed tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5" status: 200 len: 1313 microversion: 2.1 time: 0.214258 Jan 11 15:13:21.760861 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 201/416] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:21 2022] GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:13:21.764821 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-45f3c6af-79fb-4293-92ef-e967b6f8f180 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6" status: 200 len: 1318 microversion: 2.1 time: 0.230974 Jan 11 15:13:21.765828 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 216/417] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:21 2022] GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:21.766331 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0ffa09b8-d891-4092-8889-e7c8af2e3f03 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:21.766955 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0ffa09b8-d891-4092-8889-e7c8af2e3f03 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:21.777989 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0ffa09b8-d891-4092-8889-e7c8af2e3f03 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:21.777989 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0ffa09b8-d891-4092-8889-e7c8af2e3f03 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:21.777989 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0ffa09b8-d891-4092-8889-e7c8af2e3f03 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:21.778307 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0ffa09b8-d891-4092-8889-e7c8af2e3f03 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:21.906388 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0ffa09b8-d891-4092-8889-e7c8af2e3f03 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:21.914096 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0ffa09b8-d891-4092-8889-e7c8af2e3f03 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1522 microversion: 2.1 time: 0.151397 Jan 11 15:13:21.914653 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 202/418] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:21 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:22.425869 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-62f0e3cd-339a-46eb-a844-c8b0833d035e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:22.426778 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-62f0e3cd-339a-46eb-a844-c8b0833d035e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:22.433209 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-62f0e3cd-339a-46eb-a844-c8b0833d035e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:22.433675 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-62f0e3cd-339a-46eb-a844-c8b0833d035e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:22.434457 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-62f0e3cd-339a-46eb-a844-c8b0833d035e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:22.434888 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-62f0e3cd-339a-46eb-a844-c8b0833d035e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:22.444240 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-527b155f-ce0a-4058-ab5a-75ebda725ec9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:22.445788 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-527b155f-ce0a-4058-ab5a-75ebda725ec9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:22.452494 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-527b155f-ce0a-4058-ab5a-75ebda725ec9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:22.452944 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-527b155f-ce0a-4058-ab5a-75ebda725ec9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:22.453724 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-527b155f-ce0a-4058-ab5a-75ebda725ec9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:22.454199 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-527b155f-ce0a-4058-ab5a-75ebda725ec9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:22.542275 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-62f0e3cd-339a-46eb-a844-c8b0833d035e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28106 microversion: 2.20 time: 0.119931 Jan 11 15:13:22.543188 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 217/419] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:13:22 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28106 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:13:22.562739 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-527b155f-ce0a-4058-ab5a-75ebda725ec9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28196 microversion: 2.1 time: 0.121955 Jan 11 15:13:22.566744 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 203/420] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:22 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28196 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:13:22.770316 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3a346e8e-aec0-473b-b48b-cba87009f944 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:22.771018 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3a346e8e-aec0-473b-b48b-cba87009f944 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: 7ccfb598-d95c-4312-8c81-457b98804ce5] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:22.778453 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3a346e8e-aec0-473b-b48b-cba87009f944 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:22.781206 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3a346e8e-aec0-473b-b48b-cba87009f944 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:22.781206 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3a346e8e-aec0-473b-b48b-cba87009f944 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:22.781206 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3a346e8e-aec0-473b-b48b-cba87009f944 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:22.783218 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-84147b93-9cf4-4ca4-8527-09c209e74560 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:22.783970 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-84147b93-9cf4-4ca4-8527-09c209e74560 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 5d8b8b19-117d-4669-933b-5f86257caff6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:22.791077 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-84147b93-9cf4-4ca4-8527-09c209e74560 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:22.791568 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-84147b93-9cf4-4ca4-8527-09c209e74560 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:22.792653 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-84147b93-9cf4-4ca4-8527-09c209e74560 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:22.793074 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-84147b93-9cf4-4ca4-8527-09c209e74560 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:22.986969 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-84147b93-9cf4-4ca4-8527-09c209e74560 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:22.996317 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-84147b93-9cf4-4ca4-8527-09c209e74560 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6" status: 200 len: 1508 microversion: 2.1 time: 0.217793 Jan 11 15:13:22.997345 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 204/421] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:22 2022] GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6 => generated 1508 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:13:23.003774 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6143a2c8-9df1-4bbe-8fcf-e1ca3987b480 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:23.004483 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6143a2c8-9df1-4bbe-8fcf-e1ca3987b480 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:23.010978 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6143a2c8-9df1-4bbe-8fcf-e1ca3987b480 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:23.011166 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-3a346e8e-aec0-473b-b48b-cba87009f944 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:23.011705 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6143a2c8-9df1-4bbe-8fcf-e1ca3987b480 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:23.012389 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6143a2c8-9df1-4bbe-8fcf-e1ca3987b480 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:23.012817 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6143a2c8-9df1-4bbe-8fcf-e1ca3987b480 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:23.027763 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3a346e8e-aec0-473b-b48b-cba87009f944 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5" status: 200 len: 1313 microversion: 2.1 time: 0.261408 Jan 11 15:13:23.037473 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 218/422] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:22 2022] GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5 => generated 1313 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:23.043841 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [req-330f704a-5ef1-487c-9eb1-82f5cc3fc2b8 req-74d5e993-93e0-4bf7-8ada-ab826f0967ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ccfb598-d95c-4312-8c81-457b98804ce5", "name": "network-vif-plugged", "status": "completed", "tag": "f9687aef-ab44-4d69-a169-382a09e4d697"}]} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:23.044312 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:13:23.044312 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: warnings.warn(msg) Jan 11 15:13:23.057181 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-330f704a-5ef1-487c-9eb1-82f5cc3fc2b8 req-74d5e993-93e0-4bf7-8ada-ab826f0967ae service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:23.058204 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-330f704a-5ef1-487c-9eb1-82f5cc3fc2b8 req-74d5e993-93e0-4bf7-8ada-ab826f0967ae service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:23.074313 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.compute.server_external_events [req-330f704a-5ef1-487c-9eb1-82f5cc3fc2b8 req-74d5e993-93e0-4bf7-8ada-ab826f0967ae service nova] Creating event network-vif-plugged:f9687aef-ab44-4d69-a169-382a09e4d697 for instance 7ccfb598-d95c-4312-8c81-457b98804ce5 on hv-cinder-82418 Jan 11 15:13:23.079753 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [req-330f704a-5ef1-487c-9eb1-82f5cc3fc2b8 req-74d5e993-93e0-4bf7-8ada-ab826f0967ae service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041002 Jan 11 15:13:23.081463 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 219/423] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:13:23.206170 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6143a2c8-9df1-4bbe-8fcf-e1ca3987b480 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:23.213999 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6143a2c8-9df1-4bbe-8fcf-e1ca3987b480 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1522 microversion: 2.1 time: 0.215523 Jan 11 15:13:23.214579 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 205/424] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:22 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:23.556123 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d437466b-8bd2-48cd-b646-0d9b0d843e86 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:23.557357 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d437466b-8bd2-48cd-b646-0d9b0d843e86 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:23.563436 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d437466b-8bd2-48cd-b646-0d9b0d843e86 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:23.563959 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d437466b-8bd2-48cd-b646-0d9b0d843e86 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:23.564941 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d437466b-8bd2-48cd-b646-0d9b0d843e86 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:23.565508 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d437466b-8bd2-48cd-b646-0d9b0d843e86 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:23.576388 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-94e4ee4f-f9b9-44ba-ad5f-42d6efee7da9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:23.577341 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-94e4ee4f-f9b9-44ba-ad5f-42d6efee7da9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:23.583988 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-94e4ee4f-f9b9-44ba-ad5f-42d6efee7da9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:23.584443 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-94e4ee4f-f9b9-44ba-ad5f-42d6efee7da9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:23.585782 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-94e4ee4f-f9b9-44ba-ad5f-42d6efee7da9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:23.586541 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-94e4ee4f-f9b9-44ba-ad5f-42d6efee7da9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:24.006883 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-94e4ee4f-f9b9-44ba-ad5f-42d6efee7da9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28196 microversion: 2.1 time: 0.434046 Jan 11 15:13:24.008247 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 206/425] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:23 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28196 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:13:24.019721 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d437466b-8bd2-48cd-b646-0d9b0d843e86 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28106 microversion: 2.20 time: 0.462664 Jan 11 15:13:24.019721 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 220/426] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:13:23 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28106 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:13:24.045376 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d3bd46c6-9158-4817-a3db-24b6607878fd tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:24.046083 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d3bd46c6-9158-4817-a3db-24b6607878fd tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: 7ccfb598-d95c-4312-8c81-457b98804ce5] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:24.054880 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d3bd46c6-9158-4817-a3db-24b6607878fd tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:24.055428 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d3bd46c6-9158-4817-a3db-24b6607878fd tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:24.056213 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d3bd46c6-9158-4817-a3db-24b6607878fd tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:24.056648 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d3bd46c6-9158-4817-a3db-24b6607878fd tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:24.185441 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d3bd46c6-9158-4817-a3db-24b6607878fd tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:24.193166 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d3bd46c6-9158-4817-a3db-24b6607878fd tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5" status: 200 len: 1313 microversion: 2.1 time: 0.152324 Jan 11 15:13:24.193727 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 207/427] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:24 2022] GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:24.231961 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-eae9a473-464a-4987-bfc5-0bf1e21c12f0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:24.233300 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-eae9a473-464a-4987-bfc5-0bf1e21c12f0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:24.242675 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-eae9a473-464a-4987-bfc5-0bf1e21c12f0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:24.243134 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-eae9a473-464a-4987-bfc5-0bf1e21c12f0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:24.243953 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-eae9a473-464a-4987-bfc5-0bf1e21c12f0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:24.244395 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-eae9a473-464a-4987-bfc5-0bf1e21c12f0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:24.377882 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-eae9a473-464a-4987-bfc5-0bf1e21c12f0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:24.386171 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-eae9a473-464a-4987-bfc5-0bf1e21c12f0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1522 microversion: 2.1 time: 0.158272 Jan 11 15:13:24.386721 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 221/428] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:24 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:25.019154 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a120d7b3-73f3-4a1d-bf45-47819755f1d8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:25.020188 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a120d7b3-73f3-4a1d-bf45-47819755f1d8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:25.025215 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e17b203c-55d3-4deb-b7e3-ed40fbe61e67 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:25.026051 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e17b203c-55d3-4deb-b7e3-ed40fbe61e67 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:25.027033 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a120d7b3-73f3-4a1d-bf45-47819755f1d8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:25.027525 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a120d7b3-73f3-4a1d-bf45-47819755f1d8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:25.028320 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a120d7b3-73f3-4a1d-bf45-47819755f1d8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:25.028758 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a120d7b3-73f3-4a1d-bf45-47819755f1d8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:25.032775 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e17b203c-55d3-4deb-b7e3-ed40fbe61e67 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:25.033351 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e17b203c-55d3-4deb-b7e3-ed40fbe61e67 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:25.034136 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e17b203c-55d3-4deb-b7e3-ed40fbe61e67 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:25.034574 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e17b203c-55d3-4deb-b7e3-ed40fbe61e67 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:28.658559 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a120d7b3-73f3-4a1d-bf45-47819755f1d8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28196 microversion: 2.1 time: 3.642784 Jan 11 15:13:28.659234 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 208/429] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:25 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28196 bytes in 3644 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:13:28.664818 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ac5ed749-78ec-44ed-8f06-fd61dde18e68 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:28.665948 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ac5ed749-78ec-44ed-8f06-fd61dde18e68 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: 7ccfb598-d95c-4312-8c81-457b98804ce5] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:28.671328 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e17b203c-55d3-4deb-b7e3-ed40fbe61e67 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28106 microversion: 2.20 time: 3.649503 Jan 11 15:13:28.672578 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 222/430] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:13:25 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28106 bytes in 3652 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:13:28.673032 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ac5ed749-78ec-44ed-8f06-fd61dde18e68 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:28.673557 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ac5ed749-78ec-44ed-8f06-fd61dde18e68 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:28.674357 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ac5ed749-78ec-44ed-8f06-fd61dde18e68 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:28.674800 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ac5ed749-78ec-44ed-8f06-fd61dde18e68 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:28.679029 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-640ebe0f-9b9e-47be-87e6-191eefd825dc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:28.680342 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-640ebe0f-9b9e-47be-87e6-191eefd825dc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:28.691082 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-640ebe0f-9b9e-47be-87e6-191eefd825dc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:28.691564 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-640ebe0f-9b9e-47be-87e6-191eefd825dc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:28.692346 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-640ebe0f-9b9e-47be-87e6-191eefd825dc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:28.692782 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-640ebe0f-9b9e-47be-87e6-191eefd825dc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:28.873682 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ac5ed749-78ec-44ed-8f06-fd61dde18e68 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:28.876826 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-640ebe0f-9b9e-47be-87e6-191eefd825dc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:28.881018 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ac5ed749-78ec-44ed-8f06-fd61dde18e68 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5" status: 200 len: 1313 microversion: 2.1 time: 0.220356 Jan 11 15:13:28.881677 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 209/431] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:28 2022] GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:28.885101 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-640ebe0f-9b9e-47be-87e6-191eefd825dc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1522 microversion: 2.1 time: 0.210725 Jan 11 15:13:28.885653 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 223/432] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:28 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:29.669573 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b036958f-dc73-4724-b2cf-9739c8d65451 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:29.670521 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b036958f-dc73-4724-b2cf-9739c8d65451 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:29.676806 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b036958f-dc73-4724-b2cf-9739c8d65451 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:29.677258 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b036958f-dc73-4724-b2cf-9739c8d65451 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:29.678036 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b036958f-dc73-4724-b2cf-9739c8d65451 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:29.678592 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b036958f-dc73-4724-b2cf-9739c8d65451 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:29.683564 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-bcbe5b3d-822c-43b3-a89e-c4d2324ce8b1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:29.684471 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-bcbe5b3d-822c-43b3-a89e-c4d2324ce8b1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:29.690600 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bcbe5b3d-822c-43b3-a89e-c4d2324ce8b1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:29.691049 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bcbe5b3d-822c-43b3-a89e-c4d2324ce8b1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:29.691951 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bcbe5b3d-822c-43b3-a89e-c4d2324ce8b1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:29.692427 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bcbe5b3d-822c-43b3-a89e-c4d2324ce8b1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:29.936922 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-bcbe5b3d-822c-43b3-a89e-c4d2324ce8b1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28106 microversion: 2.20 time: 0.256690 Jan 11 15:13:29.938315 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 224/433] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:13:29 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28106 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:13:29.941071 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b036958f-dc73-4724-b2cf-9739c8d65451 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28196 microversion: 2.1 time: 0.274910 Jan 11 15:13:29.945481 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 210/434] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:29 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28196 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:13:29.945648 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e75dcc36-4872-4857-9231-8c6ccc63cfbb tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:29.945648 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e75dcc36-4872-4857-9231-8c6ccc63cfbb tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: 7ccfb598-d95c-4312-8c81-457b98804ce5] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:29.947269 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-baa2349a-3d5b-4708-9632-03f3cb4d75d1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:29.948061 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-baa2349a-3d5b-4708-9632-03f3cb4d75d1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:29.956541 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e75dcc36-4872-4857-9231-8c6ccc63cfbb tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:29.956541 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e75dcc36-4872-4857-9231-8c6ccc63cfbb tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:29.956541 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e75dcc36-4872-4857-9231-8c6ccc63cfbb tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:29.956541 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e75dcc36-4872-4857-9231-8c6ccc63cfbb tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:29.956851 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-baa2349a-3d5b-4708-9632-03f3cb4d75d1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:29.956851 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-baa2349a-3d5b-4708-9632-03f3cb4d75d1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:29.956851 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-baa2349a-3d5b-4708-9632-03f3cb4d75d1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:29.956851 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-baa2349a-3d5b-4708-9632-03f3cb4d75d1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:30.145872 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-e75dcc36-4872-4857-9231-8c6ccc63cfbb tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:30.150107 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-baa2349a-3d5b-4708-9632-03f3cb4d75d1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:30.153770 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e75dcc36-4872-4857-9231-8c6ccc63cfbb tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5" status: 200 len: 1313 microversion: 2.1 time: 0.215132 Jan 11 15:13:30.154334 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 225/435] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:29 2022] GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:30.158012 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-baa2349a-3d5b-4708-9632-03f3cb4d75d1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1522 microversion: 2.1 time: 0.215134 Jan 11 15:13:30.158648 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 211/436] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:29 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:30.948189 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-340badb2-9bda-463a-bc5b-c75c97a73e7c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:30.949213 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-340badb2-9bda-463a-bc5b-c75c97a73e7c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:30.952057 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0ff8246c-b01f-49ca-97b6-a960c46fc399 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:30.953063 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0ff8246c-b01f-49ca-97b6-a960c46fc399 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:30.957356 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-340badb2-9bda-463a-bc5b-c75c97a73e7c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:30.958047 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-340badb2-9bda-463a-bc5b-c75c97a73e7c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:30.958903 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-340badb2-9bda-463a-bc5b-c75c97a73e7c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:30.959182 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0ff8246c-b01f-49ca-97b6-a960c46fc399 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:30.959859 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-340badb2-9bda-463a-bc5b-c75c97a73e7c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:30.959980 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0ff8246c-b01f-49ca-97b6-a960c46fc399 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:30.960425 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0ff8246c-b01f-49ca-97b6-a960c46fc399 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:30.960979 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0ff8246c-b01f-49ca-97b6-a960c46fc399 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:31.044516 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0ff8246c-b01f-49ca-97b6-a960c46fc399 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28196 microversion: 2.1 time: 0.095621 Jan 11 15:13:31.046006 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 212/437] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:30 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28196 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:13:31.046347 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-340badb2-9bda-463a-bc5b-c75c97a73e7c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28106 microversion: 2.20 time: 0.102049 Jan 11 15:13:31.047551 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 226/438] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:13:30 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28106 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:13:31.051449 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b1a04c42-0d43-4e7f-b00f-799ca0535d5c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd91374f-fbc7-4444-bdbc-6c5f44720cee"}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:31.052564 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b1a04c42-0d43-4e7f-b00f-799ca0535d5c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 5d8b8b19-117d-4669-933b-5f86257caff6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:31.059461 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b1a04c42-0d43-4e7f-b00f-799ca0535d5c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:31.059904 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b1a04c42-0d43-4e7f-b00f-799ca0535d5c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:31.060676 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b1a04c42-0d43-4e7f-b00f-799ca0535d5c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:31.061112 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b1a04c42-0d43-4e7f-b00f-799ca0535d5c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:31.170727 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4fd48025-44aa-41fa-91c3-de3bed22793e tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:31.171457 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4fd48025-44aa-41fa-91c3-de3bed22793e tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: 7ccfb598-d95c-4312-8c81-457b98804ce5] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:31.178444 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4fd48025-44aa-41fa-91c3-de3bed22793e tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:31.178900 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4fd48025-44aa-41fa-91c3-de3bed22793e tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:31.179779 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4fd48025-44aa-41fa-91c3-de3bed22793e tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:31.180248 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4fd48025-44aa-41fa-91c3-de3bed22793e tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:31.311513 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-4fd48025-44aa-41fa-91c3-de3bed22793e tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:31.319280 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4fd48025-44aa-41fa-91c3-de3bed22793e tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5" status: 200 len: 1496 microversion: 2.1 time: 0.152493 Jan 11 15:13:31.319876 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 227/439] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:31 2022] GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5 => generated 1496 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:13:31.324064 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e2033164-bc6f-4800-ab95-ffdd27b9868e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:31.324661 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e2033164-bc6f-4800-ab95-ffdd27b9868e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:31.330136 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e2033164-bc6f-4800-ab95-ffdd27b9868e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:31.330596 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e2033164-bc6f-4800-ab95-ffdd27b9868e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:31.331411 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e2033164-bc6f-4800-ab95-ffdd27b9868e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:31.331862 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e2033164-bc6f-4800-ab95-ffdd27b9868e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:31.467732 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-e2033164-bc6f-4800-ab95-ffdd27b9868e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:31.475166 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e2033164-bc6f-4800-ab95-ffdd27b9868e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1522 microversion: 2.1 time: 0.154354 Jan 11 15:13:31.475797 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 228/440] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:31 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:31.726489 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-9cf98098-920f-4677-a589-05c19f71befc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1512562667", "imageRef": "d0ce98ab-06a2-4e75-9f37-288864a22cb9", "flavorRef": "452", "networks": [{"uuid": "415ee6ad-a714-4cc3-bed3-e34013f0703b"}]}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:31.778643 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.network.neutron [None req-9cf98098-920f-4677-a589-05c19f71befc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] validate_networks() for [('415ee6ad-a714-4cc3-bed3-e34013f0703b', None, None, None, None, None)] {{(pid=116903) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 15:13:31.853072 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b1a04c42-0d43-4e7f-b00f-799ca0535d5c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "POST /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.805239 Jan 11 15:13:31.853743 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 213/441] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jan 11 15:13:31 2022] POST /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6/os-volume_attachments => generated 194 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:13:32.088521 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-89ca4794-b175-499e-b2f7-fa7b5a4224f6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:32.088521 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-89ca4794-b175-499e-b2f7-fa7b5a4224f6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:32.088521 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-89ca4794-b175-499e-b2f7-fa7b5a4224f6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:32.088521 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-89ca4794-b175-499e-b2f7-fa7b5a4224f6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:32.089310 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-89ca4794-b175-499e-b2f7-fa7b5a4224f6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:32.089310 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-89ca4794-b175-499e-b2f7-fa7b5a4224f6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:32.137223 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-9cf98098-920f-4677-a589-05c19f71befc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Flavor limits 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 15:13:32.137668 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-9cf98098-920f-4677-a589-05c19f71befc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Image limits 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 15:13:32.138015 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-9cf98098-920f-4677-a589-05c19f71befc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Flavor pref 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 15:13:32.138515 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-9cf98098-920f-4677-a589-05c19f71befc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Image pref 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 15:13:32.138876 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-9cf98098-920f-4677-a589-05c19f71befc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 15:13:32.146013 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-89ca4794-b175-499e-b2f7-fa7b5a4224f6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28196 microversion: 2.1 time: 0.092529 Jan 11 15:13:32.146884 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 214/442] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:32 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28196 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:13:32.148344 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9cf98098-920f-4677-a589-05c19f71befc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:32.150498 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9cf98098-920f-4677-a589-05c19f71befc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:32.151600 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9cf98098-920f-4677-a589-05c19f71befc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:32.152195 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9cf98098-920f-4677-a589-05c19f71befc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:32.153341 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-93d951f2-acd0-470b-b089-a9df6419e09d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:32.154352 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-93d951f2-acd0-470b-b089-a9df6419e09d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:32.161198 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-93d951f2-acd0-470b-b089-a9df6419e09d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:32.161800 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-93d951f2-acd0-470b-b089-a9df6419e09d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:32.162618 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-93d951f2-acd0-470b-b089-a9df6419e09d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:32.163061 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-93d951f2-acd0-470b-b089-a9df6419e09d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:32.168826 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.quota [None req-9cf98098-920f-4677-a589-05c19f71befc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Getting quotas for project 9fc45775f6e34afd92637df5539194e2. Resources: {'instances', 'cores', 'ram'} {{(pid=116903) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 15:13:32.172762 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.quota [None req-9cf98098-920f-4677-a589-05c19f71befc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Getting quotas for user 8720d62426cf424b9f254574a9babf61 and project 9fc45775f6e34afd92637df5539194e2. Resources: {'instances', 'cores', 'ram'} {{(pid=116903) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 15:13:32.184129 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-9cf98098-920f-4677-a589-05c19f71befc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Going to run 1 instances... {{(pid=116903) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 15:13:32.186462 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-9cf98098-920f-4677-a589-05c19f71befc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0ce98ab-06a2-4e75-9f37-288864a22cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 15:13:32.291904 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-9cf98098-920f-4677-a589-05c19f71befc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569149 Jan 11 15:13:32.292732 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 229/443] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jan 11 15:13:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 11 15:13:32.296975 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7650c16e-0e20-450e-a5cf-8d6db9d3a043 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:32.297785 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7650c16e-0e20-450e-a5cf-8d6db9d3a043 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: 7ccfb598-d95c-4312-8c81-457b98804ce5] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:32.303783 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7650c16e-0e20-450e-a5cf-8d6db9d3a043 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:32.304229 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7650c16e-0e20-450e-a5cf-8d6db9d3a043 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:32.305038 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7650c16e-0e20-450e-a5cf-8d6db9d3a043 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:32.305479 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7650c16e-0e20-450e-a5cf-8d6db9d3a043 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:32.334418 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7650c16e-0e20-450e-a5cf-8d6db9d3a043 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: 7ccfb598-d95c-4312-8c81-457b98804ce5] Going to try to terminate instance {{(pid=116903) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 15:13:32.453811 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-93d951f2-acd0-470b-b089-a9df6419e09d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28106 microversion: 2.20 time: 0.305347 Jan 11 15:13:32.454725 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 215/444] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:13:32 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28106 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:13:32.464221 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9a6f4019-0f98-402f-ae3e-eb8822189679 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:32.465513 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9a6f4019-0f98-402f-ae3e-eb8822189679 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:32.535971 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-9a6f4019-0f98-402f-ae3e-eb8822189679 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:32.543212 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9a6f4019-0f98-402f-ae3e-eb8822189679 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1219 microversion: 2.1 time: 0.086991 Jan 11 15:13:32.543898 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 216/445] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:32 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:32.548099 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9af7fef9-913f-4410-92bf-0e6250a434fd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:32.548720 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9af7fef9-913f-4410-92bf-0e6250a434fd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:32.556222 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9af7fef9-913f-4410-92bf-0e6250a434fd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:32.557257 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9af7fef9-913f-4410-92bf-0e6250a434fd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:32.558050 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9af7fef9-913f-4410-92bf-0e6250a434fd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:32.558487 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9af7fef9-913f-4410-92bf-0e6250a434fd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:32.692268 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-9af7fef9-913f-4410-92bf-0e6250a434fd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:32.697141 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7650c16e-0e20-450e-a5cf-8d6db9d3a043 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5" status: 204 len: 0 microversion: 2.1 time: 0.403234 Jan 11 15:13:32.700913 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9af7fef9-913f-4410-92bf-0e6250a434fd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1522 microversion: 2.1 time: 0.155777 Jan 11 15:13:32.701075 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 230/446] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jan 11 15:13:32 2022] DELETE /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 15:13:32.702024 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 217/447] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:32 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:32.713201 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ecbd5d58-3333-4eb4-844d-bc84f211bf3a tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:32.713812 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-ecbd5d58-3333-4eb4-844d-bc84f211bf3a tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: 7ccfb598-d95c-4312-8c81-457b98804ce5] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:32.720531 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ecbd5d58-3333-4eb4-844d-bc84f211bf3a tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:32.720976 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ecbd5d58-3333-4eb4-844d-bc84f211bf3a tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:32.721863 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ecbd5d58-3333-4eb4-844d-bc84f211bf3a tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:32.722299 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ecbd5d58-3333-4eb4-844d-bc84f211bf3a tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:32.874859 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-ecbd5d58-3333-4eb4-844d-bc84f211bf3a tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:32.882295 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-ecbd5d58-3333-4eb4-844d-bc84f211bf3a tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5" status: 200 len: 1502 microversion: 2.1 time: 0.175560 Jan 11 15:13:32.882854 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 231/448] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:32 2022] GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5 => generated 1502 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:13:33.158353 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-54d34ff8-08ff-4d1b-959c-27bd3f19b3d7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:33.159370 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-54d34ff8-08ff-4d1b-959c-27bd3f19b3d7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:33.166167 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-54d34ff8-08ff-4d1b-959c-27bd3f19b3d7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:33.170790 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-54d34ff8-08ff-4d1b-959c-27bd3f19b3d7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:33.170790 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-54d34ff8-08ff-4d1b-959c-27bd3f19b3d7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:33.170790 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-54d34ff8-08ff-4d1b-959c-27bd3f19b3d7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:33.290851 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-54d34ff8-08ff-4d1b-959c-27bd3f19b3d7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28196 microversion: 2.1 time: 0.136143 Jan 11 15:13:33.291565 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 218/449] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:33 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28196 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:13:33.469337 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-24b539d9-71d8-49f8-944c-6e615b7fc4c0 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:33.470952 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-24b539d9-71d8-49f8-944c-6e615b7fc4c0 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:33.479763 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-24b539d9-71d8-49f8-944c-6e615b7fc4c0 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:33.480224 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-24b539d9-71d8-49f8-944c-6e615b7fc4c0 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:33.481016 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-24b539d9-71d8-49f8-944c-6e615b7fc4c0 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:33.481459 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-24b539d9-71d8-49f8-944c-6e615b7fc4c0 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:33.560976 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4716f842-3171-4c84-8c4d-24b9cae1bd77 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:33.561353 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-24b539d9-71d8-49f8-944c-6e615b7fc4c0 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28106 microversion: 2.20 time: 0.095685 Jan 11 15:13:33.561842 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-4716f842-3171-4c84-8c4d-24b9cae1bd77 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:33.565682 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 232/450] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:13:33 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28106 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:13:33.568682 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4716f842-3171-4c84-8c4d-24b9cae1bd77 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:33.569287 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4716f842-3171-4c84-8c4d-24b9cae1bd77 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:33.570330 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4716f842-3171-4c84-8c4d-24b9cae1bd77 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:33.570921 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4716f842-3171-4c84-8c4d-24b9cae1bd77 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:33.632611 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-4716f842-3171-4c84-8c4d-24b9cae1bd77 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:33.640398 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4716f842-3171-4c84-8c4d-24b9cae1bd77 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1223 microversion: 2.1 time: 0.083815 Jan 11 15:13:33.640953 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 219/451] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:33 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:33.718887 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ac6fd129-cc37-4eef-ab0b-ce768b8e5c9b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:33.719618 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-ac6fd129-cc37-4eef-ab0b-ce768b8e5c9b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:33.728246 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ac6fd129-cc37-4eef-ab0b-ce768b8e5c9b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:33.728246 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ac6fd129-cc37-4eef-ab0b-ce768b8e5c9b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:33.728246 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ac6fd129-cc37-4eef-ab0b-ce768b8e5c9b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:33.728698 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ac6fd129-cc37-4eef-ab0b-ce768b8e5c9b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:33.864806 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-ac6fd129-cc37-4eef-ab0b-ce768b8e5c9b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:33.873398 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-ac6fd129-cc37-4eef-ab0b-ce768b8e5c9b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1522 microversion: 2.1 time: 0.158402 Jan 11 15:13:33.873984 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 233/452] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:33 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:33.898699 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7cee3a6c-324d-48bb-a2a3-22a99baeb8c6 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:33.899355 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-7cee3a6c-324d-48bb-a2a3-22a99baeb8c6 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: 7ccfb598-d95c-4312-8c81-457b98804ce5] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:33.905806 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7cee3a6c-324d-48bb-a2a3-22a99baeb8c6 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:33.906260 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7cee3a6c-324d-48bb-a2a3-22a99baeb8c6 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:33.907057 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7cee3a6c-324d-48bb-a2a3-22a99baeb8c6 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:33.907551 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7cee3a6c-324d-48bb-a2a3-22a99baeb8c6 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:34.054237 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-7cee3a6c-324d-48bb-a2a3-22a99baeb8c6 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:34.062300 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7cee3a6c-324d-48bb-a2a3-22a99baeb8c6 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5" status: 200 len: 1502 microversion: 2.1 time: 0.167143 Jan 11 15:13:34.063011 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 220/453] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:33 2022] GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5 => generated 1502 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:34.301911 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-1e4f19ff-5808-4cfc-89d4-a21bcfe96a83 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:34.302816 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-1e4f19ff-5808-4cfc-89d4-a21bcfe96a83 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:34.309640 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1e4f19ff-5808-4cfc-89d4-a21bcfe96a83 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:34.310090 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1e4f19ff-5808-4cfc-89d4-a21bcfe96a83 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:34.310865 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1e4f19ff-5808-4cfc-89d4-a21bcfe96a83 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:34.311317 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1e4f19ff-5808-4cfc-89d4-a21bcfe96a83 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:34.405360 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-1e4f19ff-5808-4cfc-89d4-a21bcfe96a83 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28196 microversion: 2.1 time: 0.106875 Jan 11 15:13:34.406022 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 234/454] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:34 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28196 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:13:34.573471 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-70433688-dd5d-4d13-b43f-5fb5c52a8019 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:34.574651 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-70433688-dd5d-4d13-b43f-5fb5c52a8019 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:34.580933 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-70433688-dd5d-4d13-b43f-5fb5c52a8019 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:34.581476 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-70433688-dd5d-4d13-b43f-5fb5c52a8019 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:34.582641 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-70433688-dd5d-4d13-b43f-5fb5c52a8019 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:34.583145 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-70433688-dd5d-4d13-b43f-5fb5c52a8019 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:34.657756 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-daaf4faf-f9f7-4fb4-af8c-e104fa01d904 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:34.659241 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-daaf4faf-f9f7-4fb4-af8c-e104fa01d904 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:34.669621 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-daaf4faf-f9f7-4fb4-af8c-e104fa01d904 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:34.670074 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-daaf4faf-f9f7-4fb4-af8c-e104fa01d904 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:34.670857 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-daaf4faf-f9f7-4fb4-af8c-e104fa01d904 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:34.671531 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-daaf4faf-f9f7-4fb4-af8c-e104fa01d904 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:34.768704 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-daaf4faf-f9f7-4fb4-af8c-e104fa01d904 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:34.777683 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-daaf4faf-f9f7-4fb4-af8c-e104fa01d904 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1279 microversion: 2.1 time: 0.124168 Jan 11 15:13:34.778236 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 235/455] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:34 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1279 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:34.832106 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-70433688-dd5d-4d13-b43f-5fb5c52a8019 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28106 microversion: 2.20 time: 0.262407 Jan 11 15:13:34.836026 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 221/456] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:13:34 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28106 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:13:34.890344 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b9df054e-5dc7-458a-a935-be49982040b3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:34.890855 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b9df054e-5dc7-458a-a935-be49982040b3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:34.901750 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b9df054e-5dc7-458a-a935-be49982040b3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:34.902222 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b9df054e-5dc7-458a-a935-be49982040b3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:34.903039 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b9df054e-5dc7-458a-a935-be49982040b3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:34.903511 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b9df054e-5dc7-458a-a935-be49982040b3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:35.080734 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-53b614f3-9abd-4e63-bd17-2dc5a4ccd74c tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:35.083573 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-53b614f3-9abd-4e63-bd17-2dc5a4ccd74c tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: 7ccfb598-d95c-4312-8c81-457b98804ce5] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:35.093540 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-53b614f3-9abd-4e63-bd17-2dc5a4ccd74c tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:35.095806 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-53b614f3-9abd-4e63-bd17-2dc5a4ccd74c tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:35.097265 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-53b614f3-9abd-4e63-bd17-2dc5a4ccd74c tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:35.097936 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-53b614f3-9abd-4e63-bd17-2dc5a4ccd74c tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:35.255238 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-b9df054e-5dc7-458a-a935-be49982040b3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:35.264340 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b9df054e-5dc7-458a-a935-be49982040b3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1522 microversion: 2.1 time: 0.377763 Jan 11 15:13:35.264942 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 236/457] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:34 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1522 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:35.404743 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-53b614f3-9abd-4e63-bd17-2dc5a4ccd74c tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:35.412586 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-53b614f3-9abd-4e63-bd17-2dc5a4ccd74c tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5" status: 200 len: 1502 microversion: 2.1 time: 0.336781 Jan 11 15:13:35.413360 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 222/458] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:35 2022] GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5 => generated 1502 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:13:35.417750 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3e2c0eb5-2cc5-43a9-ba36-d90c5e8c08b8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:35.418667 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3e2c0eb5-2cc5-43a9-ba36-d90c5e8c08b8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:35.425618 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3e2c0eb5-2cc5-43a9-ba36-d90c5e8c08b8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:35.426072 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3e2c0eb5-2cc5-43a9-ba36-d90c5e8c08b8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:35.427039 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3e2c0eb5-2cc5-43a9-ba36-d90c5e8c08b8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:35.427533 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3e2c0eb5-2cc5-43a9-ba36-d90c5e8c08b8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:35.502752 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3e2c0eb5-2cc5-43a9-ba36-d90c5e8c08b8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28196 microversion: 2.1 time: 0.089090 Jan 11 15:13:35.506606 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 237/459] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:35 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28196 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:13:35.794801 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1042fc68-5c5d-45d3-82dc-2388c4adaa6e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:35.795455 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1042fc68-5c5d-45d3-82dc-2388c4adaa6e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:35.802443 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1042fc68-5c5d-45d3-82dc-2388c4adaa6e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:35.802901 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1042fc68-5c5d-45d3-82dc-2388c4adaa6e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:35.803747 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1042fc68-5c5d-45d3-82dc-2388c4adaa6e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:35.804410 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1042fc68-5c5d-45d3-82dc-2388c4adaa6e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:35.851101 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f114dcb8-911f-4d0f-9ea5-d6d58cb97b13 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:35.855453 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f114dcb8-911f-4d0f-9ea5-d6d58cb97b13 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:35.866635 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f114dcb8-911f-4d0f-9ea5-d6d58cb97b13 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:35.867584 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f114dcb8-911f-4d0f-9ea5-d6d58cb97b13 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:35.869178 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f114dcb8-911f-4d0f-9ea5-d6d58cb97b13 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:35.869837 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f114dcb8-911f-4d0f-9ea5-d6d58cb97b13 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:35.988135 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f114dcb8-911f-4d0f-9ea5-d6d58cb97b13 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28106 microversion: 2.20 time: 0.147564 Jan 11 15:13:35.991943 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 238/460] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:13:35 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28106 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:13:36.026327 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1042fc68-5c5d-45d3-82dc-2388c4adaa6e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:36.036672 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1042fc68-5c5d-45d3-82dc-2388c4adaa6e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1319 microversion: 2.1 time: 0.245949 Jan 11 15:13:36.038186 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 223/461] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:35 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:36.097687 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [req-562f50a4-217b-46be-8bbc-c266bafcf449 req-62df9e0d-3ea8-4825-b90f-01fc30232398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ccfb598-d95c-4312-8c81-457b98804ce5", "name": "network-vif-deleted", "tag": "f9687aef-ab44-4d69-a169-382a09e4d697"}]} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:36.099509 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:13:36.099509 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: warnings.warn(msg) Jan 11 15:13:36.107978 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-562f50a4-217b-46be-8bbc-c266bafcf449 req-62df9e0d-3ea8-4825-b90f-01fc30232398 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:36.108767 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-562f50a4-217b-46be-8bbc-c266bafcf449 req-62df9e0d-3ea8-4825-b90f-01fc30232398 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:36.136825 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.compute.server_external_events [req-562f50a4-217b-46be-8bbc-c266bafcf449 req-62df9e0d-3ea8-4825-b90f-01fc30232398 service nova] Creating event network-vif-deleted:f9687aef-ab44-4d69-a169-382a09e4d697 for instance 7ccfb598-d95c-4312-8c81-457b98804ce5 on hv-cinder-82418 Jan 11 15:13:36.145145 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [req-562f50a4-217b-46be-8bbc-c266bafcf449 req-62df9e0d-3ea8-4825-b90f-01fc30232398 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051300 Jan 11 15:13:36.146066 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 239/462] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:13:36.281792 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7ee40ea3-ccf1-48cb-b6c3-534db407e5a4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:36.282438 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-7ee40ea3-ccf1-48cb-b6c3-534db407e5a4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:36.288541 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7ee40ea3-ccf1-48cb-b6c3-534db407e5a4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:36.289002 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7ee40ea3-ccf1-48cb-b6c3-534db407e5a4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:36.289786 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7ee40ea3-ccf1-48cb-b6c3-534db407e5a4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:36.290228 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7ee40ea3-ccf1-48cb-b6c3-534db407e5a4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:36.430669 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-eeaa25e5-579a-4520-bfe5-6f0f3663dcb8 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:36.431866 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-eeaa25e5-579a-4520-bfe5-6f0f3663dcb8 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: 7ccfb598-d95c-4312-8c81-457b98804ce5] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:36.446219 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-eeaa25e5-579a-4520-bfe5-6f0f3663dcb8 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:36.447407 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-eeaa25e5-579a-4520-bfe5-6f0f3663dcb8 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:36.451372 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-eeaa25e5-579a-4520-bfe5-6f0f3663dcb8 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:36.453387 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-eeaa25e5-579a-4520-bfe5-6f0f3663dcb8 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:36.488497 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-7ee40ea3-ccf1-48cb-b6c3-534db407e5a4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:36.496043 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7ee40ea3-ccf1-48cb-b6c3-534db407e5a4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1522 microversion: 2.1 time: 0.217913 Jan 11 15:13:36.497062 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 224/463] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:36 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:36.501701 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-eeaa25e5-579a-4520-bfe5-6f0f3663dcb8 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:36.502236 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-eeaa25e5-579a-4520-bfe5-6f0f3663dcb8 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:36.502753 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.objects.instance [None req-eeaa25e5-579a-4520-bfe5-6f0f3663dcb8 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lazy-loading 'fault' on Instance uuid 7ccfb598-d95c-4312-8c81-457b98804ce5 {{(pid=116903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 15:13:36.514350 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b390562b-cad7-40f4-9e3e-fe783362912f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:36.515389 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b390562b-cad7-40f4-9e3e-fe783362912f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:36.524137 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b390562b-cad7-40f4-9e3e-fe783362912f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:36.525415 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b390562b-cad7-40f4-9e3e-fe783362912f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:36.526485 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b390562b-cad7-40f4-9e3e-fe783362912f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:36.527618 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b390562b-cad7-40f4-9e3e-fe783362912f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:36.554957 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-eeaa25e5-579a-4520-bfe5-6f0f3663dcb8 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:36.574268 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-eeaa25e5-579a-4520-bfe5-6f0f3663dcb8 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5" status: 200 len: 1303 microversion: 2.1 time: 0.148227 Jan 11 15:13:36.585533 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 240/464] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:36 2022] GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5 => generated 1303 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:36.688445 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b390562b-cad7-40f4-9e3e-fe783362912f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28196 microversion: 2.1 time: 0.174309 Jan 11 15:13:36.689306 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 225/465] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:36 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28196 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:13:37.000950 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-099817f0-7067-4b03-8881-d76c6f0ce3d2 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:37.002506 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-099817f0-7067-4b03-8881-d76c6f0ce3d2 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:37.010627 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-099817f0-7067-4b03-8881-d76c6f0ce3d2 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:37.011205 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-099817f0-7067-4b03-8881-d76c6f0ce3d2 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:37.012139 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-099817f0-7067-4b03-8881-d76c6f0ce3d2 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:37.012651 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-099817f0-7067-4b03-8881-d76c6f0ce3d2 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:37.038422 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-54eb689b-7272-489b-a864-c98ace15a33c req-da745cd1-a598-4d9b-8ed9-343a44faab2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92cb3dbf-b655-497a-9d23-6036c8b622f6", "tag": "8ee4bfe2-ea98-4f3d-aa81-10433dea4b21"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:37.041251 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:13:37.041251 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:13:37.053238 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-54eb689b-7272-489b-a864-c98ace15a33c req-da745cd1-a598-4d9b-8ed9-343a44faab2c service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:37.053722 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-54eb689b-7272-489b-a864-c98ace15a33c req-da745cd1-a598-4d9b-8ed9-343a44faab2c service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:37.069515 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-54eb689b-7272-489b-a864-c98ace15a33c req-da745cd1-a598-4d9b-8ed9-343a44faab2c service nova] Creating event network-changed:8ee4bfe2-ea98-4f3d-aa81-10433dea4b21 for instance 92cb3dbf-b655-497a-9d23-6036c8b622f6 on hv-cinder-82418 Jan 11 15:13:37.074505 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [req-54eb689b-7272-489b-a864-c98ace15a33c req-da745cd1-a598-4d9b-8ed9-343a44faab2c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042281 Jan 11 15:13:37.075098 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 226/466] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:13:37.079868 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-68b242a6-ef30-4b82-bc9b-77b6aaf89427 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:37.085110 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-68b242a6-ef30-4b82-bc9b-77b6aaf89427 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:37.086797 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-68b242a6-ef30-4b82-bc9b-77b6aaf89427 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:37.087709 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-68b242a6-ef30-4b82-bc9b-77b6aaf89427 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:37.088630 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-68b242a6-ef30-4b82-bc9b-77b6aaf89427 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:37.089136 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-68b242a6-ef30-4b82-bc9b-77b6aaf89427 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:37.136464 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-099817f0-7067-4b03-8881-d76c6f0ce3d2 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28397 microversion: 2.20 time: 0.140039 Jan 11 15:13:37.139359 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 241/467] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:13:36 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28397 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:13:37.260286 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-68b242a6-ef30-4b82-bc9b-77b6aaf89427 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:37.268902 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-68b242a6-ef30-4b82-bc9b-77b6aaf89427 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1319 microversion: 2.1 time: 0.192610 Jan 11 15:13:37.269630 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 227/468] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:37 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:37.513643 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ec5bd7ba-4493-475f-bb8e-70581eb47982 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:37.514365 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-ec5bd7ba-4493-475f-bb8e-70581eb47982 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:37.521276 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ec5bd7ba-4493-475f-bb8e-70581eb47982 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:37.521883 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ec5bd7ba-4493-475f-bb8e-70581eb47982 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:37.522672 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ec5bd7ba-4493-475f-bb8e-70581eb47982 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:37.523111 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ec5bd7ba-4493-475f-bb8e-70581eb47982 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:37.596603 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-516ae535-6e87-4612-bcdd-f9b7ecee5192 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:37.597227 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-516ae535-6e87-4612-bcdd-f9b7ecee5192 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: 7ccfb598-d95c-4312-8c81-457b98804ce5] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:37.608208 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-516ae535-6e87-4612-bcdd-f9b7ecee5192 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:37.608853 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-516ae535-6e87-4612-bcdd-f9b7ecee5192 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:37.610521 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-516ae535-6e87-4612-bcdd-f9b7ecee5192 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:37.611131 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-516ae535-6e87-4612-bcdd-f9b7ecee5192 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:37.632777 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.wsgi [None req-516ae535-6e87-4612-bcdd-f9b7ecee5192 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] HTTP exception thrown: Instance 7ccfb598-d95c-4312-8c81-457b98804ce5 could not be found. Jan 11 15:13:37.633424 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-516ae535-6e87-4612-bcdd-f9b7ecee5192 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Returning 404 to user: Instance 7ccfb598-d95c-4312-8c81-457b98804ce5 could not be found. {{(pid=116902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:13:37.634457 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-516ae535-6e87-4612-bcdd-f9b7ecee5192 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5" status: 404 len: 111 microversion: 2.1 time: 0.044713 Jan 11 15:13:37.635007 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 228/469] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:37 2022] GET /compute/v2.1/servers/7ccfb598-d95c-4312-8c81-457b98804ce5 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 11 15:13:37.700502 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-74114d5a-3052-45e7-8990-8b4b58a72563 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:37.702179 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-74114d5a-3052-45e7-8990-8b4b58a72563 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:37.711327 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-74114d5a-3052-45e7-8990-8b4b58a72563 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:37.717024 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-74114d5a-3052-45e7-8990-8b4b58a72563 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:37.717024 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-74114d5a-3052-45e7-8990-8b4b58a72563 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:37.717688 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-74114d5a-3052-45e7-8990-8b4b58a72563 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:37.721027 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-ec5bd7ba-4493-475f-bb8e-70581eb47982 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:37.730765 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-ec5bd7ba-4493-475f-bb8e-70581eb47982 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1522 microversion: 2.1 time: 0.221059 Jan 11 15:13:37.731925 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 242/470] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:37 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:37.815773 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-1b6b3480-0bd4-4dfa-b573-b7d7e6eecf06 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1601823986", "imageRef": "d0ce98ab-06a2-4e75-9f37-288864a22cb9", "flavorRef": "452", "networks": [{"uuid": "9d94c25d-58e1-44a7-9c50-85c32db9bd52"}]}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:37.843008 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-74114d5a-3052-45e7-8990-8b4b58a72563 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28196 microversion: 2.1 time: 0.146547 Jan 11 15:13:37.843986 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 229/471] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:37 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28196 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:13:37.887346 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.network.neutron [None req-1b6b3480-0bd4-4dfa-b573-b7d7e6eecf06 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] validate_networks() for [('9d94c25d-58e1-44a7-9c50-85c32db9bd52', None, None, None, None, None)] {{(pid=116903) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 15:13:38.154225 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e23f46fc-0435-4056-bdb7-1a74b4aac971 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:38.155047 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e23f46fc-0435-4056-bdb7-1a74b4aac971 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:38.168983 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e23f46fc-0435-4056-bdb7-1a74b4aac971 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:38.169774 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e23f46fc-0435-4056-bdb7-1a74b4aac971 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:38.170827 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e23f46fc-0435-4056-bdb7-1a74b4aac971 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:38.175095 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e23f46fc-0435-4056-bdb7-1a74b4aac971 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:38.374247 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e23f46fc-0435-4056-bdb7-1a74b4aac971 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28397 microversion: 2.20 time: 0.225576 Jan 11 15:13:38.375138 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 230/472] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:13:38 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28397 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:13:38.382342 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-78ffaa30-bb40-407c-a438-483fde91f773 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:38.391607 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-78ffaa30-bb40-407c-a438-483fde91f773 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:38.414091 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-78ffaa30-bb40-407c-a438-483fde91f773 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:38.414463 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-78ffaa30-bb40-407c-a438-483fde91f773 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:38.415321 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-78ffaa30-bb40-407c-a438-483fde91f773 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:38.417700 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-78ffaa30-bb40-407c-a438-483fde91f773 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:38.727586 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-1b6b3480-0bd4-4dfa-b573-b7d7e6eecf06 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Flavor limits 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 15:13:38.730063 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-1b6b3480-0bd4-4dfa-b573-b7d7e6eecf06 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Image limits 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 15:13:38.731011 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-1b6b3480-0bd4-4dfa-b573-b7d7e6eecf06 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Flavor pref 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 15:13:38.733773 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-1b6b3480-0bd4-4dfa-b573-b7d7e6eecf06 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Image pref 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 15:13:38.734391 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-1b6b3480-0bd4-4dfa-b573-b7d7e6eecf06 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 15:13:38.763703 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1b6b3480-0bd4-4dfa-b573-b7d7e6eecf06 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:38.765288 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1b6b3480-0bd4-4dfa-b573-b7d7e6eecf06 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:38.768604 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1b6b3480-0bd4-4dfa-b573-b7d7e6eecf06 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:38.770643 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1b6b3480-0bd4-4dfa-b573-b7d7e6eecf06 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:38.797701 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.quota [None req-1b6b3480-0bd4-4dfa-b573-b7d7e6eecf06 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Getting quotas for project 1c371bd15cae4827a44612b4cd273a42. Resources: {'instances', 'cores', 'ram'} {{(pid=116903) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 15:13:38.803829 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.quota [None req-1b6b3480-0bd4-4dfa-b573-b7d7e6eecf06 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Getting quotas for user 44478a3f9c404ce1bbc35c1f904b87be and project 1c371bd15cae4827a44612b4cd273a42. Resources: {'instances', 'cores', 'ram'} {{(pid=116903) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 15:13:38.832833 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-1b6b3480-0bd4-4dfa-b573-b7d7e6eecf06 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Going to run 1 instances... {{(pid=116903) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 15:13:38.837193 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-1b6b3480-0bd4-4dfa-b573-b7d7e6eecf06 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: be52529f-eb7b-4aae-8286-bcbfba0a3320] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0ce98ab-06a2-4e75-9f37-288864a22cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 15:13:38.857063 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-78ffaa30-bb40-407c-a438-483fde91f773 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:38.865852 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-78ffaa30-bb40-407c-a438-483fde91f773 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1319 microversion: 2.1 time: 0.489196 Jan 11 15:13:38.866970 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 231/473] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:38 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1319 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:38.872405 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8d258e0f-1598-40fc-88b9-4d9d81a6e48b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:38.873219 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8d258e0f-1598-40fc-88b9-4d9d81a6e48b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:38.879775 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8d258e0f-1598-40fc-88b9-4d9d81a6e48b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:38.880227 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8d258e0f-1598-40fc-88b9-4d9d81a6e48b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:38.881021 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8d258e0f-1598-40fc-88b9-4d9d81a6e48b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:38.881458 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8d258e0f-1598-40fc-88b9-4d9d81a6e48b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:38.999824 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-1b6b3480-0bd4-4dfa-b573-b7d7e6eecf06 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.189341 Jan 11 15:13:39.003352 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 243/474] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jan 11 15:13:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1191 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 15:13:39.019083 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-14db0b01-22c1-4714-b722-1b7973916b21 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:39.026218 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-14db0b01-22c1-4714-b722-1b7973916b21 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:39.035843 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-14db0b01-22c1-4714-b722-1b7973916b21 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:39.036297 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-14db0b01-22c1-4714-b722-1b7973916b21 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:39.037194 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-14db0b01-22c1-4714-b722-1b7973916b21 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:39.037521 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-14db0b01-22c1-4714-b722-1b7973916b21 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:39.104769 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-8d258e0f-1598-40fc-88b9-4d9d81a6e48b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:39.112320 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8d258e0f-1598-40fc-88b9-4d9d81a6e48b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1522 microversion: 2.1 time: 0.244112 Jan 11 15:13:39.112896 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 232/475] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:38 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:39.124550 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7a051888-5163-41a1-b888-f17fd0fcfb83 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:39.125153 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-7a051888-5163-41a1-b888-f17fd0fcfb83 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: be52529f-eb7b-4aae-8286-bcbfba0a3320] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:39.217893 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-7a051888-5163-41a1-b888-f17fd0fcfb83 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:39.217893 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7a051888-5163-41a1-b888-f17fd0fcfb83 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320" status: 200 len: 1214 microversion: 2.1 time: 0.072064 Jan 11 15:13:39.217893 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 233/476] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:39 2022] GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:39.220040 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-14db0b01-22c1-4714-b722-1b7973916b21 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28196 microversion: 2.1 time: 0.205966 Jan 11 15:13:39.220040 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 244/477] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:39 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28196 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:13:39.385899 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1570d7ca-e2ec-44d3-8bbd-8f674e19e154 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:39.386804 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1570d7ca-e2ec-44d3-8bbd-8f674e19e154 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:39.392541 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1570d7ca-e2ec-44d3-8bbd-8f674e19e154 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:39.392986 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1570d7ca-e2ec-44d3-8bbd-8f674e19e154 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:39.393757 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1570d7ca-e2ec-44d3-8bbd-8f674e19e154 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:39.394187 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1570d7ca-e2ec-44d3-8bbd-8f674e19e154 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:39.546387 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1570d7ca-e2ec-44d3-8bbd-8f674e19e154 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.160856 Jan 11 15:13:39.547614 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 234/478] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:13:39 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:13:39.883728 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-fabd2bc0-ce9d-45ca-9087-c8be69ad00e8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:39.885158 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-fabd2bc0-ce9d-45ca-9087-c8be69ad00e8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:39.892059 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fabd2bc0-ce9d-45ca-9087-c8be69ad00e8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:39.893051 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fabd2bc0-ce9d-45ca-9087-c8be69ad00e8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:39.893965 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fabd2bc0-ce9d-45ca-9087-c8be69ad00e8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:39.894482 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fabd2bc0-ce9d-45ca-9087-c8be69ad00e8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:40.134982 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-aefd8e29-cbdc-41de-b5c4-3bdbcf0714c3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:40.136609 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-aefd8e29-cbdc-41de-b5c4-3bdbcf0714c3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:40.148851 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aefd8e29-cbdc-41de-b5c4-3bdbcf0714c3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:40.150593 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aefd8e29-cbdc-41de-b5c4-3bdbcf0714c3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:40.154290 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aefd8e29-cbdc-41de-b5c4-3bdbcf0714c3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:40.155431 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aefd8e29-cbdc-41de-b5c4-3bdbcf0714c3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:40.163767 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-fabd2bc0-ce9d-45ca-9087-c8be69ad00e8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:40.172844 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-fabd2bc0-ce9d-45ca-9087-c8be69ad00e8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1319 microversion: 2.1 time: 0.292983 Jan 11 15:13:40.174381 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 245/479] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:39 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:40.209849 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-9c93979a-77e1-45de-a112-3ac478b60afe tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:40.210819 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-9c93979a-77e1-45de-a112-3ac478b60afe tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: be52529f-eb7b-4aae-8286-bcbfba0a3320] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:40.217460 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9c93979a-77e1-45de-a112-3ac478b60afe tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:40.218126 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9c93979a-77e1-45de-a112-3ac478b60afe tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:40.223092 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9c93979a-77e1-45de-a112-3ac478b60afe tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:40.223092 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9c93979a-77e1-45de-a112-3ac478b60afe tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:40.323663 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-9c93979a-77e1-45de-a112-3ac478b60afe tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:40.339984 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-9c93979a-77e1-45de-a112-3ac478b60afe tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320" status: 200 len: 1218 microversion: 2.1 time: 0.133820 Jan 11 15:13:40.344048 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 246/480] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:40 2022] GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320 => generated 1218 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:13:40.348884 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f1a382eb-c32e-4318-94b0-640bd4122e12 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:40.349849 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f1a382eb-c32e-4318-94b0-640bd4122e12 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:40.361529 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f1a382eb-c32e-4318-94b0-640bd4122e12 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:40.362183 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f1a382eb-c32e-4318-94b0-640bd4122e12 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:40.363270 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f1a382eb-c32e-4318-94b0-640bd4122e12 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:40.363885 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f1a382eb-c32e-4318-94b0-640bd4122e12 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:40.452400 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-aefd8e29-cbdc-41de-b5c4-3bdbcf0714c3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:40.468955 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-aefd8e29-cbdc-41de-b5c4-3bdbcf0714c3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1522 microversion: 2.1 time: 0.342934 Jan 11 15:13:40.475408 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f1a382eb-c32e-4318-94b0-640bd4122e12 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28196 microversion: 2.1 time: 0.133540 Jan 11 15:13:40.476642 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 247/481] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:40 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28196 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:13:40.487553 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 235/482] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:40 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:40.538624 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-083fa1f2-7791-4c9d-a674-23d8796251c0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd91374f-fbc7-4444-bdbc-6c5f44720cee"}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:40.540578 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-083fa1f2-7791-4c9d-a674-23d8796251c0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 5d8b8b19-117d-4669-933b-5f86257caff6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:40.548786 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-083fa1f2-7791-4c9d-a674-23d8796251c0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:40.549479 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-083fa1f2-7791-4c9d-a674-23d8796251c0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:40.550580 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-083fa1f2-7791-4c9d-a674-23d8796251c0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:40.551183 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-083fa1f2-7791-4c9d-a674-23d8796251c0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:40.559863 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-45cff8d1-f6ad-47a0-92e6-2a9517911690 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:40.560886 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-45cff8d1-f6ad-47a0-92e6-2a9517911690 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:40.577119 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-45cff8d1-f6ad-47a0-92e6-2a9517911690 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:40.578183 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-45cff8d1-f6ad-47a0-92e6-2a9517911690 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:40.580743 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-45cff8d1-f6ad-47a0-92e6-2a9517911690 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:40.581281 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-45cff8d1-f6ad-47a0-92e6-2a9517911690 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:40.694437 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.wsgi [None req-083fa1f2-7791-4c9d-a674-23d8796251c0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] HTTP exception thrown: Invalid volume: volume fd91374f-fbc7-4444-bdbc-6c5f44720cee is already attached to instances: 5d8b8b19-117d-4669-933b-5f86257caff6 Jan 11 15:13:40.695195 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-083fa1f2-7791-4c9d-a674-23d8796251c0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Returning 400 to user: Invalid volume: volume fd91374f-fbc7-4444-bdbc-6c5f44720cee is already attached to instances: 5d8b8b19-117d-4669-933b-5f86257caff6 {{(pid=116903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:13:40.696360 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-083fa1f2-7791-4c9d-a674-23d8796251c0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "POST /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.162405 Jan 11 15:13:40.698078 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 248/483] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jan 11 15:13:40 2022] POST /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6/os-volume_attachments => generated 174 bytes in 166 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 11 15:13:40.771080 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b49bff3f-aed4-45f3-a2f8-d999fe002f31 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:40.773016 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b49bff3f-aed4-45f3-a2f8-d999fe002f31 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 5d8b8b19-117d-4669-933b-5f86257caff6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:40.782963 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b49bff3f-aed4-45f3-a2f8-d999fe002f31 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:40.784614 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b49bff3f-aed4-45f3-a2f8-d999fe002f31 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:40.786361 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b49bff3f-aed4-45f3-a2f8-d999fe002f31 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:40.786959 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b49bff3f-aed4-45f3-a2f8-d999fe002f31 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:40.799864 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-45cff8d1-f6ad-47a0-92e6-2a9517911690 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.245418 Jan 11 15:13:40.801732 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 236/484] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:13:40 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:13:40.867812 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.objects.instance [None req-b49bff3f-aed4-45f3-a2f8-d999fe002f31 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lazy-loading 'services' on Instance uuid 5d8b8b19-117d-4669-933b-5f86257caff6 {{(pid=116903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 15:13:41.141440 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b49bff3f-aed4-45f3-a2f8-d999fe002f31 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6/os-volume_attachments/fd91374f-fbc7-4444-bdbc-6c5f44720cee" status: 202 len: 0 microversion: 2.1 time: 0.375253 Jan 11 15:13:41.145372 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 249/485] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jan 11 15:13:40 2022] DELETE /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6/os-volume_attachments/fd91374f-fbc7-4444-bdbc-6c5f44720cee => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:13:41.162327 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e837c2ba-fd97-424e-8a72-46d8ca5d3f2b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:41.163395 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e837c2ba-fd97-424e-8a72-46d8ca5d3f2b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 5d8b8b19-117d-4669-933b-5f86257caff6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:41.179788 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e837c2ba-fd97-424e-8a72-46d8ca5d3f2b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:41.180469 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e837c2ba-fd97-424e-8a72-46d8ca5d3f2b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:41.181319 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e837c2ba-fd97-424e-8a72-46d8ca5d3f2b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:41.181805 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e837c2ba-fd97-424e-8a72-46d8ca5d3f2b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:41.191608 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c742fa67-0f03-4d80-8331-8517e6e77c5d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:41.192398 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c742fa67-0f03-4d80-8331-8517e6e77c5d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:41.200194 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c742fa67-0f03-4d80-8331-8517e6e77c5d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:41.201234 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c742fa67-0f03-4d80-8331-8517e6e77c5d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:41.202235 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c742fa67-0f03-4d80-8331-8517e6e77c5d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:41.202858 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c742fa67-0f03-4d80-8331-8517e6e77c5d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:41.254701 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e837c2ba-fd97-424e-8a72-46d8ca5d3f2b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103933 Jan 11 15:13:41.255841 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 237/486] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:13:41 2022] GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:13:41.365765 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e80952d4-a44c-44b2-8c8d-f679114701f0 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:41.367425 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e80952d4-a44c-44b2-8c8d-f679114701f0 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: be52529f-eb7b-4aae-8286-bcbfba0a3320] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:41.382806 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e80952d4-a44c-44b2-8c8d-f679114701f0 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:41.383282 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e80952d4-a44c-44b2-8c8d-f679114701f0 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:41.384227 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e80952d4-a44c-44b2-8c8d-f679114701f0 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:41.384823 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e80952d4-a44c-44b2-8c8d-f679114701f0 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:41.567322 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e80952d4-a44c-44b2-8c8d-f679114701f0 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:41.577601 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e80952d4-a44c-44b2-8c8d-f679114701f0 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320" status: 200 len: 1266 microversion: 2.1 time: 0.222059 Jan 11 15:13:41.578191 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 238/487] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:41 2022] GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:13:41.583254 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3aa357a1-68ff-41a3-940e-1dcb0ec40154 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:41.584389 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3aa357a1-68ff-41a3-940e-1dcb0ec40154 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:41.591540 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3aa357a1-68ff-41a3-940e-1dcb0ec40154 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:41.594373 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3aa357a1-68ff-41a3-940e-1dcb0ec40154 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:41.594373 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3aa357a1-68ff-41a3-940e-1dcb0ec40154 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:41.594572 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-c742fa67-0f03-4d80-8331-8517e6e77c5d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:41.594691 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3aa357a1-68ff-41a3-940e-1dcb0ec40154 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:41.608122 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c742fa67-0f03-4d80-8331-8517e6e77c5d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1319 microversion: 2.1 time: 0.415403 Jan 11 15:13:41.611407 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 250/488] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:41 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1319 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:13:41.622516 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b30ef330-7924-4af1-baeb-abcb19d93ec6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:41.625831 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b30ef330-7924-4af1-baeb-abcb19d93ec6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:41.638707 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b30ef330-7924-4af1-baeb-abcb19d93ec6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:41.639458 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b30ef330-7924-4af1-baeb-abcb19d93ec6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:41.640495 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b30ef330-7924-4af1-baeb-abcb19d93ec6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:41.641098 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b30ef330-7924-4af1-baeb-abcb19d93ec6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:41.689484 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3aa357a1-68ff-41a3-940e-1dcb0ec40154 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28196 microversion: 2.1 time: 0.109407 Jan 11 15:13:41.694620 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 239/489] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:41 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28196 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:13:41.813453 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-01f134a0-8721-4347-bc00-399fd6d0da86 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:41.814906 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-01f134a0-8721-4347-bc00-399fd6d0da86 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:41.825891 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-01f134a0-8721-4347-bc00-399fd6d0da86 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:41.826715 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-01f134a0-8721-4347-bc00-399fd6d0da86 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:41.828035 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-01f134a0-8721-4347-bc00-399fd6d0da86 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:41.828667 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-01f134a0-8721-4347-bc00-399fd6d0da86 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:41.931592 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-01f134a0-8721-4347-bc00-399fd6d0da86 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.122090 Jan 11 15:13:41.932966 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 240/490] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:13:41 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:13:42.035159 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-b30ef330-7924-4af1-baeb-abcb19d93ec6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:42.046181 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b30ef330-7924-4af1-baeb-abcb19d93ec6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1502 microversion: 2.1 time: 0.433540 Jan 11 15:13:42.058471 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 251/491] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:41 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1502 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:42.065431 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-dc95bc23-90e1-4555-b8f4-f0ce2a136acb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5ee4bcf-290b-4ec3-b689-ecd736a39ce9"}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:42.068293 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-dc95bc23-90e1-4555-b8f4-f0ce2a136acb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:42.104566 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dc95bc23-90e1-4555-b8f4-f0ce2a136acb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:42.105635 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dc95bc23-90e1-4555-b8f4-f0ce2a136acb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:42.107742 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dc95bc23-90e1-4555-b8f4-f0ce2a136acb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:42.108667 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dc95bc23-90e1-4555-b8f4-f0ce2a136acb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:42.139653 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.wsgi [None req-dc95bc23-90e1-4555-b8f4-f0ce2a136acb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] HTTP exception thrown: Cannot 'attach_volume' instance 3b978091-0bf4-4e69-8053-76e49154df4c while it is in vm_state rescued Jan 11 15:13:42.140489 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-dc95bc23-90e1-4555-b8f4-f0ce2a136acb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Returning 409 to user: Cannot 'attach_volume' instance 3b978091-0bf4-4e69-8053-76e49154df4c while it is in vm_state rescued {{(pid=116902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:13:42.141083 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-dc95bc23-90e1-4555-b8f4-f0ce2a136acb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "POST /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.080491 Jan 11 15:13:42.141630 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 241/492] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jan 11 15:13:42 2022] POST /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 152 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jan 11 15:13:42.150445 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-03f21a65-b186-4481-9d0c-41cca56ae545 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:42.150978 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-03f21a65-b186-4481-9d0c-41cca56ae545 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:42.161945 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-03f21a65-b186-4481-9d0c-41cca56ae545 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:42.162405 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-03f21a65-b186-4481-9d0c-41cca56ae545 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:42.163196 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-03f21a65-b186-4481-9d0c-41cca56ae545 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:42.163792 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-03f21a65-b186-4481-9d0c-41cca56ae545 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:42.265205 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-15858a62-fa42-4c72-aea0-44f74d41958d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:42.266152 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-15858a62-fa42-4c72-aea0-44f74d41958d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 5d8b8b19-117d-4669-933b-5f86257caff6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:42.279654 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-15858a62-fa42-4c72-aea0-44f74d41958d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:42.280215 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-15858a62-fa42-4c72-aea0-44f74d41958d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:42.282208 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-15858a62-fa42-4c72-aea0-44f74d41958d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:42.282657 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-15858a62-fa42-4c72-aea0-44f74d41958d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:42.326602 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-15858a62-fa42-4c72-aea0-44f74d41958d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065279 Jan 11 15:13:42.327654 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 242/493] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:13:42 2022] GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:13:42.409667 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-03f21a65-b186-4481-9d0c-41cca56ae545 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "POST /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/action" status: 202 len: 0 microversion: 2.1 time: 0.256916 Jan 11 15:13:42.409667 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 252/494] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:42 2022] POST /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:13:42.413961 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f950334b-24da-434f-b702-ef482fa3f6dd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:42.414820 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f950334b-24da-434f-b702-ef482fa3f6dd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:42.426113 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f950334b-24da-434f-b702-ef482fa3f6dd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:42.427709 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f950334b-24da-434f-b702-ef482fa3f6dd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:42.434301 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f950334b-24da-434f-b702-ef482fa3f6dd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:42.434868 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f950334b-24da-434f-b702-ef482fa3f6dd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:42.595232 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a777515f-5108-40bf-b219-0ab1ed85185b tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:42.597792 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a777515f-5108-40bf-b219-0ab1ed85185b tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: be52529f-eb7b-4aae-8286-bcbfba0a3320] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:42.612303 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a777515f-5108-40bf-b219-0ab1ed85185b tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:42.615419 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a777515f-5108-40bf-b219-0ab1ed85185b tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:42.622185 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a777515f-5108-40bf-b219-0ab1ed85185b tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:42.622892 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a777515f-5108-40bf-b219-0ab1ed85185b tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:42.882268 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-a777515f-5108-40bf-b219-0ab1ed85185b tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:42.891268 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a777515f-5108-40bf-b219-0ab1ed85185b tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320" status: 200 len: 1272 microversion: 2.1 time: 0.300654 Jan 11 15:13:42.892426 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 253/495] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:42 2022] GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320 => generated 1272 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:13:42.905322 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b355521b-d7d5-4eef-8328-45921e03b557 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:42.905951 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b355521b-d7d5-4eef-8328-45921e03b557 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:42.912585 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b355521b-d7d5-4eef-8328-45921e03b557 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:42.913304 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b355521b-d7d5-4eef-8328-45921e03b557 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:42.915002 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b355521b-d7d5-4eef-8328-45921e03b557 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:42.916290 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b355521b-d7d5-4eef-8328-45921e03b557 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:43.083840 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f950334b-24da-434f-b702-ef482fa3f6dd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:43.091847 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f950334b-24da-434f-b702-ef482fa3f6dd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1510 microversion: 2.1 time: 0.682707 Jan 11 15:13:43.092415 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 243/496] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:42 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1510 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:43.097708 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0d87ae08-e616-4504-b303-823fda8b2607 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:43.098831 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0d87ae08-e616-4504-b303-823fda8b2607 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:43.108394 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0d87ae08-e616-4504-b303-823fda8b2607 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:43.108885 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0d87ae08-e616-4504-b303-823fda8b2607 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:43.109683 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0d87ae08-e616-4504-b303-823fda8b2607 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:43.110150 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0d87ae08-e616-4504-b303-823fda8b2607 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:43.261276 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0d87ae08-e616-4504-b303-823fda8b2607 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28485 microversion: 2.1 time: 0.166841 Jan 11 15:13:43.262177 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 244/497] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:43 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28485 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:13:43.272105 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-39bfd031-5fa5-4a4f-b914-23f77440c969 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:43.272105 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-39bfd031-5fa5-4a4f-b914-23f77440c969 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:43.278300 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-b355521b-d7d5-4eef-8328-45921e03b557 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:43.282115 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-39bfd031-5fa5-4a4f-b914-23f77440c969 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:43.284444 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-39bfd031-5fa5-4a4f-b914-23f77440c969 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:43.287634 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b355521b-d7d5-4eef-8328-45921e03b557 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1319 microversion: 2.1 time: 0.392211 Jan 11 15:13:43.288809 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 254/498] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:42 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1319 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:43.289117 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-39bfd031-5fa5-4a4f-b914-23f77440c969 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:43.291470 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-39bfd031-5fa5-4a4f-b914-23f77440c969 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:43.342454 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d2998ede-5121-4ba2-b66d-c67a110a60b3 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:43.343529 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d2998ede-5121-4ba2-b66d-c67a110a60b3 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 5d8b8b19-117d-4669-933b-5f86257caff6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:43.349677 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d2998ede-5121-4ba2-b66d-c67a110a60b3 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:43.350138 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d2998ede-5121-4ba2-b66d-c67a110a60b3 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:43.350992 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d2998ede-5121-4ba2-b66d-c67a110a60b3 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:43.351694 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d2998ede-5121-4ba2-b66d-c67a110a60b3 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:43.383480 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d2998ede-5121-4ba2-b66d-c67a110a60b3 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048241 Jan 11 15:13:43.384501 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 255/499] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:13:43 2022] GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 15:13:43.389033 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-39bfd031-5fa5-4a4f-b914-23f77440c969 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.124585 Jan 11 15:13:43.391688 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 245/500] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:13:43 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:13:43.573342 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-1d0c8624-c906-4c28-a280-b17d3eecd13a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-785516821", "imageRef": "d0ce98ab-06a2-4e75-9f37-288864a22cb9", "flavorRef": "452", "networks": [{"uuid": "76369959-3647-4f73-a129-60ab7e24f3af"}]}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:43.626671 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.network.neutron [None req-1d0c8624-c906-4c28-a280-b17d3eecd13a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] validate_networks() for [('76369959-3647-4f73-a129-60ab7e24f3af', None, None, None, None, None)] {{(pid=116903) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 15:13:43.909823 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-dddb269c-c4f8-49b9-b738-6cb62705703a tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:43.911847 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-dddb269c-c4f8-49b9-b738-6cb62705703a tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: be52529f-eb7b-4aae-8286-bcbfba0a3320] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:43.920058 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dddb269c-c4f8-49b9-b738-6cb62705703a tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:43.922015 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dddb269c-c4f8-49b9-b738-6cb62705703a tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:43.923071 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dddb269c-c4f8-49b9-b738-6cb62705703a tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:43.924393 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dddb269c-c4f8-49b9-b738-6cb62705703a tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:44.290885 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-dddb269c-c4f8-49b9-b738-6cb62705703a tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:44.294268 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-dddb269c-c4f8-49b9-b738-6cb62705703a tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320" status: 200 len: 1314 microversion: 2.1 time: 0.389529 Jan 11 15:13:44.295171 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 246/501] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:43 2022] GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320 => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:44.300160 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b388b3bd-72c6-4c8a-88d6-81c14d4cb88a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:44.304162 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b388b3bd-72c6-4c8a-88d6-81c14d4cb88a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:44.316986 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b388b3bd-72c6-4c8a-88d6-81c14d4cb88a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:44.318822 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b388b3bd-72c6-4c8a-88d6-81c14d4cb88a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:44.320412 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b388b3bd-72c6-4c8a-88d6-81c14d4cb88a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:44.320706 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b388b3bd-72c6-4c8a-88d6-81c14d4cb88a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:44.359737 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-1d0c8624-c906-4c28-a280-b17d3eecd13a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Flavor limits 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 15:13:44.361925 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-1d0c8624-c906-4c28-a280-b17d3eecd13a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Image limits 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 15:13:44.362606 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-1d0c8624-c906-4c28-a280-b17d3eecd13a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Flavor pref 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 15:13:44.364011 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-1d0c8624-c906-4c28-a280-b17d3eecd13a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Image pref 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 15:13:44.364804 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-1d0c8624-c906-4c28-a280-b17d3eecd13a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 15:13:44.376006 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1d0c8624-c906-4c28-a280-b17d3eecd13a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:44.377268 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1d0c8624-c906-4c28-a280-b17d3eecd13a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:44.378390 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1d0c8624-c906-4c28-a280-b17d3eecd13a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:44.379034 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1d0c8624-c906-4c28-a280-b17d3eecd13a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:44.402925 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.quota [None req-1d0c8624-c906-4c28-a280-b17d3eecd13a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Getting quotas for project 2ed51a96e66d44ca9c02bbe820c68180. Resources: {'instances', 'cores', 'ram'} {{(pid=116903) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 15:13:44.407183 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.quota [None req-1d0c8624-c906-4c28-a280-b17d3eecd13a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Getting quotas for user 13f0a933d4d34f8984292406266866a0 and project 2ed51a96e66d44ca9c02bbe820c68180. Resources: {'instances', 'cores', 'ram'} {{(pid=116903) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 15:13:44.418681 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-1d0c8624-c906-4c28-a280-b17d3eecd13a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Going to run 1 instances... {{(pid=116903) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 15:13:44.421104 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-1d0c8624-c906-4c28-a280-b17d3eecd13a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 1d506318-9988-434f-b8d6-bf11cbdef7b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0ce98ab-06a2-4e75-9f37-288864a22cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 15:13:44.539076 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-1d0c8624-c906-4c28-a280-b17d3eecd13a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.969516 Jan 11 15:13:44.542148 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 256/502] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jan 11 15:13:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 15:13:44.553989 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c3850526-40d9-47b1-a6fd-33732afd58f6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:44.555637 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c3850526-40d9-47b1-a6fd-33732afd58f6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:44.586292 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c3850526-40d9-47b1-a6fd-33732afd58f6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:44.587049 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c3850526-40d9-47b1-a6fd-33732afd58f6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:44.589791 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c3850526-40d9-47b1-a6fd-33732afd58f6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:44.590397 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c3850526-40d9-47b1-a6fd-33732afd58f6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:44.722300 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c3850526-40d9-47b1-a6fd-33732afd58f6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28487 microversion: 2.1 time: 0.176489 Jan 11 15:13:44.723367 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b388b3bd-72c6-4c8a-88d6-81c14d4cb88a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:44.725949 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 257/503] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:44 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28487 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:13:44.739620 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b388b3bd-72c6-4c8a-88d6-81c14d4cb88a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1510 microversion: 2.1 time: 0.441365 Jan 11 15:13:44.739620 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 247/504] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:44 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1510 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:44.744077 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b7d51f33-0fbf-410c-9ed1-e310e578a3f6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:44.744784 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b7d51f33-0fbf-410c-9ed1-e310e578a3f6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:44.755053 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a6688f99-8561-4d18-bc18-b482c313b7ba tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:44.761300 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a6688f99-8561-4d18-bc18-b482c313b7ba tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:44.764558 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b7d51f33-0fbf-410c-9ed1-e310e578a3f6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:44.766385 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b7d51f33-0fbf-410c-9ed1-e310e578a3f6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:44.767227 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b7d51f33-0fbf-410c-9ed1-e310e578a3f6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:44.769967 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b7d51f33-0fbf-410c-9ed1-e310e578a3f6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:44.774191 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a6688f99-8561-4d18-bc18-b482c313b7ba tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:44.774636 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a6688f99-8561-4d18-bc18-b482c313b7ba tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:44.775482 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a6688f99-8561-4d18-bc18-b482c313b7ba tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:44.775931 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a6688f99-8561-4d18-bc18-b482c313b7ba tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:44.911937 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a6688f99-8561-4d18-bc18-b482c313b7ba tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.171854 Jan 11 15:13:44.912914 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 248/505] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:13:44 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:13:44.919968 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5a7e197b-38d6-48f9-b919-7f10b2879057 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:44.921106 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5a7e197b-38d6-48f9-b919-7f10b2879057 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 1d506318-9988-434f-b8d6-bf11cbdef7b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:45.087878 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-5a7e197b-38d6-48f9-b919-7f10b2879057 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:45.115881 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5a7e197b-38d6-48f9-b919-7f10b2879057 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4" status: 200 len: 1217 microversion: 2.1 time: 0.192436 Jan 11 15:13:45.116639 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 249/506] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:44 2022] GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4 => generated 1217 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:45.144983 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-b7d51f33-0fbf-410c-9ed1-e310e578a3f6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:45.150427 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-9c39ce5f-eafa-4248-a164-5948be30d7f3 req-48f1d6bc-4deb-422e-87f3-dd3f572a8e8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be52529f-eb7b-4aae-8286-bcbfba0a3320", "tag": "dbdee383-d3de-45d6-92a7-b388ebbfb33d"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:45.152986 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b7d51f33-0fbf-410c-9ed1-e310e578a3f6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1319 microversion: 2.1 time: 0.420898 Jan 11 15:13:45.153568 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 258/507] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:44 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1319 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:45.154047 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:13:45.154047 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:13:45.172317 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-9c39ce5f-eafa-4248-a164-5948be30d7f3 req-48f1d6bc-4deb-422e-87f3-dd3f572a8e8c service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:45.173097 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-9c39ce5f-eafa-4248-a164-5948be30d7f3 req-48f1d6bc-4deb-422e-87f3-dd3f572a8e8c service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:45.196298 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-9c39ce5f-eafa-4248-a164-5948be30d7f3 req-48f1d6bc-4deb-422e-87f3-dd3f572a8e8c service nova] Creating event network-changed:dbdee383-d3de-45d6-92a7-b388ebbfb33d for instance be52529f-eb7b-4aae-8286-bcbfba0a3320 on hv-cinder-82418 Jan 11 15:13:45.206618 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [req-9c39ce5f-eafa-4248-a164-5948be30d7f3 req-48f1d6bc-4deb-422e-87f3-dd3f572a8e8c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075889 Jan 11 15:13:45.208021 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 250/508] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:13:45.310910 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4f305b62-13a6-47ea-89d5-eb2d3c55d64c tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:45.316985 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4f305b62-13a6-47ea-89d5-eb2d3c55d64c tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: be52529f-eb7b-4aae-8286-bcbfba0a3320] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:45.332791 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4f305b62-13a6-47ea-89d5-eb2d3c55d64c tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:45.332791 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4f305b62-13a6-47ea-89d5-eb2d3c55d64c tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:45.332791 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4f305b62-13a6-47ea-89d5-eb2d3c55d64c tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:45.332791 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4f305b62-13a6-47ea-89d5-eb2d3c55d64c tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:45.606651 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-4f305b62-13a6-47ea-89d5-eb2d3c55d64c tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:45.615339 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4f305b62-13a6-47ea-89d5-eb2d3c55d64c tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320" status: 200 len: 1314 microversion: 2.1 time: 0.307984 Jan 11 15:13:45.624668 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 259/509] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:45 2022] GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:45.738120 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-73a66208-4223-48ec-a98e-ef8f21cac8db tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:45.739519 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-73a66208-4223-48ec-a98e-ef8f21cac8db tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:45.748515 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-73a66208-4223-48ec-a98e-ef8f21cac8db tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:45.748912 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-73a66208-4223-48ec-a98e-ef8f21cac8db tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:45.750698 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-73a66208-4223-48ec-a98e-ef8f21cac8db tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:45.751315 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-73a66208-4223-48ec-a98e-ef8f21cac8db tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:45.756215 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7d395b85-f5ee-4c03-8940-db11b0e19b5e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:45.758293 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7d395b85-f5ee-4c03-8940-db11b0e19b5e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:45.770525 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7d395b85-f5ee-4c03-8940-db11b0e19b5e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:45.771501 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7d395b85-f5ee-4c03-8940-db11b0e19b5e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:45.772701 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7d395b85-f5ee-4c03-8940-db11b0e19b5e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:45.773435 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7d395b85-f5ee-4c03-8940-db11b0e19b5e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:45.879247 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-73a66208-4223-48ec-a98e-ef8f21cac8db tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.144080 Jan 11 15:13:45.880182 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 251/510] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:45 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:13:45.900814 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-489fad29-627b-4053-8b6d-09b450763d4d req-93af49f8-d506-4ed6-95d7-1bf02f681a20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92cb3dbf-b655-497a-9d23-6036c8b622f6", "name": "network-vif-plugged", "status": "completed", "tag": "8ee4bfe2-ea98-4f3d-aa81-10433dea4b21"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:45.907613 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:13:45.907613 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:13:45.927323 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-489fad29-627b-4053-8b6d-09b450763d4d req-93af49f8-d506-4ed6-95d7-1bf02f681a20 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:45.931220 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-489fad29-627b-4053-8b6d-09b450763d4d req-93af49f8-d506-4ed6-95d7-1bf02f681a20 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:45.942349 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-7d395b85-f5ee-4c03-8940-db11b0e19b5e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:45.950758 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-489fad29-627b-4053-8b6d-09b450763d4d req-93af49f8-d506-4ed6-95d7-1bf02f681a20 service nova] Creating event network-vif-plugged:8ee4bfe2-ea98-4f3d-aa81-10433dea4b21 for instance 92cb3dbf-b655-497a-9d23-6036c8b622f6 on hv-cinder-82418 Jan 11 15:13:45.951957 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7d395b85-f5ee-4c03-8940-db11b0e19b5e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1510 microversion: 2.1 time: 0.199465 Jan 11 15:13:45.953112 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 260/511] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:45 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1510 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:45.959751 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d34a363f-db21-4ca4-a4e4-4e23c3a66538 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:45.961033 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d34a363f-db21-4ca4-a4e4-4e23c3a66538 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:45.965106 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [req-489fad29-627b-4053-8b6d-09b450763d4d req-93af49f8-d506-4ed6-95d7-1bf02f681a20 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083358 Jan 11 15:13:45.966069 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 252/512] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:13:45.968373 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d34a363f-db21-4ca4-a4e4-4e23c3a66538 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:45.969092 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d34a363f-db21-4ca4-a4e4-4e23c3a66538 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:45.970472 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d34a363f-db21-4ca4-a4e4-4e23c3a66538 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:45.971110 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d34a363f-db21-4ca4-a4e4-4e23c3a66538 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:46.134693 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9b34be79-bc44-4091-ae67-dee203e6537a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:46.135427 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9b34be79-bc44-4091-ae67-dee203e6537a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 1d506318-9988-434f-b8d6-bf11cbdef7b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:46.146071 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9b34be79-bc44-4091-ae67-dee203e6537a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:46.147057 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9b34be79-bc44-4091-ae67-dee203e6537a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:46.150793 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9b34be79-bc44-4091-ae67-dee203e6537a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:46.150793 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9b34be79-bc44-4091-ae67-dee203e6537a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:46.237358 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d34a363f-db21-4ca4-a4e4-4e23c3a66538 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.282702 Jan 11 15:13:46.238786 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 261/513] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:13:45 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:13:46.244560 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-35ea0610-4e32-4f58-933b-13dbf6a3525f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:46.245516 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-35ea0610-4e32-4f58-933b-13dbf6a3525f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:46.270963 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-35ea0610-4e32-4f58-933b-13dbf6a3525f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:46.279709 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-35ea0610-4e32-4f58-933b-13dbf6a3525f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:46.279709 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-35ea0610-4e32-4f58-933b-13dbf6a3525f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:46.279709 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-35ea0610-4e32-4f58-933b-13dbf6a3525f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:46.323205 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-9b34be79-bc44-4091-ae67-dee203e6537a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:46.334830 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9b34be79-bc44-4091-ae67-dee203e6537a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4" status: 200 len: 1213 microversion: 2.1 time: 0.205339 Jan 11 15:13:46.344528 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 253/514] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:46 2022] GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4 => generated 1213 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:46.640150 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-79af58a7-7785-4d63-ba7b-853622bed1a8 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:46.640150 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-79af58a7-7785-4d63-ba7b-853622bed1a8 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: be52529f-eb7b-4aae-8286-bcbfba0a3320] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:46.650533 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-79af58a7-7785-4d63-ba7b-853622bed1a8 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:46.652001 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-79af58a7-7785-4d63-ba7b-853622bed1a8 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:46.652985 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-79af58a7-7785-4d63-ba7b-853622bed1a8 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:46.653587 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-79af58a7-7785-4d63-ba7b-853622bed1a8 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:46.789425 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-35ea0610-4e32-4f58-933b-13dbf6a3525f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:46.805175 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-35ea0610-4e32-4f58-933b-13dbf6a3525f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1319 microversion: 2.1 time: 0.564835 Jan 11 15:13:46.805788 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 262/515] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:46 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1319 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:46.892269 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c977e67a-981b-4cdc-bd2d-9b789a638b42 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:46.893609 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c977e67a-981b-4cdc-bd2d-9b789a638b42 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:46.908147 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c977e67a-981b-4cdc-bd2d-9b789a638b42 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:46.908605 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c977e67a-981b-4cdc-bd2d-9b789a638b42 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:46.914973 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c977e67a-981b-4cdc-bd2d-9b789a638b42 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:46.917532 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c977e67a-981b-4cdc-bd2d-9b789a638b42 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:46.930815 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-79af58a7-7785-4d63-ba7b-853622bed1a8 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:46.939960 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-79af58a7-7785-4d63-ba7b-853622bed1a8 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320" status: 200 len: 1314 microversion: 2.1 time: 0.311537 Jan 11 15:13:46.951526 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 254/516] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:46 2022] GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:46.969061 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f2bf106c-833e-4780-a1df-c23bddc0b1e0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:46.969663 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f2bf106c-833e-4780-a1df-c23bddc0b1e0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:46.982064 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f2bf106c-833e-4780-a1df-c23bddc0b1e0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:46.983694 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f2bf106c-833e-4780-a1df-c23bddc0b1e0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:46.984680 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f2bf106c-833e-4780-a1df-c23bddc0b1e0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:46.985340 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f2bf106c-833e-4780-a1df-c23bddc0b1e0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:47.093192 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c977e67a-981b-4cdc-bd2d-9b789a638b42 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.205765 Jan 11 15:13:47.094582 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 263/517] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:46 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:13:47.200891 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f2bf106c-833e-4780-a1df-c23bddc0b1e0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:47.209029 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f2bf106c-833e-4780-a1df-c23bddc0b1e0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1516 microversion: 2.1 time: 0.243443 Jan 11 15:13:47.214531 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 255/518] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:46 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1516 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:47.250174 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-dfeb51f4-7842-4293-a36d-b779464e5647 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:47.251497 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-dfeb51f4-7842-4293-a36d-b779464e5647 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:47.269899 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-dfeb51f4-7842-4293-a36d-b779464e5647 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:47.277219 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-dfeb51f4-7842-4293-a36d-b779464e5647 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:47.278462 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-dfeb51f4-7842-4293-a36d-b779464e5647 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:47.281577 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-dfeb51f4-7842-4293-a36d-b779464e5647 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:47.359175 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0908a5de-a61b-4ab6-b0d6-c97df534013a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:47.361394 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0908a5de-a61b-4ab6-b0d6-c97df534013a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 1d506318-9988-434f-b8d6-bf11cbdef7b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:47.380704 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0908a5de-a61b-4ab6-b0d6-c97df534013a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:47.381313 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0908a5de-a61b-4ab6-b0d6-c97df534013a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:47.382195 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0908a5de-a61b-4ab6-b0d6-c97df534013a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:47.382800 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0908a5de-a61b-4ab6-b0d6-c97df534013a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:47.383127 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-dfeb51f4-7842-4293-a36d-b779464e5647 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.136794 Jan 11 15:13:47.385586 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 264/519] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:13:47 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:13:47.447908 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0908a5de-a61b-4ab6-b0d6-c97df534013a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:47.455653 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0908a5de-a61b-4ab6-b0d6-c97df534013a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4" status: 200 len: 1269 microversion: 2.1 time: 0.105931 Jan 11 15:13:47.456234 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 256/520] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:47 2022] GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4 => generated 1269 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:47.823257 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-110241e5-2ada-4953-b4f6-fdc7cc15b3e4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:47.824000 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-110241e5-2ada-4953-b4f6-fdc7cc15b3e4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:47.835452 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-110241e5-2ada-4953-b4f6-fdc7cc15b3e4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:47.837537 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-110241e5-2ada-4953-b4f6-fdc7cc15b3e4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:47.843676 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-110241e5-2ada-4953-b4f6-fdc7cc15b3e4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:47.844390 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-110241e5-2ada-4953-b4f6-fdc7cc15b3e4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:47.957987 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5b00a66e-f55b-458f-a595-cfef985dd60e tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:47.958603 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5b00a66e-f55b-458f-a595-cfef985dd60e tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: be52529f-eb7b-4aae-8286-bcbfba0a3320] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:47.971485 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5b00a66e-f55b-458f-a595-cfef985dd60e tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:47.972374 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5b00a66e-f55b-458f-a595-cfef985dd60e tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:47.973718 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5b00a66e-f55b-458f-a595-cfef985dd60e tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:47.975668 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5b00a66e-f55b-458f-a595-cfef985dd60e tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:48.318146 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-110241e5-2ada-4953-b4f6-fdc7cc15b3e4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:48.330192 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-110241e5-2ada-4953-b4f6-fdc7cc15b3e4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1319 microversion: 2.1 time: 0.510693 Jan 11 15:13:48.331689 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 265/521] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:47 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1319 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:48.339229 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-8d64a520-35bd-43e3-b481-19b8bbb3c5d4 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:48.340830 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-8d64a520-35bd-43e3-b481-19b8bbb3c5d4 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:48.348373 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8d64a520-35bd-43e3-b481-19b8bbb3c5d4 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:48.349012 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8d64a520-35bd-43e3-b481-19b8bbb3c5d4 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:48.350015 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8d64a520-35bd-43e3-b481-19b8bbb3c5d4 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:48.351586 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8d64a520-35bd-43e3-b481-19b8bbb3c5d4 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:48.353748 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-5b00a66e-f55b-458f-a595-cfef985dd60e tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:48.362883 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5b00a66e-f55b-458f-a595-cfef985dd60e tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320" status: 200 len: 1314 microversion: 2.1 time: 0.408540 Jan 11 15:13:48.363997 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 257/522] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:47 2022] GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320 => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:13:48.396489 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-06cf4570-b7f4-4d9c-a964-551694d3e84a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:48.397845 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-06cf4570-b7f4-4d9c-a964-551694d3e84a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:48.404871 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-06cf4570-b7f4-4d9c-a964-551694d3e84a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:48.405332 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-06cf4570-b7f4-4d9c-a964-551694d3e84a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:48.406308 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-06cf4570-b7f4-4d9c-a964-551694d3e84a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:48.406751 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-06cf4570-b7f4-4d9c-a964-551694d3e84a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:48.468856 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-8d64a520-35bd-43e3-b481-19b8bbb3c5d4 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.134944 Jan 11 15:13:48.470559 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 266/523] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:48 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:13:48.486415 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e5061273-30c9-4637-87e6-6f3fe40d5d02 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:48.486415 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e5061273-30c9-4637-87e6-6f3fe40d5d02 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 1d506318-9988-434f-b8d6-bf11cbdef7b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:48.491704 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e5061273-30c9-4637-87e6-6f3fe40d5d02 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:48.492367 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e5061273-30c9-4637-87e6-6f3fe40d5d02 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:48.493440 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e5061273-30c9-4637-87e6-6f3fe40d5d02 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:48.494044 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e5061273-30c9-4637-87e6-6f3fe40d5d02 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:48.523380 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-06cf4570-b7f4-4d9c-a964-551694d3e84a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.130397 Jan 11 15:13:48.525506 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 258/524] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:13:48 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:13:48.598444 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-e5061273-30c9-4637-87e6-6f3fe40d5d02 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:48.613549 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e5061273-30c9-4637-87e6-6f3fe40d5d02 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4" status: 200 len: 1275 microversion: 2.1 time: 0.137482 Jan 11 15:13:48.614140 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 267/525] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:48 2022] GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4 => generated 1275 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:13:49.350787 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d3c53c39-ea83-4850-ae8c-3db148922fb7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:49.352273 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d3c53c39-ea83-4850-ae8c-3db148922fb7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:49.369545 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d3c53c39-ea83-4850-ae8c-3db148922fb7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:49.370414 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d3c53c39-ea83-4850-ae8c-3db148922fb7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:49.371552 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d3c53c39-ea83-4850-ae8c-3db148922fb7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:49.372210 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d3c53c39-ea83-4850-ae8c-3db148922fb7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:49.382613 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4f50443d-e02a-4597-8a76-238465a332ca tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:49.383231 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4f50443d-e02a-4597-8a76-238465a332ca tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: be52529f-eb7b-4aae-8286-bcbfba0a3320] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:49.401624 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4f50443d-e02a-4597-8a76-238465a332ca tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:49.407311 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4f50443d-e02a-4597-8a76-238465a332ca tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:49.408370 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4f50443d-e02a-4597-8a76-238465a332ca tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:49.411935 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4f50443d-e02a-4597-8a76-238465a332ca tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:49.973041 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d3c53c39-ea83-4850-ae8c-3db148922fb7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:49.982556 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-4f50443d-e02a-4597-8a76-238465a332ca tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:49.984594 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d3c53c39-ea83-4850-ae8c-3db148922fb7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1508 microversion: 2.1 time: 0.638872 Jan 11 15:13:49.992531 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4f50443d-e02a-4597-8a76-238465a332ca tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320" status: 200 len: 1314 microversion: 2.1 time: 0.614168 Jan 11 15:13:49.995701 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 268/526] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:49 2022] GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320 => generated 1314 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:13:50.001327 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 259/527] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:49 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1508 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:50.007501 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e4ba3778-5d8c-46a9-90f4-5afa79d46de5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:50.008572 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-5e5bfe4e-024c-41cd-8037-dca38bcc37c4 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:50.009802 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e4ba3778-5d8c-46a9-90f4-5afa79d46de5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:50.012407 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-5e5bfe4e-024c-41cd-8037-dca38bcc37c4 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:50.023815 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e4ba3778-5d8c-46a9-90f4-5afa79d46de5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:50.025362 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5e5bfe4e-024c-41cd-8037-dca38bcc37c4 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:50.025627 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e4ba3778-5d8c-46a9-90f4-5afa79d46de5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:50.025868 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5e5bfe4e-024c-41cd-8037-dca38bcc37c4 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:50.026752 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5e5bfe4e-024c-41cd-8037-dca38bcc37c4 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:50.026933 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e4ba3778-5d8c-46a9-90f4-5afa79d46de5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:50.027192 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5e5bfe4e-024c-41cd-8037-dca38bcc37c4 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:50.028684 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e4ba3778-5d8c-46a9-90f4-5afa79d46de5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:50.159658 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e4ba3778-5d8c-46a9-90f4-5afa79d46de5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.157129 Jan 11 15:13:50.164570 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 260/528] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:13:50 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:13:50.171331 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-5e5bfe4e-024c-41cd-8037-dca38bcc37c4 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.173669 Jan 11 15:13:50.171986 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 269/529] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:49 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:13:50.175206 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ca9d88c4-61cf-4e9a-bfc5-1f0c5619e91c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:50.178169 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ca9d88c4-61cf-4e9a-bfc5-1f0c5619e91c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 1d506318-9988-434f-b8d6-bf11cbdef7b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:50.200171 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ca9d88c4-61cf-4e9a-bfc5-1f0c5619e91c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:50.200901 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ca9d88c4-61cf-4e9a-bfc5-1f0c5619e91c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:50.204707 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ca9d88c4-61cf-4e9a-bfc5-1f0c5619e91c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:50.206977 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ca9d88c4-61cf-4e9a-bfc5-1f0c5619e91c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:50.226726 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-952cdbd9-31a7-4aeb-bb0d-076858bb118f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:50.227811 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-952cdbd9-31a7-4aeb-bb0d-076858bb118f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:50.240793 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-952cdbd9-31a7-4aeb-bb0d-076858bb118f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:50.241317 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-952cdbd9-31a7-4aeb-bb0d-076858bb118f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:50.242113 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-952cdbd9-31a7-4aeb-bb0d-076858bb118f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:50.242554 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-952cdbd9-31a7-4aeb-bb0d-076858bb118f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:50.593987 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ca9d88c4-61cf-4e9a-bfc5-1f0c5619e91c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:50.605300 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ca9d88c4-61cf-4e9a-bfc5-1f0c5619e91c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4" status: 200 len: 1317 microversion: 2.1 time: 0.439289 Jan 11 15:13:50.606076 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 261/530] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:50 2022] GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4 => generated 1317 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:50.656574 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-952cdbd9-31a7-4aeb-bb0d-076858bb118f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:50.675857 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-952cdbd9-31a7-4aeb-bb0d-076858bb118f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1516 microversion: 2.1 time: 0.454509 Jan 11 15:13:50.676769 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 270/531] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:50 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1516 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:50.693062 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2b59461c-ef2e-48b6-8d30-607c49eab351 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "610c960d-8a64-4ee2-85d2-5ae3bb879fee"}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:50.695514 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2b59461c-ef2e-48b6-8d30-607c49eab351 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:50.709245 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2b59461c-ef2e-48b6-8d30-607c49eab351 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:50.709777 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2b59461c-ef2e-48b6-8d30-607c49eab351 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:50.714474 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2b59461c-ef2e-48b6-8d30-607c49eab351 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:50.715022 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2b59461c-ef2e-48b6-8d30-607c49eab351 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:51.010185 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-fd759784-ce4d-4a21-8b3f-fc971c5ec726 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:51.011148 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-fd759784-ce4d-4a21-8b3f-fc971c5ec726 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: be52529f-eb7b-4aae-8286-bcbfba0a3320] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:51.017717 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fd759784-ce4d-4a21-8b3f-fc971c5ec726 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:51.018871 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fd759784-ce4d-4a21-8b3f-fc971c5ec726 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:51.019867 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fd759784-ce4d-4a21-8b3f-fc971c5ec726 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:51.020319 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fd759784-ce4d-4a21-8b3f-fc971c5ec726 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:51.419638 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-fd759784-ce4d-4a21-8b3f-fc971c5ec726 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:51.439152 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-fd759784-ce4d-4a21-8b3f-fc971c5ec726 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320" status: 200 len: 1314 microversion: 2.1 time: 0.432871 Jan 11 15:13:51.440103 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 271/532] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:51 2022] GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320 => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:13:51.448533 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-0c217a18-db18-4e8b-bec8-90a3c1afd254 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:51.455230 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-0c217a18-db18-4e8b-bec8-90a3c1afd254 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:51.464200 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0c217a18-db18-4e8b-bec8-90a3c1afd254 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:51.465837 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0c217a18-db18-4e8b-bec8-90a3c1afd254 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:51.468800 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0c217a18-db18-4e8b-bec8-90a3c1afd254 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:51.470435 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0c217a18-db18-4e8b-bec8-90a3c1afd254 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:51.585540 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-0c217a18-db18-4e8b-bec8-90a3c1afd254 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.143943 Jan 11 15:13:51.586186 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 272/533] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:13:51 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:13:51.594108 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2b59461c-ef2e-48b6-8d30-607c49eab351 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "POST /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.904199 Jan 11 15:13:51.595363 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 262/534] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jan 11 15:13:50 2022] POST /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 194 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:13:51.609116 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [req-707d5588-a9d2-41da-949e-930b0e34fa10 req-02e463c7-ab6e-42ae-9d11-872a5d6ac050 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d506318-9988-434f-b8d6-bf11cbdef7b4", "tag": "981e1962-a1ba-49a2-9065-b74c48bb46ba"}]} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:51.617622 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:13:51.617622 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: warnings.warn(msg) Jan 11 15:13:51.618922 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3a97b804-296a-4ad5-bedc-ed085c887723 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:51.623156 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3a97b804-296a-4ad5-bedc-ed085c887723 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:51.645195 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-707d5588-a9d2-41da-949e-930b0e34fa10 req-02e463c7-ab6e-42ae-9d11-872a5d6ac050 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:51.645641 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-707d5588-a9d2-41da-949e-930b0e34fa10 req-02e463c7-ab6e-42ae-9d11-872a5d6ac050 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:51.653207 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3a97b804-296a-4ad5-bedc-ed085c887723 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:51.653671 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3a97b804-296a-4ad5-bedc-ed085c887723 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:51.655626 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3a97b804-296a-4ad5-bedc-ed085c887723 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:51.656092 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3a97b804-296a-4ad5-bedc-ed085c887723 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:51.714660 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.compute.server_external_events [req-707d5588-a9d2-41da-949e-930b0e34fa10 req-02e463c7-ab6e-42ae-9d11-872a5d6ac050 service nova] Creating event network-changed:981e1962-a1ba-49a2-9065-b74c48bb46ba for instance 1d506318-9988-434f-b8d6-bf11cbdef7b4 on hv-cinder-82418 Jan 11 15:13:51.720175 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [req-707d5588-a9d2-41da-949e-930b0e34fa10 req-02e463c7-ab6e-42ae-9d11-872a5d6ac050 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131542 Jan 11 15:13:51.722951 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 273/535] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:13:51.749293 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-24ed33cb-356f-4af8-8cd6-f1f0004ddeca tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:51.750855 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-24ed33cb-356f-4af8-8cd6-f1f0004ddeca tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 1d506318-9988-434f-b8d6-bf11cbdef7b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:51.758487 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-24ed33cb-356f-4af8-8cd6-f1f0004ddeca tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:51.762108 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-24ed33cb-356f-4af8-8cd6-f1f0004ddeca tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:51.762108 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-24ed33cb-356f-4af8-8cd6-f1f0004ddeca tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:51.762108 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-24ed33cb-356f-4af8-8cd6-f1f0004ddeca tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:51.829544 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3a97b804-296a-4ad5-bedc-ed085c887723 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.231822 Jan 11 15:13:51.830531 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 263/536] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:51 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:13:52.188320 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-24ed33cb-356f-4af8-8cd6-f1f0004ddeca tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:52.195683 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-24ed33cb-356f-4af8-8cd6-f1f0004ddeca tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4" status: 200 len: 1317 microversion: 2.1 time: 0.471254 Jan 11 15:13:52.196289 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 274/537] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:51 2022] GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4 => generated 1317 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:52.244993 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-418260eb-11ef-4626-a487-04d2b0847e8e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Action: 'create', calling method: .version_select at 0x7f16b9f554c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1509984335"}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:52.260941 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.quota [None req-418260eb-11ef-4626-a487-04d2b0847e8e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Getting quotas for project 650f188bc41c4e3287333c86a814f108. Resources: {'key_pairs'} {{(pid=116902) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 15:13:52.264995 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.quota [None req-418260eb-11ef-4626-a487-04d2b0847e8e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Getting quotas for user 7306e551d8234142977681a0d803a21a and project 650f188bc41c4e3287333c86a814f108. Resources: {'key_pairs'} {{(pid=116902) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 15:13:52.456883 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-cae610ef-e66b-46fa-8fdf-9dce744e4702 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:52.457489 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-cae610ef-e66b-46fa-8fdf-9dce744e4702 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: be52529f-eb7b-4aae-8286-bcbfba0a3320] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:52.467189 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cae610ef-e66b-46fa-8fdf-9dce744e4702 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:52.467681 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cae610ef-e66b-46fa-8fdf-9dce744e4702 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:52.468470 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cae610ef-e66b-46fa-8fdf-9dce744e4702 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:52.468929 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cae610ef-e66b-46fa-8fdf-9dce744e4702 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:52.475409 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.quota [None req-418260eb-11ef-4626-a487-04d2b0847e8e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Getting quotas for project 650f188bc41c4e3287333c86a814f108. Resources: {'key_pairs'} {{(pid=116902) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 15:13:52.481110 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.quota [None req-418260eb-11ef-4626-a487-04d2b0847e8e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Getting quotas for user 7306e551d8234142977681a0d803a21a and project 650f188bc41c4e3287333c86a814f108. Resources: {'key_pairs'} {{(pid=116902) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 15:13:52.499854 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-418260eb-11ef-4626-a487-04d2b0847e8e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.455079 Jan 11 15:13:52.499854 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 264/538] 10.222.0.52 () {60 vars in 1157 bytes} [Tue Jan 11 15:13:52 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:13:52.599406 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b988fe95-733a-40ac-8df4-e4605a1a8927 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:52.601582 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b988fe95-733a-40ac-8df4-e4605a1a8927 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:52.623198 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b988fe95-733a-40ac-8df4-e4605a1a8927 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:52.624781 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b988fe95-733a-40ac-8df4-e4605a1a8927 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:52.626922 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b988fe95-733a-40ac-8df4-e4605a1a8927 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:52.629126 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b988fe95-733a-40ac-8df4-e4605a1a8927 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:52.779913 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-cae610ef-e66b-46fa-8fdf-9dce744e4702 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:52.786489 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b988fe95-733a-40ac-8df4-e4605a1a8927 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.191506 Jan 11 15:13:52.787559 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 265/539] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:13:52 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:13:52.799518 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-cae610ef-e66b-46fa-8fdf-9dce744e4702 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320" status: 200 len: 1314 microversion: 2.1 time: 0.346341 Jan 11 15:13:52.800096 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 275/540] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:52 2022] GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:13:52.852091 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5ce2d6f8-12f4-4cc6-a4dd-89333d2f4953 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:52.854000 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5ce2d6f8-12f4-4cc6-a4dd-89333d2f4953 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:52.866814 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5ce2d6f8-12f4-4cc6-a4dd-89333d2f4953 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:52.867800 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5ce2d6f8-12f4-4cc6-a4dd-89333d2f4953 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:52.869987 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5ce2d6f8-12f4-4cc6-a4dd-89333d2f4953 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:52.876813 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5ce2d6f8-12f4-4cc6-a4dd-89333d2f4953 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:52.985246 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5ce2d6f8-12f4-4cc6-a4dd-89333d2f4953 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.138649 Jan 11 15:13:52.987373 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 266/541] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:52 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:13:53.213963 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7243357e-6eba-4eb7-97dc-c55e19ad63d2 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:53.214741 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7243357e-6eba-4eb7-97dc-c55e19ad63d2 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 1d506318-9988-434f-b8d6-bf11cbdef7b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:53.222057 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7243357e-6eba-4eb7-97dc-c55e19ad63d2 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:53.222532 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7243357e-6eba-4eb7-97dc-c55e19ad63d2 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:53.223585 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7243357e-6eba-4eb7-97dc-c55e19ad63d2 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:53.224027 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7243357e-6eba-4eb7-97dc-c55e19ad63d2 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:53.341082 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-fc01a871-e0ea-4b70-89e9-c93abaaf8a53 req-16f291a7-5eec-4091-ae14-5c19ce36bfbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be52529f-eb7b-4aae-8286-bcbfba0a3320", "name": "network-vif-plugged", "status": "completed", "tag": "dbdee383-d3de-45d6-92a7-b388ebbfb33d"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:53.342817 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:13:53.342817 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:13:53.352009 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-fc01a871-e0ea-4b70-89e9-c93abaaf8a53 req-16f291a7-5eec-4091-ae14-5c19ce36bfbc service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:53.353324 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-fc01a871-e0ea-4b70-89e9-c93abaaf8a53 req-16f291a7-5eec-4091-ae14-5c19ce36bfbc service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:53.371284 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-fc01a871-e0ea-4b70-89e9-c93abaaf8a53 req-16f291a7-5eec-4091-ae14-5c19ce36bfbc service nova] Creating event network-vif-plugged:dbdee383-d3de-45d6-92a7-b388ebbfb33d for instance be52529f-eb7b-4aae-8286-bcbfba0a3320 on hv-cinder-82418 Jan 11 15:13:53.376767 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [req-fc01a871-e0ea-4b70-89e9-c93abaaf8a53 req-16f291a7-5eec-4091-ae14-5c19ce36bfbc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040535 Jan 11 15:13:53.377653 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 267/542] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:13:53.412829 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-7243357e-6eba-4eb7-97dc-c55e19ad63d2 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:53.430640 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7243357e-6eba-4eb7-97dc-c55e19ad63d2 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4" status: 200 len: 1317 microversion: 2.1 time: 0.221531 Jan 11 15:13:53.443782 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 276/543] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:53 2022] GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:53.800035 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d6025799-b495-48b9-a98b-cb4d3729d03b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:53.801054 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d6025799-b495-48b9-a98b-cb4d3729d03b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:53.818030 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d6025799-b495-48b9-a98b-cb4d3729d03b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:53.818378 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-62fdf122-4b96-4552-94e7-038354f3c00c tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:53.818869 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d6025799-b495-48b9-a98b-cb4d3729d03b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:53.819052 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-62fdf122-4b96-4552-94e7-038354f3c00c tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: be52529f-eb7b-4aae-8286-bcbfba0a3320] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:53.822016 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d6025799-b495-48b9-a98b-cb4d3729d03b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:53.822485 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d6025799-b495-48b9-a98b-cb4d3729d03b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:53.825900 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-62fdf122-4b96-4552-94e7-038354f3c00c tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:53.826611 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-62fdf122-4b96-4552-94e7-038354f3c00c tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:53.827695 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-62fdf122-4b96-4552-94e7-038354f3c00c tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:53.828480 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-62fdf122-4b96-4552-94e7-038354f3c00c tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:54.022659 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-62fdf122-4b96-4552-94e7-038354f3c00c tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:54.031794 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-62fdf122-4b96-4552-94e7-038354f3c00c tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320" status: 200 len: 1314 microversion: 2.1 time: 0.217657 Jan 11 15:13:54.032891 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 277/544] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:53 2022] GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:13:54.037427 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4e196d06-9597-47c0-b6ce-f58c70c83dc4 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:54.038562 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4e196d06-9597-47c0-b6ce-f58c70c83dc4 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:54.047017 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4e196d06-9597-47c0-b6ce-f58c70c83dc4 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:54.047643 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4e196d06-9597-47c0-b6ce-f58c70c83dc4 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:54.048609 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4e196d06-9597-47c0-b6ce-f58c70c83dc4 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:54.049188 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4e196d06-9597-47c0-b6ce-f58c70c83dc4 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:54.317771 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4e196d06-9597-47c0-b6ce-f58c70c83dc4 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.283409 Jan 11 15:13:54.318311 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 278/545] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:54 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:13:54.334939 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d6025799-b495-48b9-a98b-cb4d3729d03b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.539268 Jan 11 15:13:54.341035 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 268/546] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:13:53 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:13:54.452703 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4408ba84-6109-42a9-b1e3-20b5f29a6708 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:54.453410 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4408ba84-6109-42a9-b1e3-20b5f29a6708 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 1d506318-9988-434f-b8d6-bf11cbdef7b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:54.464274 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4408ba84-6109-42a9-b1e3-20b5f29a6708 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:54.464735 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4408ba84-6109-42a9-b1e3-20b5f29a6708 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:54.465524 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4408ba84-6109-42a9-b1e3-20b5f29a6708 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:54.466052 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4408ba84-6109-42a9-b1e3-20b5f29a6708 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:54.641797 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-4408ba84-6109-42a9-b1e3-20b5f29a6708 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:54.651678 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4408ba84-6109-42a9-b1e3-20b5f29a6708 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4" status: 200 len: 1317 microversion: 2.1 time: 0.205265 Jan 11 15:13:54.658155 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 279/547] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:54 2022] GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4 => generated 1317 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:55.058373 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b6643ec8-1c13-4e0c-b245-3a6444b19db0 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:55.059609 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b6643ec8-1c13-4e0c-b245-3a6444b19db0 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: be52529f-eb7b-4aae-8286-bcbfba0a3320] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:55.070300 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b6643ec8-1c13-4e0c-b245-3a6444b19db0 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:55.070894 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b6643ec8-1c13-4e0c-b245-3a6444b19db0 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:55.072219 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b6643ec8-1c13-4e0c-b245-3a6444b19db0 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:55.072666 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b6643ec8-1c13-4e0c-b245-3a6444b19db0 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:55.307528 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b6643ec8-1c13-4e0c-b245-3a6444b19db0 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:55.329908 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-03936db8-177a-4d29-886b-ace76aad61bb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:55.331591 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-03936db8-177a-4d29-886b-ace76aad61bb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:55.347875 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-03936db8-177a-4d29-886b-ace76aad61bb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:55.348624 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-03936db8-177a-4d29-886b-ace76aad61bb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:55.348987 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b6643ec8-1c13-4e0c-b245-3a6444b19db0 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320" status: 200 len: 1314 microversion: 2.1 time: 0.301240 Jan 11 15:13:55.349852 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-03936db8-177a-4d29-886b-ace76aad61bb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:55.350498 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-03936db8-177a-4d29-886b-ace76aad61bb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:55.355785 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 269/548] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:55 2022] GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:13:55.374234 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d49da932-0a7c-4986-ab7f-7defddba7721 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:55.376010 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d49da932-0a7c-4986-ab7f-7defddba7721 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:55.384739 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d49da932-0a7c-4986-ab7f-7defddba7721 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:55.386664 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d49da932-0a7c-4986-ab7f-7defddba7721 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:55.387787 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d49da932-0a7c-4986-ab7f-7defddba7721 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:55.388816 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d49da932-0a7c-4986-ab7f-7defddba7721 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:55.464185 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-03936db8-177a-4d29-886b-ace76aad61bb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.137544 Jan 11 15:13:55.468736 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 280/549] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:55 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:13:55.490280 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d49da932-0a7c-4986-ab7f-7defddba7721 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.132882 Jan 11 15:13:55.491316 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 270/550] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:13:55 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:13:55.676040 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-334398a2-d92c-46a3-aaa2-00343f9ef897 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:55.676933 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-334398a2-d92c-46a3-aaa2-00343f9ef897 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 1d506318-9988-434f-b8d6-bf11cbdef7b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:55.684625 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-334398a2-d92c-46a3-aaa2-00343f9ef897 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:55.685142 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-334398a2-d92c-46a3-aaa2-00343f9ef897 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:55.691562 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-334398a2-d92c-46a3-aaa2-00343f9ef897 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:55.691562 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-334398a2-d92c-46a3-aaa2-00343f9ef897 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:55.837646 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-334398a2-d92c-46a3-aaa2-00343f9ef897 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:55.847258 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-334398a2-d92c-46a3-aaa2-00343f9ef897 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4" status: 200 len: 1317 microversion: 2.1 time: 0.174189 Jan 11 15:13:55.847258 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 281/551] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:55 2022] GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:56.370393 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-78d38fd2-f423-4275-bff7-6264e9cb5260 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:56.371239 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-78d38fd2-f423-4275-bff7-6264e9cb5260 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: be52529f-eb7b-4aae-8286-bcbfba0a3320] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:56.383032 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-78d38fd2-f423-4275-bff7-6264e9cb5260 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:56.383032 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-78d38fd2-f423-4275-bff7-6264e9cb5260 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:56.383032 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-78d38fd2-f423-4275-bff7-6264e9cb5260 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:56.383032 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-78d38fd2-f423-4275-bff7-6264e9cb5260 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:56.479053 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-70920d64-3eb4-42f5-91e5-f692db5df968 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:56.480009 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-70920d64-3eb4-42f5-91e5-f692db5df968 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:56.486584 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-70920d64-3eb4-42f5-91e5-f692db5df968 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:56.487032 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-70920d64-3eb4-42f5-91e5-f692db5df968 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:56.487854 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-70920d64-3eb4-42f5-91e5-f692db5df968 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:56.488288 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-70920d64-3eb4-42f5-91e5-f692db5df968 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:56.521313 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-78d38fd2-f423-4275-bff7-6264e9cb5260 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:56.529922 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-78d38fd2-f423-4275-bff7-6264e9cb5260 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320" status: 200 len: 1314 microversion: 2.1 time: 0.163583 Jan 11 15:13:56.530571 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 271/552] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:56 2022] GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:56.536612 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-19882576-b4c2-4ee5-8944-52d7b7ef9c29 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:56.537787 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-19882576-b4c2-4ee5-8944-52d7b7ef9c29 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:56.544329 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-19882576-b4c2-4ee5-8944-52d7b7ef9c29 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:56.544785 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-19882576-b4c2-4ee5-8944-52d7b7ef9c29 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:56.545713 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-19882576-b4c2-4ee5-8944-52d7b7ef9c29 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:56.546032 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-19882576-b4c2-4ee5-8944-52d7b7ef9c29 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:56.590953 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-70920d64-3eb4-42f5-91e5-f692db5df968 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.115443 Jan 11 15:13:56.591723 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 282/553] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:56 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:13:56.610592 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-19882576-b4c2-4ee5-8944-52d7b7ef9c29 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.078315 Jan 11 15:13:56.611233 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 272/554] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:13:56 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:13:56.864652 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-5e775df7-2ccd-4bfa-a4e0-503a52109b7d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:56.865417 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-5e775df7-2ccd-4bfa-a4e0-503a52109b7d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 1d506318-9988-434f-b8d6-bf11cbdef7b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:56.873408 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5e775df7-2ccd-4bfa-a4e0-503a52109b7d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:56.873865 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5e775df7-2ccd-4bfa-a4e0-503a52109b7d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:56.874688 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5e775df7-2ccd-4bfa-a4e0-503a52109b7d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:56.875121 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5e775df7-2ccd-4bfa-a4e0-503a52109b7d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:57.027953 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-5e775df7-2ccd-4bfa-a4e0-503a52109b7d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:57.036327 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-5e775df7-2ccd-4bfa-a4e0-503a52109b7d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4" status: 200 len: 1317 microversion: 2.1 time: 0.176186 Jan 11 15:13:57.037245 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 283/555] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:56 2022] GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:57.546693 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-fe5bdbd7-4d49-4841-93f3-13db5386d367 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:57.548260 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-fe5bdbd7-4d49-4841-93f3-13db5386d367 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: be52529f-eb7b-4aae-8286-bcbfba0a3320] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:57.556350 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fe5bdbd7-4d49-4841-93f3-13db5386d367 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:57.556810 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fe5bdbd7-4d49-4841-93f3-13db5386d367 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:57.557634 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fe5bdbd7-4d49-4841-93f3-13db5386d367 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:57.558077 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fe5bdbd7-4d49-4841-93f3-13db5386d367 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:57.602032 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d4903216-a9b3-4255-a599-7baabdf39719 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:57.603024 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d4903216-a9b3-4255-a599-7baabdf39719 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:57.611470 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d4903216-a9b3-4255-a599-7baabdf39719 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:57.612190 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d4903216-a9b3-4255-a599-7baabdf39719 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:57.613495 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d4903216-a9b3-4255-a599-7baabdf39719 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:57.613936 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d4903216-a9b3-4255-a599-7baabdf39719 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:57.743663 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-fe5bdbd7-4d49-4841-93f3-13db5386d367 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:57.751033 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-fe5bdbd7-4d49-4841-93f3-13db5386d367 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320" status: 200 len: 1497 microversion: 2.1 time: 0.208361 Jan 11 15:13:57.751778 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 273/556] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:57 2022] GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320 => generated 1497 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:57.756174 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-300681a8-7cc7-48dc-9163-4e6e6d8ffec9 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:57.757068 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-300681a8-7cc7-48dc-9163-4e6e6d8ffec9 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:57.764624 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-300681a8-7cc7-48dc-9163-4e6e6d8ffec9 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:57.764624 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-300681a8-7cc7-48dc-9163-4e6e6d8ffec9 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:57.765594 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-300681a8-7cc7-48dc-9163-4e6e6d8ffec9 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:57.766136 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-300681a8-7cc7-48dc-9163-4e6e6d8ffec9 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:57.768929 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d4903216-a9b3-4255-a599-7baabdf39719 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.170470 Jan 11 15:13:57.769650 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 284/557] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:57 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:13:57.847211 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-300681a8-7cc7-48dc-9163-4e6e6d8ffec9 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.094033 Jan 11 15:13:57.847895 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 274/558] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:13:57 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:13:58.054277 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-40e5b937-ff9c-409f-a8cc-ee4fd203f63d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:58.055055 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-40e5b937-ff9c-409f-a8cc-ee4fd203f63d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 1d506318-9988-434f-b8d6-bf11cbdef7b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:58.062749 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-40e5b937-ff9c-409f-a8cc-ee4fd203f63d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:58.063051 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-40e5b937-ff9c-409f-a8cc-ee4fd203f63d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:58.063872 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-40e5b937-ff9c-409f-a8cc-ee4fd203f63d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:58.064322 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-40e5b937-ff9c-409f-a8cc-ee4fd203f63d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:58.271462 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-40e5b937-ff9c-409f-a8cc-ee4fd203f63d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:58.279222 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-40e5b937-ff9c-409f-a8cc-ee4fd203f63d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4" status: 200 len: 1317 microversion: 2.1 time: 0.229068 Jan 11 15:13:58.279848 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 285/559] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:58 2022] GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4 => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:58.655409 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b1dd90b8-6a19-46dd-b4eb-961199b08d0d tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:58.656021 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b1dd90b8-6a19-46dd-b4eb-961199b08d0d tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: be52529f-eb7b-4aae-8286-bcbfba0a3320] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:58.663041 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b1dd90b8-6a19-46dd-b4eb-961199b08d0d tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:58.663525 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b1dd90b8-6a19-46dd-b4eb-961199b08d0d tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:58.664333 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b1dd90b8-6a19-46dd-b4eb-961199b08d0d tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:58.665395 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b1dd90b8-6a19-46dd-b4eb-961199b08d0d tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:58.690580 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b1dd90b8-6a19-46dd-b4eb-961199b08d0d tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: be52529f-eb7b-4aae-8286-bcbfba0a3320] Going to try to terminate instance {{(pid=116902) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 15:13:58.781225 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4046302d-816a-41b8-9d52-a6c8e4000926 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:58.782147 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4046302d-816a-41b8-9d52-a6c8e4000926 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:58.788453 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4046302d-816a-41b8-9d52-a6c8e4000926 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:58.788906 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4046302d-816a-41b8-9d52-a6c8e4000926 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:58.789701 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4046302d-816a-41b8-9d52-a6c8e4000926 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:58.790127 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4046302d-816a-41b8-9d52-a6c8e4000926 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:58.890662 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4046302d-816a-41b8-9d52-a6c8e4000926 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.112794 Jan 11 15:13:58.891322 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 286/560] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:58 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:13:58.898163 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-30437912-758f-4c9c-8cd8-5b9e2a31d2cd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:58.899974 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-30437912-758f-4c9c-8cd8-5b9e2a31d2cd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:58.907827 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-30437912-758f-4c9c-8cd8-5b9e2a31d2cd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:58.908282 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-30437912-758f-4c9c-8cd8-5b9e2a31d2cd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:58.909080 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-30437912-758f-4c9c-8cd8-5b9e2a31d2cd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:58.909519 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-30437912-758f-4c9c-8cd8-5b9e2a31d2cd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:58.941123 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b1dd90b8-6a19-46dd-b4eb-961199b08d0d tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "DELETE /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320" status: 204 len: 0 microversion: 2.1 time: 0.289855 Jan 11 15:13:58.941826 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 275/561] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jan 11 15:13:58 2022] DELETE /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 15:13:58.953299 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2c200b3a-2a2a-4309-9072-f31ca2d1953f tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:58.953986 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2c200b3a-2a2a-4309-9072-f31ca2d1953f tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: be52529f-eb7b-4aae-8286-bcbfba0a3320] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:58.959859 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2c200b3a-2a2a-4309-9072-f31ca2d1953f tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:58.960309 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2c200b3a-2a2a-4309-9072-f31ca2d1953f tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:58.961089 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2c200b3a-2a2a-4309-9072-f31ca2d1953f tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:58.962562 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2c200b3a-2a2a-4309-9072-f31ca2d1953f tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:59.031161 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-30437912-758f-4c9c-8cd8-5b9e2a31d2cd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.138250 Jan 11 15:13:59.035214 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 287/562] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:13:58 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:13:59.105978 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-2c200b3a-2a2a-4309-9072-f31ca2d1953f tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:59.114193 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2c200b3a-2a2a-4309-9072-f31ca2d1953f tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320" status: 200 len: 1503 microversion: 2.1 time: 0.164808 Jan 11 15:13:59.114755 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 276/563] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:58 2022] GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:13:59.296760 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7b0963d5-6a92-40ba-ab5b-cdb4b1ae818b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:13:59.297466 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7b0963d5-6a92-40ba-ab5b-cdb4b1ae818b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 1d506318-9988-434f-b8d6-bf11cbdef7b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:59.304291 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7b0963d5-6a92-40ba-ab5b-cdb4b1ae818b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:59.304743 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7b0963d5-6a92-40ba-ab5b-cdb4b1ae818b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:59.305530 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7b0963d5-6a92-40ba-ab5b-cdb4b1ae818b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:59.305974 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7b0963d5-6a92-40ba-ab5b-cdb4b1ae818b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:59.440228 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-7b0963d5-6a92-40ba-ab5b-cdb4b1ae818b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:13:59.447721 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7b0963d5-6a92-40ba-ab5b-cdb4b1ae818b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4" status: 200 len: 1317 microversion: 2.1 time: 0.154941 Jan 11 15:13:59.448405 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 288/564] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:13:59 2022] GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:13:59.904077 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1584598d-8435-437c-a7f3-2f6cb6a1f889 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:13:59.905095 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1584598d-8435-437c-a7f3-2f6cb6a1f889 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:13:59.911369 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1584598d-8435-437c-a7f3-2f6cb6a1f889 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:59.911826 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1584598d-8435-437c-a7f3-2f6cb6a1f889 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:59.912601 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1584598d-8435-437c-a7f3-2f6cb6a1f889 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:13:59.913042 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1584598d-8435-437c-a7f3-2f6cb6a1f889 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:13:59.983177 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1584598d-8435-437c-a7f3-2f6cb6a1f889 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.082453 Jan 11 15:13:59.983775 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 277/565] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:13:59 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:14:00.042204 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b88a7b4a-f43a-4ba0-8081-fb99a4320865 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:00.043121 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b88a7b4a-f43a-4ba0-8081-fb99a4320865 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:00.050979 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b88a7b4a-f43a-4ba0-8081-fb99a4320865 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:00.051462 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b88a7b4a-f43a-4ba0-8081-fb99a4320865 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:00.053017 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b88a7b4a-f43a-4ba0-8081-fb99a4320865 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:00.053455 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b88a7b4a-f43a-4ba0-8081-fb99a4320865 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:00.137797 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2098ce58-48e4-4b5c-96ff-25d8e77530ae tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:00.137797 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2098ce58-48e4-4b5c-96ff-25d8e77530ae tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: be52529f-eb7b-4aae-8286-bcbfba0a3320] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:00.143564 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2098ce58-48e4-4b5c-96ff-25d8e77530ae tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:00.144137 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2098ce58-48e4-4b5c-96ff-25d8e77530ae tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:00.144896 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2098ce58-48e4-4b5c-96ff-25d8e77530ae tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:00.145375 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2098ce58-48e4-4b5c-96ff-25d8e77530ae tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:00.148348 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b88a7b4a-f43a-4ba0-8081-fb99a4320865 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.110013 Jan 11 15:14:00.149707 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 289/566] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:00 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:14:00.243254 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3b5c2dc7-53a2-474a-b110-4cfa3ecd4cc0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:00.244315 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3b5c2dc7-53a2-474a-b110-4cfa3ecd4cc0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:00.251570 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3b5c2dc7-53a2-474a-b110-4cfa3ecd4cc0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:00.252259 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3b5c2dc7-53a2-474a-b110-4cfa3ecd4cc0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:00.253136 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3b5c2dc7-53a2-474a-b110-4cfa3ecd4cc0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:00.253643 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3b5c2dc7-53a2-474a-b110-4cfa3ecd4cc0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:00.278358 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.objects.instance [None req-3b5c2dc7-53a2-474a-b110-4cfa3ecd4cc0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lazy-loading 'flavor' on Instance uuid 3b978091-0bf4-4e69-8053-76e49154df4c {{(pid=116903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 15:14:00.292905 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-2098ce58-48e4-4b5c-96ff-25d8e77530ae tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:00.300504 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2098ce58-48e4-4b5c-96ff-25d8e77530ae tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320" status: 200 len: 1503 microversion: 2.1 time: 0.170355 Jan 11 15:14:00.301092 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 278/567] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:00 2022] GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320 => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:00.469891 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7407f4c3-e0bb-484b-b2fe-3ecb039fd435 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:00.470632 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-7407f4c3-e0bb-484b-b2fe-3ecb039fd435 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 1d506318-9988-434f-b8d6-bf11cbdef7b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:00.478575 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7407f4c3-e0bb-484b-b2fe-3ecb039fd435 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:00.479030 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7407f4c3-e0bb-484b-b2fe-3ecb039fd435 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:00.479870 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7407f4c3-e0bb-484b-b2fe-3ecb039fd435 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:00.480314 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7407f4c3-e0bb-484b-b2fe-3ecb039fd435 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:00.596490 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3b5c2dc7-53a2-474a-b110-4cfa3ecd4cc0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "POST /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/action" status: 200 len: 32 microversion: 2.1 time: 0.357743 Jan 11 15:14:00.597089 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 290/568] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:00 2022] POST /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/action => generated 32 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 11 15:14:00.609548 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f7c0c382-f8e3-45af-982f-1a3fdf95a841 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:00.610623 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f7c0c382-f8e3-45af-982f-1a3fdf95a841 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:00.618783 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-7407f4c3-e0bb-484b-b2fe-3ecb039fd435 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:00.623396 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f7c0c382-f8e3-45af-982f-1a3fdf95a841 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:00.623857 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f7c0c382-f8e3-45af-982f-1a3fdf95a841 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:00.626740 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f7c0c382-f8e3-45af-982f-1a3fdf95a841 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:00.626740 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f7c0c382-f8e3-45af-982f-1a3fdf95a841 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:00.627764 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7407f4c3-e0bb-484b-b2fe-3ecb039fd435 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4" status: 200 len: 1317 microversion: 2.1 time: 0.161533 Jan 11 15:14:00.628363 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 279/569] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:00 2022] GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:00.845808 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-f7c0c382-f8e3-45af-982f-1a3fdf95a841 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:00.854212 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f7c0c382-f8e3-45af-982f-1a3fdf95a841 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1568 microversion: 2.1 time: 0.251882 Jan 11 15:14:00.855400 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 291/570] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:00 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1568 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:14:00.994486 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1519be3e-39ab-4451-8730-3e735d22ba02 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:00.995366 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1519be3e-39ab-4451-8730-3e735d22ba02 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:01.002101 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1519be3e-39ab-4451-8730-3e735d22ba02 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:01.002564 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1519be3e-39ab-4451-8730-3e735d22ba02 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:01.003416 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1519be3e-39ab-4451-8730-3e735d22ba02 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:01.003886 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1519be3e-39ab-4451-8730-3e735d22ba02 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:01.160779 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-077650d7-fc3b-4edb-acd1-398805f68a53 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:01.162459 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-077650d7-fc3b-4edb-acd1-398805f68a53 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:01.173414 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-077650d7-fc3b-4edb-acd1-398805f68a53 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:01.173858 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-077650d7-fc3b-4edb-acd1-398805f68a53 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:01.174658 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-077650d7-fc3b-4edb-acd1-398805f68a53 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:01.175095 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-077650d7-fc3b-4edb-acd1-398805f68a53 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:01.185866 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1519be3e-39ab-4451-8730-3e735d22ba02 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.195011 Jan 11 15:14:01.190654 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 280/571] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:00 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:14:01.255380 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-077650d7-fc3b-4edb-acd1-398805f68a53 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.098082 Jan 11 15:14:01.255912 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 292/572] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:01 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:14:01.256836 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-5f5c6631-3258-4a65-8ece-eada47cd9e6c req-0b0f508c-b7ca-46ba-9830-a27047d2edd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d506318-9988-434f-b8d6-bf11cbdef7b4", "name": "network-vif-plugged", "status": "completed", "tag": "981e1962-a1ba-49a2-9065-b74c48bb46ba"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:01.259810 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:14:01.259810 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:14:01.267899 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-5f5c6631-3258-4a65-8ece-eada47cd9e6c req-0b0f508c-b7ca-46ba-9830-a27047d2edd1 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:01.268571 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-5f5c6631-3258-4a65-8ece-eada47cd9e6c req-0b0f508c-b7ca-46ba-9830-a27047d2edd1 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:01.284192 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-5f5c6631-3258-4a65-8ece-eada47cd9e6c req-0b0f508c-b7ca-46ba-9830-a27047d2edd1 service nova] Creating event network-vif-plugged:981e1962-a1ba-49a2-9065-b74c48bb46ba for instance 1d506318-9988-434f-b8d6-bf11cbdef7b4 on hv-cinder-82418 Jan 11 15:14:01.289476 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [req-5f5c6631-3258-4a65-8ece-eada47cd9e6c req-0b0f508c-b7ca-46ba-9830-a27047d2edd1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042121 Jan 11 15:14:01.290173 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 281/573] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:14:01.325399 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-6164dcb6-61ea-42a5-9628-faaec744cf51 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:01.326671 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-6164dcb6-61ea-42a5-9628-faaec744cf51 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: be52529f-eb7b-4aae-8286-bcbfba0a3320] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:01.335327 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6164dcb6-61ea-42a5-9628-faaec744cf51 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:01.336557 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6164dcb6-61ea-42a5-9628-faaec744cf51 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:01.337664 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6164dcb6-61ea-42a5-9628-faaec744cf51 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:01.338324 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6164dcb6-61ea-42a5-9628-faaec744cf51 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:01.518307 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-6164dcb6-61ea-42a5-9628-faaec744cf51 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:01.526398 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-6164dcb6-61ea-42a5-9628-faaec744cf51 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320" status: 200 len: 1503 microversion: 2.1 time: 0.209003 Jan 11 15:14:01.536149 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 293/574] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:01 2022] GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320 => generated 1503 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:01.645416 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e5bf72ea-f963-4ca5-868b-204503b4ed6c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:01.646411 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e5bf72ea-f963-4ca5-868b-204503b4ed6c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 1d506318-9988-434f-b8d6-bf11cbdef7b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:01.656203 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e5bf72ea-f963-4ca5-868b-204503b4ed6c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:01.656669 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e5bf72ea-f963-4ca5-868b-204503b4ed6c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:01.657482 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e5bf72ea-f963-4ca5-868b-204503b4ed6c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:01.657925 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e5bf72ea-f963-4ca5-868b-204503b4ed6c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:01.804467 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e5bf72ea-f963-4ca5-868b-204503b4ed6c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:01.807511 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [req-e8afb6e9-34ab-4e7a-b69c-f0ce9c8d8d67 req-b6c70ff9-0e8c-4f89-a96d-18aa32663981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be52529f-eb7b-4aae-8286-bcbfba0a3320", "name": "network-vif-deleted", "tag": "dbdee383-d3de-45d6-92a7-b388ebbfb33d"}]} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:01.809064 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:14:01.809064 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: warnings.warn(msg) Jan 11 15:14:01.813937 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e5bf72ea-f963-4ca5-868b-204503b4ed6c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4" status: 200 len: 1317 microversion: 2.1 time: 0.172298 Jan 11 15:14:01.813937 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 282/575] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:01 2022] GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:01.818536 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-e8afb6e9-34ab-4e7a-b69c-f0ce9c8d8d67 req-b6c70ff9-0e8c-4f89-a96d-18aa32663981 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:01.819197 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-e8afb6e9-34ab-4e7a-b69c-f0ce9c8d8d67 req-b6c70ff9-0e8c-4f89-a96d-18aa32663981 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:01.830612 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.compute.server_external_events [req-e8afb6e9-34ab-4e7a-b69c-f0ce9c8d8d67 req-b6c70ff9-0e8c-4f89-a96d-18aa32663981 service nova] Creating event network-vif-deleted:dbdee383-d3de-45d6-92a7-b388ebbfb33d for instance be52529f-eb7b-4aae-8286-bcbfba0a3320 on hv-cinder-82418 Jan 11 15:14:01.835382 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [req-e8afb6e9-34ab-4e7a-b69c-f0ce9c8d8d67 req-b6c70ff9-0e8c-4f89-a96d-18aa32663981 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032053 Jan 11 15:14:01.835972 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 294/576] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:14:01.871712 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-229d51af-acdb-4a5c-a2c0-84d362aaef10 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:01.872322 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-229d51af-acdb-4a5c-a2c0-84d362aaef10 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:01.879218 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-229d51af-acdb-4a5c-a2c0-84d362aaef10 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:01.879705 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-229d51af-acdb-4a5c-a2c0-84d362aaef10 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:01.880498 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-229d51af-acdb-4a5c-a2c0-84d362aaef10 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:01.880932 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-229d51af-acdb-4a5c-a2c0-84d362aaef10 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:02.013196 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-229d51af-acdb-4a5c-a2c0-84d362aaef10 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:02.021199 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-229d51af-acdb-4a5c-a2c0-84d362aaef10 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1568 microversion: 2.1 time: 0.153655 Jan 11 15:14:02.021770 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 283/577] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:01 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:02.198368 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3e1b27df-abdb-4419-b762-baad7bf6d82a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:02.199415 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3e1b27df-abdb-4419-b762-baad7bf6d82a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:02.205784 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3e1b27df-abdb-4419-b762-baad7bf6d82a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:02.206481 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3e1b27df-abdb-4419-b762-baad7bf6d82a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:02.207494 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3e1b27df-abdb-4419-b762-baad7bf6d82a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:02.208858 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3e1b27df-abdb-4419-b762-baad7bf6d82a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:02.267561 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-41ffcb58-468b-4f6f-8e12-8916bc3176be tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:02.268524 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-41ffcb58-468b-4f6f-8e12-8916bc3176be tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:02.275388 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-41ffcb58-468b-4f6f-8e12-8916bc3176be tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:02.275841 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-41ffcb58-468b-4f6f-8e12-8916bc3176be tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:02.276665 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-41ffcb58-468b-4f6f-8e12-8916bc3176be tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:02.277102 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-41ffcb58-468b-4f6f-8e12-8916bc3176be tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:02.309017 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3e1b27df-abdb-4419-b762-baad7bf6d82a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.115084 Jan 11 15:14:02.310639 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 295/578] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:02 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:14:02.354745 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-41ffcb58-468b-4f6f-8e12-8916bc3176be tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.090836 Jan 11 15:14:02.355870 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 284/579] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:02 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:14:02.543869 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d3ba532e-cc43-4a72-a949-fc699f0c8260 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:02.544629 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d3ba532e-cc43-4a72-a949-fc699f0c8260 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: be52529f-eb7b-4aae-8286-bcbfba0a3320] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:02.553133 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d3ba532e-cc43-4a72-a949-fc699f0c8260 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:02.553133 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d3ba532e-cc43-4a72-a949-fc699f0c8260 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:02.558085 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d3ba532e-cc43-4a72-a949-fc699f0c8260 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:02.558583 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d3ba532e-cc43-4a72-a949-fc699f0c8260 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:02.605590 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d3ba532e-cc43-4a72-a949-fc699f0c8260 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:02.606022 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d3ba532e-cc43-4a72-a949-fc699f0c8260 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:02.606506 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.objects.instance [None req-d3ba532e-cc43-4a72-a949-fc699f0c8260 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lazy-loading 'fault' on Instance uuid be52529f-eb7b-4aae-8286-bcbfba0a3320 {{(pid=116903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 15:14:02.653192 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-d3ba532e-cc43-4a72-a949-fc699f0c8260 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44478a3f9c404ce1bbc35c1f904b87be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c371bd15cae4827a44612b4cd273a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:02.660798 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d3ba532e-cc43-4a72-a949-fc699f0c8260 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320" status: 200 len: 1304 microversion: 2.1 time: 0.120930 Jan 11 15:14:02.661429 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 296/580] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:02 2022] GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320 => generated 1304 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:02.831983 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c59e5147-82a9-4e08-ad4c-65d43d22f297 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:02.832592 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c59e5147-82a9-4e08-ad4c-65d43d22f297 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 1d506318-9988-434f-b8d6-bf11cbdef7b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:02.840491 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c59e5147-82a9-4e08-ad4c-65d43d22f297 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:02.840945 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c59e5147-82a9-4e08-ad4c-65d43d22f297 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:02.841738 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c59e5147-82a9-4e08-ad4c-65d43d22f297 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:02.842184 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c59e5147-82a9-4e08-ad4c-65d43d22f297 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:02.981680 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c59e5147-82a9-4e08-ad4c-65d43d22f297 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:02.990347 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c59e5147-82a9-4e08-ad4c-65d43d22f297 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4" status: 200 len: 1317 microversion: 2.1 time: 0.162437 Jan 11 15:14:02.990913 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 285/581] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:02 2022] GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:03.037980 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3dedb2f3-ae54-40a1-ad0d-4224883f20a2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:03.038580 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3dedb2f3-ae54-40a1-ad0d-4224883f20a2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:03.045263 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3dedb2f3-ae54-40a1-ad0d-4224883f20a2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:03.045730 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3dedb2f3-ae54-40a1-ad0d-4224883f20a2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:03.047045 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3dedb2f3-ae54-40a1-ad0d-4224883f20a2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:03.047524 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3dedb2f3-ae54-40a1-ad0d-4224883f20a2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:03.180958 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-3dedb2f3-ae54-40a1-ad0d-4224883f20a2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:03.188793 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3dedb2f3-ae54-40a1-ad0d-4224883f20a2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1568 microversion: 2.1 time: 0.154643 Jan 11 15:14:03.189352 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 297/582] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:03 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:14:03.320618 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0c98042c-ee54-448b-811c-4dff5d0450db tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:03.321762 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0c98042c-ee54-448b-811c-4dff5d0450db tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:03.328902 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0c98042c-ee54-448b-811c-4dff5d0450db tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:03.330203 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0c98042c-ee54-448b-811c-4dff5d0450db tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:03.330203 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0c98042c-ee54-448b-811c-4dff5d0450db tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:03.330664 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0c98042c-ee54-448b-811c-4dff5d0450db tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:03.368602 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-51650740-4359-4292-a54d-6c719e776334 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:03.369521 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-51650740-4359-4292-a54d-6c719e776334 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:03.375480 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-51650740-4359-4292-a54d-6c719e776334 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:03.375991 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-51650740-4359-4292-a54d-6c719e776334 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:03.376746 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-51650740-4359-4292-a54d-6c719e776334 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:03.377183 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-51650740-4359-4292-a54d-6c719e776334 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:03.426840 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0c98042c-ee54-448b-811c-4dff5d0450db tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.109709 Jan 11 15:14:03.427454 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 286/583] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:03 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:14:03.681951 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e75180c3-d73e-4025-b0e5-c126b1c01120 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:03.682595 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e75180c3-d73e-4025-b0e5-c126b1c01120 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] [instance: be52529f-eb7b-4aae-8286-bcbfba0a3320] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:03.689855 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e75180c3-d73e-4025-b0e5-c126b1c01120 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:03.690311 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e75180c3-d73e-4025-b0e5-c126b1c01120 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:03.691101 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e75180c3-d73e-4025-b0e5-c126b1c01120 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:03.691568 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e75180c3-d73e-4025-b0e5-c126b1c01120 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:03.706586 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.wsgi [None req-e75180c3-d73e-4025-b0e5-c126b1c01120 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] HTTP exception thrown: Instance be52529f-eb7b-4aae-8286-bcbfba0a3320 could not be found. Jan 11 15:14:03.707218 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e75180c3-d73e-4025-b0e5-c126b1c01120 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] Returning 404 to user: Instance be52529f-eb7b-4aae-8286-bcbfba0a3320 could not be found. {{(pid=116902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:14:03.708098 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e75180c3-d73e-4025-b0e5-c126b1c01120 tempest-VolumesActionsTest-2134374452 tempest-VolumesActionsTest-2134374452-project] 10.222.0.52 "GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320" status: 404 len: 111 microversion: 2.1 time: 0.030793 Jan 11 15:14:03.708676 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 287/584] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:03 2022] GET /compute/v2.1/servers/be52529f-eb7b-4aae-8286-bcbfba0a3320 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 11 15:14:04.007573 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b74d5d38-7c85-4b5a-ac49-07e29c8762a7 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:04.008177 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b74d5d38-7c85-4b5a-ac49-07e29c8762a7 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 1d506318-9988-434f-b8d6-bf11cbdef7b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:04.016022 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b74d5d38-7c85-4b5a-ac49-07e29c8762a7 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:04.016592 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b74d5d38-7c85-4b5a-ac49-07e29c8762a7 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:04.017381 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b74d5d38-7c85-4b5a-ac49-07e29c8762a7 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:04.017817 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b74d5d38-7c85-4b5a-ac49-07e29c8762a7 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:04.164885 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b74d5d38-7c85-4b5a-ac49-07e29c8762a7 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:04.174907 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b74d5d38-7c85-4b5a-ac49-07e29c8762a7 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4" status: 200 len: 1317 microversion: 2.1 time: 0.170903 Jan 11 15:14:04.175644 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 288/585] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:04 2022] GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:14:04.205630 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-99335173-ae1b-4232-a838-d10469c13326 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:04.206317 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-99335173-ae1b-4232-a838-d10469c13326 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:04.213098 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-99335173-ae1b-4232-a838-d10469c13326 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:04.213551 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-99335173-ae1b-4232-a838-d10469c13326 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:04.214333 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-99335173-ae1b-4232-a838-d10469c13326 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:04.214781 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-99335173-ae1b-4232-a838-d10469c13326 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:04.354555 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-99335173-ae1b-4232-a838-d10469c13326 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:04.362859 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-99335173-ae1b-4232-a838-d10469c13326 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1568 microversion: 2.1 time: 0.160804 Jan 11 15:14:04.363548 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 289/586] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:04 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:14:04.439671 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a787e82e-36ab-46b3-84e1-6af1b992e021 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:04.440581 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a787e82e-36ab-46b3-84e1-6af1b992e021 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:04.450607 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a787e82e-36ab-46b3-84e1-6af1b992e021 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:04.450607 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a787e82e-36ab-46b3-84e1-6af1b992e021 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:04.451762 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a787e82e-36ab-46b3-84e1-6af1b992e021 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:04.451762 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a787e82e-36ab-46b3-84e1-6af1b992e021 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:11.959330 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-51650740-4359-4292-a54d-6c719e776334 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 8.596519 Jan 11 15:14:11.959986 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 298/587] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:03 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 8598 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:14:11.965115 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-8d540135-5df2-4bb5-8592-e3f92e995130 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:11.965815 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-8d540135-5df2-4bb5-8592-e3f92e995130 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 1d506318-9988-434f-b8d6-bf11cbdef7b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:11.974513 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8d540135-5df2-4bb5-8592-e3f92e995130 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:11.974871 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8d540135-5df2-4bb5-8592-e3f92e995130 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:11.975700 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8d540135-5df2-4bb5-8592-e3f92e995130 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:11.976212 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8d540135-5df2-4bb5-8592-e3f92e995130 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:12.097213 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a787e82e-36ab-46b3-84e1-6af1b992e021 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 7.661394 Jan 11 15:14:12.101591 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 290/588] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:04 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 7664 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:14:12.105509 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0d70b72e-24c8-45e3-a7db-323a95972307 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:12.106293 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0d70b72e-24c8-45e3-a7db-323a95972307 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:12.114482 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0d70b72e-24c8-45e3-a7db-323a95972307 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:12.114944 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0d70b72e-24c8-45e3-a7db-323a95972307 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:12.115848 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0d70b72e-24c8-45e3-a7db-323a95972307 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:12.116289 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0d70b72e-24c8-45e3-a7db-323a95972307 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:12.119064 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-8d540135-5df2-4bb5-8592-e3f92e995130 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:12.126989 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-8d540135-5df2-4bb5-8592-e3f92e995130 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4" status: 200 len: 1317 microversion: 2.1 time: 0.165842 Jan 11 15:14:12.127601 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 299/589] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:11 2022] GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:12.269582 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0d70b72e-24c8-45e3-a7db-323a95972307 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:12.277845 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0d70b72e-24c8-45e3-a7db-323a95972307 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1568 microversion: 2.1 time: 0.177563 Jan 11 15:14:12.280586 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 291/590] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:12 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:12.979987 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-38b198a3-e6b8-486f-89c7-c47a0901de4b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:12.981019 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-38b198a3-e6b8-486f-89c7-c47a0901de4b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:12.987371 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-38b198a3-e6b8-486f-89c7-c47a0901de4b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:12.987881 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-38b198a3-e6b8-486f-89c7-c47a0901de4b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:12.988668 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-38b198a3-e6b8-486f-89c7-c47a0901de4b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:12.989195 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-38b198a3-e6b8-486f-89c7-c47a0901de4b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:13.109781 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9daa33fc-1647-4993-84d0-8ccc65692a5a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:13.110695 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9daa33fc-1647-4993-84d0-8ccc65692a5a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:13.118102 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9daa33fc-1647-4993-84d0-8ccc65692a5a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:13.119405 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9daa33fc-1647-4993-84d0-8ccc65692a5a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:13.120340 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9daa33fc-1647-4993-84d0-8ccc65692a5a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:13.120786 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9daa33fc-1647-4993-84d0-8ccc65692a5a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:19.045615 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-38b198a3-e6b8-486f-89c7-c47a0901de4b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 6.077838 Jan 11 15:14:19.046588 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 300/591] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:12 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 6080 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:14:19.051222 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-1ef825ec-eddb-46ae-a72b-f79a1506c398 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:19.051941 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-1ef825ec-eddb-46ae-a72b-f79a1506c398 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 1d506318-9988-434f-b8d6-bf11cbdef7b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:19.055265 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9daa33fc-1647-4993-84d0-8ccc65692a5a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 5.949162 Jan 11 15:14:19.056568 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 292/592] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:13 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 5951 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:14:19.059357 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1ef825ec-eddb-46ae-a72b-f79a1506c398 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:19.059751 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1ef825ec-eddb-46ae-a72b-f79a1506c398 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:19.060526 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1ef825ec-eddb-46ae-a72b-f79a1506c398 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:19.061130 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1ef825ec-eddb-46ae-a72b-f79a1506c398 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:19.062178 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-42ebf65b-3490-48f9-b2ca-2e9bec188be9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:19.063356 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-42ebf65b-3490-48f9-b2ca-2e9bec188be9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:19.070589 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-42ebf65b-3490-48f9-b2ca-2e9bec188be9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:19.071045 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-42ebf65b-3490-48f9-b2ca-2e9bec188be9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:19.072495 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-42ebf65b-3490-48f9-b2ca-2e9bec188be9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:19.072935 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-42ebf65b-3490-48f9-b2ca-2e9bec188be9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:19.256355 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-1ef825ec-eddb-46ae-a72b-f79a1506c398 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:19.264012 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-42ebf65b-3490-48f9-b2ca-2e9bec188be9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:19.264968 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-1ef825ec-eddb-46ae-a72b-f79a1506c398 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4" status: 200 len: 1507 microversion: 2.1 time: 0.217312 Jan 11 15:14:19.265543 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 301/593] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:19 2022] GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4 => generated 1507 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:19.272951 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-42ebf65b-3490-48f9-b2ca-2e9bec188be9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1568 microversion: 2.1 time: 0.214851 Jan 11 15:14:19.273517 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 293/594] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:19 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1568 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:20.057752 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e71b2cc8-c15b-4b06-8a11-e7185ca2226b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:20.058659 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e71b2cc8-c15b-4b06-8a11-e7185ca2226b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:20.064914 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e71b2cc8-c15b-4b06-8a11-e7185ca2226b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:20.065356 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e71b2cc8-c15b-4b06-8a11-e7185ca2226b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:20.066129 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e71b2cc8-c15b-4b06-8a11-e7185ca2226b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:20.066565 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e71b2cc8-c15b-4b06-8a11-e7185ca2226b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:20.067784 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ce6c27d9-066d-4ec1-8309-d3b1f9cabc47 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:20.068721 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ce6c27d9-066d-4ec1-8309-d3b1f9cabc47 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:20.075408 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ce6c27d9-066d-4ec1-8309-d3b1f9cabc47 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:20.075861 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ce6c27d9-066d-4ec1-8309-d3b1f9cabc47 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:20.076639 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ce6c27d9-066d-4ec1-8309-d3b1f9cabc47 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:20.077072 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ce6c27d9-066d-4ec1-8309-d3b1f9cabc47 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:20.190409 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e71b2cc8-c15b-4b06-8a11-e7185ca2226b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.136303 Jan 11 15:14:20.191060 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 302/595] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:20 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:14:20.193993 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ce6c27d9-066d-4ec1-8309-d3b1f9cabc47 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.129615 Jan 11 15:14:20.194616 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 294/596] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:20 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:14:20.290093 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e501e319-2616-4d11-88bf-c7243bc481b7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:20.290818 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e501e319-2616-4d11-88bf-c7243bc481b7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:20.297685 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e501e319-2616-4d11-88bf-c7243bc481b7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:20.298134 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e501e319-2616-4d11-88bf-c7243bc481b7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:20.298909 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e501e319-2616-4d11-88bf-c7243bc481b7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:20.299369 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e501e319-2616-4d11-88bf-c7243bc481b7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:20.432984 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-e501e319-2616-4d11-88bf-c7243bc481b7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:20.441572 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e501e319-2616-4d11-88bf-c7243bc481b7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1568 microversion: 2.1 time: 0.155411 Jan 11 15:14:20.442125 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 303/597] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:20 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:14:21.203869 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4df73356-880f-4e1f-91a4-2a6d3243aaf5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:21.205033 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-4df73356-880f-4e1f-91a4-2a6d3243aaf5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:21.205629 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e23856a9-495f-4118-a1dc-3f054433f084 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:21.206527 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e23856a9-495f-4118-a1dc-3f054433f084 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:21.212559 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4df73356-880f-4e1f-91a4-2a6d3243aaf5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:21.213004 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4df73356-880f-4e1f-91a4-2a6d3243aaf5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:21.213110 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e23856a9-495f-4118-a1dc-3f054433f084 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:21.213566 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e23856a9-495f-4118-a1dc-3f054433f084 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:21.213781 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4df73356-880f-4e1f-91a4-2a6d3243aaf5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:21.214214 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4df73356-880f-4e1f-91a4-2a6d3243aaf5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:21.214378 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e23856a9-495f-4118-a1dc-3f054433f084 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:21.214817 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e23856a9-495f-4118-a1dc-3f054433f084 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:21.283994 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e23856a9-495f-4118-a1dc-3f054433f084 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.081606 Jan 11 15:14:21.285267 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 304/598] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:21 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:14:21.287573 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4df73356-880f-4e1f-91a4-2a6d3243aaf5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.088375 Jan 11 15:14:21.288298 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 295/599] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:21 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:14:21.462088 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-69a143c7-9e44-4282-b4d3-82cebe620d80 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:21.462776 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-69a143c7-9e44-4282-b4d3-82cebe620d80 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:21.469929 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-69a143c7-9e44-4282-b4d3-82cebe620d80 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:21.470378 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-69a143c7-9e44-4282-b4d3-82cebe620d80 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:21.471214 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-69a143c7-9e44-4282-b4d3-82cebe620d80 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:21.471758 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-69a143c7-9e44-4282-b4d3-82cebe620d80 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:21.599682 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-69a143c7-9e44-4282-b4d3-82cebe620d80 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:21.608452 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-69a143c7-9e44-4282-b4d3-82cebe620d80 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1568 microversion: 2.1 time: 0.150637 Jan 11 15:14:21.609011 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 305/600] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:21 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:22.296600 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-87a6e218-ce11-4dc6-946e-a355c9ee190e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:22.297587 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-87a6e218-ce11-4dc6-946e-a355c9ee190e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:22.303047 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e510ad51-6bf2-4bb9-8910-06f8f7d73f23 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:22.304207 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e510ad51-6bf2-4bb9-8910-06f8f7d73f23 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:22.304664 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-87a6e218-ce11-4dc6-946e-a355c9ee190e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:22.305117 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-87a6e218-ce11-4dc6-946e-a355c9ee190e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:22.305963 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-87a6e218-ce11-4dc6-946e-a355c9ee190e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:22.306398 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-87a6e218-ce11-4dc6-946e-a355c9ee190e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:22.312949 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e510ad51-6bf2-4bb9-8910-06f8f7d73f23 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:22.312949 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e510ad51-6bf2-4bb9-8910-06f8f7d73f23 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:22.312949 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e510ad51-6bf2-4bb9-8910-06f8f7d73f23 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:22.313548 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e510ad51-6bf2-4bb9-8910-06f8f7d73f23 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:22.384705 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-87a6e218-ce11-4dc6-946e-a355c9ee190e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.091438 Jan 11 15:14:22.396189 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 296/601] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:22 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:14:22.396416 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e510ad51-6bf2-4bb9-8910-06f8f7d73f23 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.090612 Jan 11 15:14:22.396416 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 306/602] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:22 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:14:22.626696 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-39d16b2c-6eda-48c8-b93e-65c5c1df69d4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:22.627565 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-39d16b2c-6eda-48c8-b93e-65c5c1df69d4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:22.635181 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-39d16b2c-6eda-48c8-b93e-65c5c1df69d4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:22.636036 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-39d16b2c-6eda-48c8-b93e-65c5c1df69d4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:22.637187 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-39d16b2c-6eda-48c8-b93e-65c5c1df69d4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:22.637800 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-39d16b2c-6eda-48c8-b93e-65c5c1df69d4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:22.781541 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-39d16b2c-6eda-48c8-b93e-65c5c1df69d4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:22.791887 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-39d16b2c-6eda-48c8-b93e-65c5c1df69d4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1568 microversion: 2.1 time: 0.169626 Jan 11 15:14:22.800878 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 297/603] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:22 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:22.883234 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-8e75861f-b766-4bb7-9ec9-e2ce2b5ea42e tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02e0de43-f200-4174-baf0-559477615f7a"}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:22.884959 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-8e75861f-b766-4bb7-9ec9-e2ce2b5ea42e tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 1d506318-9988-434f-b8d6-bf11cbdef7b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:22.892306 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8e75861f-b766-4bb7-9ec9-e2ce2b5ea42e tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:22.892757 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8e75861f-b766-4bb7-9ec9-e2ce2b5ea42e tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:22.893730 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8e75861f-b766-4bb7-9ec9-e2ce2b5ea42e tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:22.894328 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8e75861f-b766-4bb7-9ec9-e2ce2b5ea42e tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:23.396329 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ab86026f-436b-420b-882c-8b649f6722d1 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:23.397241 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ab86026f-436b-420b-882c-8b649f6722d1 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:23.403617 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ab86026f-436b-420b-882c-8b649f6722d1 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:23.404069 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ab86026f-436b-420b-882c-8b649f6722d1 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:23.404845 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ab86026f-436b-420b-882c-8b649f6722d1 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:23.405284 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ab86026f-436b-420b-882c-8b649f6722d1 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:23.478181 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ab86026f-436b-420b-882c-8b649f6722d1 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.084789 Jan 11 15:14:23.482167 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 298/604] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:23 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:14:23.485455 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-837287ce-72e1-437a-9ca3-dc1382ab4efa tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:23.486935 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-837287ce-72e1-437a-9ca3-dc1382ab4efa tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:23.494726 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-837287ce-72e1-437a-9ca3-dc1382ab4efa tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:23.495189 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-837287ce-72e1-437a-9ca3-dc1382ab4efa tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:23.496028 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-837287ce-72e1-437a-9ca3-dc1382ab4efa tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:23.496476 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-837287ce-72e1-437a-9ca3-dc1382ab4efa tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:23.589394 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-837287ce-72e1-437a-9ca3-dc1382ab4efa tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.108800 Jan 11 15:14:23.590880 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 299/605] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:23 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:14:23.636115 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-8e75861f-b766-4bb7-9ec9-e2ce2b5ea42e tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "POST /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.756067 Jan 11 15:14:23.638739 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 307/606] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jan 11 15:14:22 2022] POST /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4/os-volume_attachments => generated 194 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:14:23.810205 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6ea98be8-bada-4b80-979c-49bd7baaaaa3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:23.811350 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6ea98be8-bada-4b80-979c-49bd7baaaaa3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:23.820109 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6ea98be8-bada-4b80-979c-49bd7baaaaa3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:23.822321 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6ea98be8-bada-4b80-979c-49bd7baaaaa3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:23.823273 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6ea98be8-bada-4b80-979c-49bd7baaaaa3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:23.823905 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6ea98be8-bada-4b80-979c-49bd7baaaaa3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:23.999095 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6ea98be8-bada-4b80-979c-49bd7baaaaa3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:24.008358 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6ea98be8-bada-4b80-979c-49bd7baaaaa3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1568 microversion: 2.1 time: 0.204276 Jan 11 15:14:24.009045 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 300/607] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:23 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1568 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:24.490674 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e90c67f7-158b-4347-bcc1-b50edf123182 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:24.491817 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e90c67f7-158b-4347-bcc1-b50edf123182 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:24.499265 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e90c67f7-158b-4347-bcc1-b50edf123182 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:24.499741 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e90c67f7-158b-4347-bcc1-b50edf123182 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:24.500618 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e90c67f7-158b-4347-bcc1-b50edf123182 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:24.501215 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e90c67f7-158b-4347-bcc1-b50edf123182 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:24.591206 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e90c67f7-158b-4347-bcc1-b50edf123182 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.105434 Jan 11 15:14:24.592123 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 308/608] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:24 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:14:24.601957 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b95e4a6a-f16a-4a80-a765-7323d5815b2a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:24.603119 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b95e4a6a-f16a-4a80-a765-7323d5815b2a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:24.620718 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b95e4a6a-f16a-4a80-a765-7323d5815b2a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:24.625882 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b95e4a6a-f16a-4a80-a765-7323d5815b2a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:24.625882 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b95e4a6a-f16a-4a80-a765-7323d5815b2a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:24.625882 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b95e4a6a-f16a-4a80-a765-7323d5815b2a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:24.729954 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b95e4a6a-f16a-4a80-a765-7323d5815b2a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.131914 Jan 11 15:14:24.734051 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 301/609] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:24 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:14:25.026988 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3a40405d-bd04-4989-894d-52e055123a7c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:25.028450 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3a40405d-bd04-4989-894d-52e055123a7c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:25.035586 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3a40405d-bd04-4989-894d-52e055123a7c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:25.036344 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3a40405d-bd04-4989-894d-52e055123a7c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:25.037532 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3a40405d-bd04-4989-894d-52e055123a7c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:25.038110 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3a40405d-bd04-4989-894d-52e055123a7c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:25.191428 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-3a40405d-bd04-4989-894d-52e055123a7c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:25.200455 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3a40405d-bd04-4989-894d-52e055123a7c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1568 microversion: 2.1 time: 0.177935 Jan 11 15:14:25.210064 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 309/610] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:25 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:25.608572 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-010eabe3-f286-4e5f-b48a-bc2eb48d95d6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:25.610979 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-010eabe3-f286-4e5f-b48a-bc2eb48d95d6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:25.625623 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-010eabe3-f286-4e5f-b48a-bc2eb48d95d6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:25.626393 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-010eabe3-f286-4e5f-b48a-bc2eb48d95d6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:25.627758 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-010eabe3-f286-4e5f-b48a-bc2eb48d95d6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:25.628893 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-010eabe3-f286-4e5f-b48a-bc2eb48d95d6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:25.720749 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-010eabe3-f286-4e5f-b48a-bc2eb48d95d6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.119953 Jan 11 15:14:25.722072 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 302/611] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:25 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:14:25.742071 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-709bb33c-c6e9-4d09-a9fc-7dac83b8b026 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:25.743127 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-709bb33c-c6e9-4d09-a9fc-7dac83b8b026 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:25.749977 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-709bb33c-c6e9-4d09-a9fc-7dac83b8b026 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:25.750548 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-709bb33c-c6e9-4d09-a9fc-7dac83b8b026 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:25.751706 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-709bb33c-c6e9-4d09-a9fc-7dac83b8b026 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:25.752742 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-709bb33c-c6e9-4d09-a9fc-7dac83b8b026 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:25.848375 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-709bb33c-c6e9-4d09-a9fc-7dac83b8b026 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.110130 Jan 11 15:14:25.848934 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 310/612] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:25 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:14:26.219017 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4ba26145-4c1f-4b8e-97ef-0d0dfb77c52c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:26.219754 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-4ba26145-4c1f-4b8e-97ef-0d0dfb77c52c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:26.227339 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4ba26145-4c1f-4b8e-97ef-0d0dfb77c52c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:26.227806 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4ba26145-4c1f-4b8e-97ef-0d0dfb77c52c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:26.228596 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4ba26145-4c1f-4b8e-97ef-0d0dfb77c52c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:26.229042 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4ba26145-4c1f-4b8e-97ef-0d0dfb77c52c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:26.401089 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-4ba26145-4c1f-4b8e-97ef-0d0dfb77c52c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:26.408966 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4ba26145-4c1f-4b8e-97ef-0d0dfb77c52c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1568 microversion: 2.1 time: 0.194454 Jan 11 15:14:26.412536 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 303/613] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:26 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:14:26.734988 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-188ce1c8-b1a5-40f2-976f-ba3fdd435a0b tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:26.736655 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-188ce1c8-b1a5-40f2-976f-ba3fdd435a0b tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:26.746441 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-188ce1c8-b1a5-40f2-976f-ba3fdd435a0b tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:26.747122 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-188ce1c8-b1a5-40f2-976f-ba3fdd435a0b tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:26.748575 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-188ce1c8-b1a5-40f2-976f-ba3fdd435a0b tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:26.749220 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-188ce1c8-b1a5-40f2-976f-ba3fdd435a0b tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:26.843956 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-188ce1c8-b1a5-40f2-976f-ba3fdd435a0b tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.111652 Jan 11 15:14:26.845009 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 311/614] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:26 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:14:26.859278 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e2015ff0-b086-4d0a-81b4-fe021c485a9d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:26.860225 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e2015ff0-b086-4d0a-81b4-fe021c485a9d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:26.866671 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e2015ff0-b086-4d0a-81b4-fe021c485a9d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:26.867127 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e2015ff0-b086-4d0a-81b4-fe021c485a9d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:26.868627 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e2015ff0-b086-4d0a-81b4-fe021c485a9d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:26.869348 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e2015ff0-b086-4d0a-81b4-fe021c485a9d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:27.026947 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e2015ff0-b086-4d0a-81b4-fe021c485a9d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.170334 Jan 11 15:14:27.032172 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 304/615] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:26 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:14:27.426337 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c838e45c-5856-47ff-b468-aeefb5072818 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:27.427145 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c838e45c-5856-47ff-b468-aeefb5072818 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:27.441368 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c838e45c-5856-47ff-b468-aeefb5072818 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:27.441833 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c838e45c-5856-47ff-b468-aeefb5072818 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:27.442630 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c838e45c-5856-47ff-b468-aeefb5072818 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:27.443081 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c838e45c-5856-47ff-b468-aeefb5072818 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:27.603895 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-c838e45c-5856-47ff-b468-aeefb5072818 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:27.616078 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c838e45c-5856-47ff-b468-aeefb5072818 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1568 microversion: 2.1 time: 0.193752 Jan 11 15:14:27.617253 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 312/616] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:27 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:27.858491 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-158a8a58-72a3-44d1-aaba-8c8a1113882e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:27.859547 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-158a8a58-72a3-44d1-aaba-8c8a1113882e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:27.872058 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-158a8a58-72a3-44d1-aaba-8c8a1113882e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:27.872726 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-158a8a58-72a3-44d1-aaba-8c8a1113882e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:27.873700 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-158a8a58-72a3-44d1-aaba-8c8a1113882e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:27.874334 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-158a8a58-72a3-44d1-aaba-8c8a1113882e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:27.986154 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-158a8a58-72a3-44d1-aaba-8c8a1113882e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.132122 Jan 11 15:14:27.990180 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 305/617] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:27 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:14:28.037964 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3d432275-c680-4111-9efb-ebd609376a73 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:28.038995 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3d432275-c680-4111-9efb-ebd609376a73 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:28.045753 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3d432275-c680-4111-9efb-ebd609376a73 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:28.046325 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3d432275-c680-4111-9efb-ebd609376a73 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:28.047373 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3d432275-c680-4111-9efb-ebd609376a73 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:28.047983 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3d432275-c680-4111-9efb-ebd609376a73 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:28.162506 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3d432275-c680-4111-9efb-ebd609376a73 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.128085 Jan 11 15:14:28.168452 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 313/618] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:28 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:14:28.635722 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-077dce1a-3a13-4b92-b829-53d9c1fe79bc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:28.636762 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-077dce1a-3a13-4b92-b829-53d9c1fe79bc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:28.644232 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-077dce1a-3a13-4b92-b829-53d9c1fe79bc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:28.644979 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-077dce1a-3a13-4b92-b829-53d9c1fe79bc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:28.646007 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-077dce1a-3a13-4b92-b829-53d9c1fe79bc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:28.646528 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-077dce1a-3a13-4b92-b829-53d9c1fe79bc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:28.816078 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-077dce1a-3a13-4b92-b829-53d9c1fe79bc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:28.826712 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-077dce1a-3a13-4b92-b829-53d9c1fe79bc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1568 microversion: 2.1 time: 0.195219 Jan 11 15:14:28.836767 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 306/619] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:28 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1568 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:28.997956 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-914e01a5-2cfa-4bf5-9b05-efaaf90cc3af tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:28.998966 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-914e01a5-2cfa-4bf5-9b05-efaaf90cc3af tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:29.005946 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-914e01a5-2cfa-4bf5-9b05-efaaf90cc3af tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:29.006665 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-914e01a5-2cfa-4bf5-9b05-efaaf90cc3af tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:29.007682 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-914e01a5-2cfa-4bf5-9b05-efaaf90cc3af tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:29.008306 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-914e01a5-2cfa-4bf5-9b05-efaaf90cc3af tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:29.142308 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-914e01a5-2cfa-4bf5-9b05-efaaf90cc3af tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.148107 Jan 11 15:14:29.142993 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 314/620] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:28 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:14:29.179355 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ef1d6c04-38cc-463c-beb0-9ad7bb35e2e7 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:29.179355 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ef1d6c04-38cc-463c-beb0-9ad7bb35e2e7 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:29.187339 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ef1d6c04-38cc-463c-beb0-9ad7bb35e2e7 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:29.187802 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ef1d6c04-38cc-463c-beb0-9ad7bb35e2e7 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:29.188812 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ef1d6c04-38cc-463c-beb0-9ad7bb35e2e7 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:29.189433 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ef1d6c04-38cc-463c-beb0-9ad7bb35e2e7 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:29.284539 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ef1d6c04-38cc-463c-beb0-9ad7bb35e2e7 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.112295 Jan 11 15:14:29.286253 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 307/621] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:29 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:14:29.844388 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2d9bc743-962f-41f8-a48e-9e105292acfe tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:29.845346 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2d9bc743-962f-41f8-a48e-9e105292acfe tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:29.852770 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2d9bc743-962f-41f8-a48e-9e105292acfe tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:29.853237 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2d9bc743-962f-41f8-a48e-9e105292acfe tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:29.854079 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2d9bc743-962f-41f8-a48e-9e105292acfe tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:29.854535 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2d9bc743-962f-41f8-a48e-9e105292acfe tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:30.014436 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-2d9bc743-962f-41f8-a48e-9e105292acfe tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:30.026784 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2d9bc743-962f-41f8-a48e-9e105292acfe tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1568 microversion: 2.1 time: 0.186463 Jan 11 15:14:30.027490 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 315/622] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:29 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:30.156171 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-09f9aea0-312d-40d2-ab47-a9c4a0881128 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:30.157427 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-09f9aea0-312d-40d2-ab47-a9c4a0881128 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:30.165871 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-09f9aea0-312d-40d2-ab47-a9c4a0881128 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:30.167263 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-09f9aea0-312d-40d2-ab47-a9c4a0881128 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:30.168256 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-09f9aea0-312d-40d2-ab47-a9c4a0881128 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:30.169180 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-09f9aea0-312d-40d2-ab47-a9c4a0881128 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:30.256641 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-09f9aea0-312d-40d2-ab47-a9c4a0881128 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.104906 Jan 11 15:14:30.259353 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 308/623] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:30 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:14:30.296633 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a241e974-43ed-4caa-8669-a9e59fac5aa0 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:30.298610 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a241e974-43ed-4caa-8669-a9e59fac5aa0 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:30.305762 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a241e974-43ed-4caa-8669-a9e59fac5aa0 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:30.306257 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a241e974-43ed-4caa-8669-a9e59fac5aa0 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:30.307071 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a241e974-43ed-4caa-8669-a9e59fac5aa0 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:30.307570 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a241e974-43ed-4caa-8669-a9e59fac5aa0 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:30.904264 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a241e974-43ed-4caa-8669-a9e59fac5aa0 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.611141 Jan 11 15:14:30.904999 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 316/624] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:30 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:14:31.045379 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-53c31dd2-745f-485b-b93f-00da571255a9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:31.047004 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-53c31dd2-745f-485b-b93f-00da571255a9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:31.057119 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-53c31dd2-745f-485b-b93f-00da571255a9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:31.058662 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-53c31dd2-745f-485b-b93f-00da571255a9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:31.059759 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-53c31dd2-745f-485b-b93f-00da571255a9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:31.060483 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-53c31dd2-745f-485b-b93f-00da571255a9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:31.238658 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-53c31dd2-745f-485b-b93f-00da571255a9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:31.248171 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-53c31dd2-745f-485b-b93f-00da571255a9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1568 microversion: 2.1 time: 0.206653 Jan 11 15:14:31.249454 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 309/625] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:31 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1568 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:31.272687 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ac9d0944-6225-4441-a625-4b14c3d5c2f7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:31.273833 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-ac9d0944-6225-4441-a625-4b14c3d5c2f7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:31.283830 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ac9d0944-6225-4441-a625-4b14c3d5c2f7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:31.284752 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ac9d0944-6225-4441-a625-4b14c3d5c2f7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:31.285790 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ac9d0944-6225-4441-a625-4b14c3d5c2f7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:31.286469 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ac9d0944-6225-4441-a625-4b14c3d5c2f7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:31.387697 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-ac9d0944-6225-4441-a625-4b14c3d5c2f7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.119859 Jan 11 15:14:31.393056 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 317/626] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:31 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:14:31.916884 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-18ff9b44-d374-4e71-a838-f7da5ceeaf4a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:31.918461 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-18ff9b44-d374-4e71-a838-f7da5ceeaf4a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:31.925194 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-18ff9b44-d374-4e71-a838-f7da5ceeaf4a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:31.925827 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-18ff9b44-d374-4e71-a838-f7da5ceeaf4a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:31.926643 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-18ff9b44-d374-4e71-a838-f7da5ceeaf4a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:31.927265 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-18ff9b44-d374-4e71-a838-f7da5ceeaf4a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:32.187280 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-18ff9b44-d374-4e71-a838-f7da5ceeaf4a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.274324 Jan 11 15:14:32.193065 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 310/627] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:31 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:14:32.266685 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e7a52e7f-6d3f-48c5-8c17-dff03811911d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:32.267560 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e7a52e7f-6d3f-48c5-8c17-dff03811911d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:32.275679 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e7a52e7f-6d3f-48c5-8c17-dff03811911d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:32.276233 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e7a52e7f-6d3f-48c5-8c17-dff03811911d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:32.277140 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e7a52e7f-6d3f-48c5-8c17-dff03811911d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:32.277662 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e7a52e7f-6d3f-48c5-8c17-dff03811911d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:32.401410 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2dab5dfd-5ab5-4b24-8794-01831e6922da tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:32.402792 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2dab5dfd-5ab5-4b24-8794-01831e6922da tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:32.412648 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2dab5dfd-5ab5-4b24-8794-01831e6922da tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:32.413365 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2dab5dfd-5ab5-4b24-8794-01831e6922da tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:32.414407 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2dab5dfd-5ab5-4b24-8794-01831e6922da tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:32.415112 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2dab5dfd-5ab5-4b24-8794-01831e6922da tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:32.473568 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-e7a52e7f-6d3f-48c5-8c17-dff03811911d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:32.483532 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e7a52e7f-6d3f-48c5-8c17-dff03811911d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1568 microversion: 2.1 time: 0.221066 Jan 11 15:14:32.487943 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 318/628] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:32 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:32.582101 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2dab5dfd-5ab5-4b24-8794-01831e6922da tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.184819 Jan 11 15:14:32.582947 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 311/629] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:32 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:14:32.605551 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e37bd49e-b0bf-404b-89a3-9677b917a64d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:32.606071 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e37bd49e-b0bf-404b-89a3-9677b917a64d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 1d506318-9988-434f-b8d6-bf11cbdef7b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:32.612323 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e37bd49e-b0bf-404b-89a3-9677b917a64d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:32.612768 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e37bd49e-b0bf-404b-89a3-9677b917a64d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:32.613733 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e37bd49e-b0bf-404b-89a3-9677b917a64d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:32.614166 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e37bd49e-b0bf-404b-89a3-9677b917a64d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:32.696326 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.objects.instance [None req-e37bd49e-b0bf-404b-89a3-9677b917a64d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lazy-loading 'services' on Instance uuid 1d506318-9988-434f-b8d6-bf11cbdef7b4 {{(pid=116903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 15:14:32.927440 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e37bd49e-b0bf-404b-89a3-9677b917a64d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4/os-volume_attachments/02e0de43-f200-4174-baf0-559477615f7a" status: 202 len: 0 microversion: 2.1 time: 0.325758 Jan 11 15:14:32.928523 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 319/630] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jan 11 15:14:32 2022] DELETE /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4/os-volume_attachments/02e0de43-f200-4174-baf0-559477615f7a => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:14:32.936736 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6d953867-7a27-4ea7-8ec2-06e9d161c877 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:32.951602 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6d953867-7a27-4ea7-8ec2-06e9d161c877 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 1d506318-9988-434f-b8d6-bf11cbdef7b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:32.957417 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6d953867-7a27-4ea7-8ec2-06e9d161c877 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:32.958213 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6d953867-7a27-4ea7-8ec2-06e9d161c877 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:32.959231 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6d953867-7a27-4ea7-8ec2-06e9d161c877 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:32.959927 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6d953867-7a27-4ea7-8ec2-06e9d161c877 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:32.997996 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6d953867-7a27-4ea7-8ec2-06e9d161c877 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065179 Jan 11 15:14:32.999018 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 312/631] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:14:32 2022] GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:14:33.201359 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-9ba4a111-4078-4c9c-abeb-0e90e9d9d177 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:33.203338 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-9ba4a111-4078-4c9c-abeb-0e90e9d9d177 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:33.212272 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9ba4a111-4078-4c9c-abeb-0e90e9d9d177 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:33.213084 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9ba4a111-4078-4c9c-abeb-0e90e9d9d177 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:33.214876 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9ba4a111-4078-4c9c-abeb-0e90e9d9d177 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:33.215521 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9ba4a111-4078-4c9c-abeb-0e90e9d9d177 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:33.299553 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-9ba4a111-4078-4c9c-abeb-0e90e9d9d177 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.104128 Jan 11 15:14:33.300574 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 320/632] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:33 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:14:33.505226 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8b1e6b46-489e-430c-a249-494562408b4e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:33.506132 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8b1e6b46-489e-430c-a249-494562408b4e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:33.513048 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8b1e6b46-489e-430c-a249-494562408b4e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:33.513497 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8b1e6b46-489e-430c-a249-494562408b4e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:33.514311 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8b1e6b46-489e-430c-a249-494562408b4e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:33.515124 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8b1e6b46-489e-430c-a249-494562408b4e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:33.599731 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-9dbccd9e-62f8-4c9d-8438-ddf3edd412cd tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:33.600874 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-9dbccd9e-62f8-4c9d-8438-ddf3edd412cd tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:33.608978 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9dbccd9e-62f8-4c9d-8438-ddf3edd412cd tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:33.609944 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9dbccd9e-62f8-4c9d-8438-ddf3edd412cd tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:33.610842 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9dbccd9e-62f8-4c9d-8438-ddf3edd412cd tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:33.611527 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9dbccd9e-62f8-4c9d-8438-ddf3edd412cd tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:33.676941 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-8b1e6b46-489e-430c-a249-494562408b4e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:33.686953 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8b1e6b46-489e-430c-a249-494562408b4e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1568 microversion: 2.1 time: 0.185321 Jan 11 15:14:33.697973 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 313/633] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:33 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:14:33.723709 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-9dbccd9e-62f8-4c9d-8438-ddf3edd412cd tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.127652 Jan 11 15:14:33.725435 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 321/634] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:33 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:14:34.013581 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9a705375-8a4e-47ce-a6a5-4b959287219c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:34.014527 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9a705375-8a4e-47ce-a6a5-4b959287219c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 1d506318-9988-434f-b8d6-bf11cbdef7b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:34.022033 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9a705375-8a4e-47ce-a6a5-4b959287219c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:34.023076 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9a705375-8a4e-47ce-a6a5-4b959287219c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:34.024474 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9a705375-8a4e-47ce-a6a5-4b959287219c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:34.025133 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9a705375-8a4e-47ce-a6a5-4b959287219c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:34.064846 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9a705375-8a4e-47ce-a6a5-4b959287219c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057373 Jan 11 15:14:34.065902 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 314/635] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:14:34 2022] GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:14:34.329288 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-49998d0f-6b7b-4b2e-b13f-51ad9fb704c9 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:34.330981 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-49998d0f-6b7b-4b2e-b13f-51ad9fb704c9 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:34.341644 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-49998d0f-6b7b-4b2e-b13f-51ad9fb704c9 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:34.342659 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-49998d0f-6b7b-4b2e-b13f-51ad9fb704c9 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:34.344043 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-49998d0f-6b7b-4b2e-b13f-51ad9fb704c9 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:34.349847 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-49998d0f-6b7b-4b2e-b13f-51ad9fb704c9 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:34.456385 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-49998d0f-6b7b-4b2e-b13f-51ad9fb704c9 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.135462 Jan 11 15:14:34.459817 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 322/636] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:34 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:14:34.705047 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5c3829d4-b823-4541-ba37-762d55b4a57b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:34.706036 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5c3829d4-b823-4541-ba37-762d55b4a57b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:34.713597 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5c3829d4-b823-4541-ba37-762d55b4a57b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:34.714429 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5c3829d4-b823-4541-ba37-762d55b4a57b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:34.715247 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5c3829d4-b823-4541-ba37-762d55b4a57b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:34.715893 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5c3829d4-b823-4541-ba37-762d55b4a57b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:34.738557 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-94534173-1909-4915-9d44-55bee5d00417 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:34.739592 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-94534173-1909-4915-9d44-55bee5d00417 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:34.746389 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-94534173-1909-4915-9d44-55bee5d00417 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:34.747074 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-94534173-1909-4915-9d44-55bee5d00417 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:34.747889 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-94534173-1909-4915-9d44-55bee5d00417 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:34.748329 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-94534173-1909-4915-9d44-55bee5d00417 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:34.858730 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-5c3829d4-b823-4541-ba37-762d55b4a57b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:34.867452 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5c3829d4-b823-4541-ba37-762d55b4a57b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1568 microversion: 2.1 time: 0.166237 Jan 11 15:14:34.868225 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 315/637] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:34 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:34.921418 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-94534173-1909-4915-9d44-55bee5d00417 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.187862 Jan 11 15:14:34.926040 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 323/638] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:34 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:14:35.078026 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ba9a4aa7-3517-41ee-b3d9-ca2867228476 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:35.078879 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ba9a4aa7-3517-41ee-b3d9-ca2867228476 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 1d506318-9988-434f-b8d6-bf11cbdef7b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:35.085149 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ba9a4aa7-3517-41ee-b3d9-ca2867228476 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:35.085805 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ba9a4aa7-3517-41ee-b3d9-ca2867228476 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:35.087466 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ba9a4aa7-3517-41ee-b3d9-ca2867228476 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:35.087907 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ba9a4aa7-3517-41ee-b3d9-ca2867228476 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:35.131261 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ba9a4aa7-3517-41ee-b3d9-ca2867228476 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057117 Jan 11 15:14:35.131998 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 316/639] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:14:35 2022] GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 15:14:35.474016 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3ae17da5-7c71-453a-9d3d-4e9f725fc68a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:35.475035 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3ae17da5-7c71-453a-9d3d-4e9f725fc68a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:35.483551 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3ae17da5-7c71-453a-9d3d-4e9f725fc68a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:35.489201 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3ae17da5-7c71-453a-9d3d-4e9f725fc68a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:35.489201 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3ae17da5-7c71-453a-9d3d-4e9f725fc68a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:35.489201 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3ae17da5-7c71-453a-9d3d-4e9f725fc68a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:35.611352 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3ae17da5-7c71-453a-9d3d-4e9f725fc68a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.140343 Jan 11 15:14:35.611352 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 324/640] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:35 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:14:35.884510 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6d507f5b-b65f-4da5-9889-7554146d0c1e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:35.885757 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6d507f5b-b65f-4da5-9889-7554146d0c1e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:35.892913 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6d507f5b-b65f-4da5-9889-7554146d0c1e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:35.893731 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6d507f5b-b65f-4da5-9889-7554146d0c1e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:35.895164 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6d507f5b-b65f-4da5-9889-7554146d0c1e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:35.895850 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6d507f5b-b65f-4da5-9889-7554146d0c1e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:35.934871 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3bc48cc4-1f09-4c8d-b835-9fc6f3c9ac8e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:35.936732 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3bc48cc4-1f09-4c8d-b835-9fc6f3c9ac8e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:35.945767 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3bc48cc4-1f09-4c8d-b835-9fc6f3c9ac8e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:35.946612 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3bc48cc4-1f09-4c8d-b835-9fc6f3c9ac8e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:35.947762 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3bc48cc4-1f09-4c8d-b835-9fc6f3c9ac8e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:35.948428 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3bc48cc4-1f09-4c8d-b835-9fc6f3c9ac8e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:36.058060 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6d507f5b-b65f-4da5-9889-7554146d0c1e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:36.066801 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6d507f5b-b65f-4da5-9889-7554146d0c1e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1568 microversion: 2.1 time: 0.185900 Jan 11 15:14:36.067407 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 317/641] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:35 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:36.161427 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3bc48cc4-1f09-4c8d-b835-9fc6f3c9ac8e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.231028 Jan 11 15:14:36.162731 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 325/642] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:35 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:14:36.583240 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b6b87205-5642-4921-af57-26f71a50d97b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:36.583801 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b6b87205-5642-4921-af57-26f71a50d97b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 1d506318-9988-434f-b8d6-bf11cbdef7b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:36.590424 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b6b87205-5642-4921-af57-26f71a50d97b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:36.590903 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b6b87205-5642-4921-af57-26f71a50d97b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:36.591715 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b6b87205-5642-4921-af57-26f71a50d97b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:36.592153 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b6b87205-5642-4921-af57-26f71a50d97b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:36.616207 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b6b87205-5642-4921-af57-26f71a50d97b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 1d506318-9988-434f-b8d6-bf11cbdef7b4] Going to try to terminate instance {{(pid=116902) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 15:14:36.623180 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-435af2d6-62e1-4e0b-a67f-b7fe87703d07 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:36.624067 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-435af2d6-62e1-4e0b-a67f-b7fe87703d07 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:36.630585 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-435af2d6-62e1-4e0b-a67f-b7fe87703d07 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:36.631039 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-435af2d6-62e1-4e0b-a67f-b7fe87703d07 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:36.631884 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-435af2d6-62e1-4e0b-a67f-b7fe87703d07 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:36.632324 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-435af2d6-62e1-4e0b-a67f-b7fe87703d07 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:36.794702 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-435af2d6-62e1-4e0b-a67f-b7fe87703d07 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.175543 Jan 11 15:14:36.795836 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 326/643] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:36 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:14:36.918170 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b6b87205-5642-4921-af57-26f71a50d97b tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4" status: 204 len: 0 microversion: 2.1 time: 0.338349 Jan 11 15:14:36.918956 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 318/644] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jan 11 15:14:36 2022] DELETE /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 11 15:14:36.932737 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-23796f7f-0945-4237-b91e-a1288c1a475a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:36.934623 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-23796f7f-0945-4237-b91e-a1288c1a475a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 1d506318-9988-434f-b8d6-bf11cbdef7b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:36.942585 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-23796f7f-0945-4237-b91e-a1288c1a475a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:36.943954 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-23796f7f-0945-4237-b91e-a1288c1a475a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:36.945216 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-23796f7f-0945-4237-b91e-a1288c1a475a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:36.945867 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-23796f7f-0945-4237-b91e-a1288c1a475a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:37.087547 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b66ba752-41db-4f01-a25d-ec607e412988 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:37.088654 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b66ba752-41db-4f01-a25d-ec607e412988 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:37.095535 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b66ba752-41db-4f01-a25d-ec607e412988 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:37.096322 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b66ba752-41db-4f01-a25d-ec607e412988 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:37.097312 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b66ba752-41db-4f01-a25d-ec607e412988 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:37.097957 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b66ba752-41db-4f01-a25d-ec607e412988 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:37.108281 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-23796f7f-0945-4237-b91e-a1288c1a475a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:37.115937 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-23796f7f-0945-4237-b91e-a1288c1a475a tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4" status: 200 len: 1513 microversion: 2.1 time: 0.187809 Jan 11 15:14:37.116515 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 327/645] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:36 2022] GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4 => generated 1513 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:14:37.173869 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-6d051359-4ef4-4cd1-9124-16fe57789e6b tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:37.174787 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-6d051359-4ef4-4cd1-9124-16fe57789e6b tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:37.185459 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6d051359-4ef4-4cd1-9124-16fe57789e6b tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:37.187010 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6d051359-4ef4-4cd1-9124-16fe57789e6b tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:37.190889 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6d051359-4ef4-4cd1-9124-16fe57789e6b tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:37.191561 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6d051359-4ef4-4cd1-9124-16fe57789e6b tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:37.278080 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b66ba752-41db-4f01-a25d-ec607e412988 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:37.287933 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b66ba752-41db-4f01-a25d-ec607e412988 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1568 microversion: 2.1 time: 0.204899 Jan 11 15:14:37.288521 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 319/646] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:37 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1568 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:37.679961 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-6d051359-4ef4-4cd1-9124-16fe57789e6b tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.509515 Jan 11 15:14:37.680820 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 328/647] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:37 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:14:37.806173 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f58ff1bc-0ca2-45d5-b105-8ebbc4c22976 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:37.807195 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f58ff1bc-0ca2-45d5-b105-8ebbc4c22976 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:37.813698 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f58ff1bc-0ca2-45d5-b105-8ebbc4c22976 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:37.814161 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f58ff1bc-0ca2-45d5-b105-8ebbc4c22976 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:37.814948 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f58ff1bc-0ca2-45d5-b105-8ebbc4c22976 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:37.815447 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f58ff1bc-0ca2-45d5-b105-8ebbc4c22976 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:37.977297 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f58ff1bc-0ca2-45d5-b105-8ebbc4c22976 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.174603 Jan 11 15:14:37.977945 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 320/648] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:37 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:14:38.134567 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-29f5084c-7183-4858-8bcb-a5b0ea1d121f tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:38.135174 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-29f5084c-7183-4858-8bcb-a5b0ea1d121f tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 1d506318-9988-434f-b8d6-bf11cbdef7b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:38.142802 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-29f5084c-7183-4858-8bcb-a5b0ea1d121f tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:38.143254 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-29f5084c-7183-4858-8bcb-a5b0ea1d121f tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:38.144086 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-29f5084c-7183-4858-8bcb-a5b0ea1d121f tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:38.144705 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-29f5084c-7183-4858-8bcb-a5b0ea1d121f tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:38.307864 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5c4491e3-19f9-4646-9b67-c0bac8fbe7a1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:38.308636 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5c4491e3-19f9-4646-9b67-c0bac8fbe7a1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:38.316347 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5c4491e3-19f9-4646-9b67-c0bac8fbe7a1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:38.317110 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5c4491e3-19f9-4646-9b67-c0bac8fbe7a1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:38.318049 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5c4491e3-19f9-4646-9b67-c0bac8fbe7a1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:38.318588 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5c4491e3-19f9-4646-9b67-c0bac8fbe7a1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:38.367113 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-29f5084c-7183-4858-8bcb-a5b0ea1d121f tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:38.401844 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-29f5084c-7183-4858-8bcb-a5b0ea1d121f tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4" status: 200 len: 1513 microversion: 2.1 time: 0.271797 Jan 11 15:14:38.405132 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 329/649] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:38 2022] GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4 => generated 1513 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:38.502166 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-5c4491e3-19f9-4646-9b67-c0bac8fbe7a1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:38.514347 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5c4491e3-19f9-4646-9b67-c0bac8fbe7a1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1568 microversion: 2.1 time: 0.213239 Jan 11 15:14:38.514928 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 321/650] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:38 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:14:38.697357 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-91717c47-2424-4b00-8873-b7da18c37e26 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:38.698294 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-91717c47-2424-4b00-8873-b7da18c37e26 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:38.705981 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-91717c47-2424-4b00-8873-b7da18c37e26 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:38.706441 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-91717c47-2424-4b00-8873-b7da18c37e26 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:38.707285 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-91717c47-2424-4b00-8873-b7da18c37e26 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:38.707755 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-91717c47-2424-4b00-8873-b7da18c37e26 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:38.828767 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-91717c47-2424-4b00-8873-b7da18c37e26 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.134698 Jan 11 15:14:38.829587 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 330/651] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:38 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:14:38.988323 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-27c2ffd7-b56e-48bf-9df1-d96af3a1e716 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:38.989219 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-27c2ffd7-b56e-48bf-9df1-d96af3a1e716 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:38.996069 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-27c2ffd7-b56e-48bf-9df1-d96af3a1e716 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:38.996519 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-27c2ffd7-b56e-48bf-9df1-d96af3a1e716 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:38.997286 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-27c2ffd7-b56e-48bf-9df1-d96af3a1e716 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:38.997726 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-27c2ffd7-b56e-48bf-9df1-d96af3a1e716 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:39.080015 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-27c2ffd7-b56e-48bf-9df1-d96af3a1e716 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.095333 Jan 11 15:14:39.080903 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 322/652] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:38 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:14:39.422125 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f47c1821-20ab-483f-acd9-d6679448d46d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:39.423365 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f47c1821-20ab-483f-acd9-d6679448d46d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 1d506318-9988-434f-b8d6-bf11cbdef7b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:39.431614 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f47c1821-20ab-483f-acd9-d6679448d46d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:39.432406 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f47c1821-20ab-483f-acd9-d6679448d46d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:39.433510 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f47c1821-20ab-483f-acd9-d6679448d46d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:39.434173 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f47c1821-20ab-483f-acd9-d6679448d46d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:39.532126 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-95b8f09e-4259-4bbe-9792-eadb2a2a7c6e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:39.533206 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-95b8f09e-4259-4bbe-9792-eadb2a2a7c6e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:39.542434 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-95b8f09e-4259-4bbe-9792-eadb2a2a7c6e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:39.544934 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-95b8f09e-4259-4bbe-9792-eadb2a2a7c6e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:39.551507 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-95b8f09e-4259-4bbe-9792-eadb2a2a7c6e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:39.552302 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-95b8f09e-4259-4bbe-9792-eadb2a2a7c6e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:39.691792 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-f47c1821-20ab-483f-acd9-d6679448d46d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:39.691792 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f47c1821-20ab-483f-acd9-d6679448d46d tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4" status: 200 len: 1513 microversion: 2.1 time: 0.271831 Jan 11 15:14:39.691792 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 331/653] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:39 2022] GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4 => generated 1513 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:39.799930 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-95b8f09e-4259-4bbe-9792-eadb2a2a7c6e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:39.805446 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-95b8f09e-4259-4bbe-9792-eadb2a2a7c6e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1568 microversion: 2.1 time: 0.277288 Jan 11 15:14:39.806316 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 323/654] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:39 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1568 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:39.840597 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-fadbb98c-42d6-43a7-b3e9-c5c79da05979 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:39.841539 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-fadbb98c-42d6-43a7-b3e9-c5c79da05979 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:39.847932 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fadbb98c-42d6-43a7-b3e9-c5c79da05979 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:39.848381 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fadbb98c-42d6-43a7-b3e9-c5c79da05979 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:39.849162 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fadbb98c-42d6-43a7-b3e9-c5c79da05979 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:39.849598 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fadbb98c-42d6-43a7-b3e9-c5c79da05979 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:40.047500 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-fadbb98c-42d6-43a7-b3e9-c5c79da05979 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.211040 Jan 11 15:14:40.048149 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 332/655] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:39 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:14:40.092332 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7c199506-78d4-4a8e-ac33-34a481f1edda tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:40.093250 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-7c199506-78d4-4a8e-ac33-34a481f1edda tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:40.099592 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7c199506-78d4-4a8e-ac33-34a481f1edda tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:40.101345 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7c199506-78d4-4a8e-ac33-34a481f1edda tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:40.101345 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7c199506-78d4-4a8e-ac33-34a481f1edda tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:40.101345 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7c199506-78d4-4a8e-ac33-34a481f1edda tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:40.214616 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7c199506-78d4-4a8e-ac33-34a481f1edda tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.125618 Jan 11 15:14:40.218655 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 324/656] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:40 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:14:40.710345 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-25269e20-e57c-43ff-b53d-aff46f4aea3c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:40.711038 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-25269e20-e57c-43ff-b53d-aff46f4aea3c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 1d506318-9988-434f-b8d6-bf11cbdef7b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:40.718225 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-25269e20-e57c-43ff-b53d-aff46f4aea3c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:40.721158 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-25269e20-e57c-43ff-b53d-aff46f4aea3c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:40.721158 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-25269e20-e57c-43ff-b53d-aff46f4aea3c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:40.721158 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-25269e20-e57c-43ff-b53d-aff46f4aea3c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:40.828628 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8dbb2853-86fb-4296-9394-63a51f2b2580 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:40.830026 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8dbb2853-86fb-4296-9394-63a51f2b2580 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:40.838337 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8dbb2853-86fb-4296-9394-63a51f2b2580 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:40.839105 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8dbb2853-86fb-4296-9394-63a51f2b2580 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:40.841452 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8dbb2853-86fb-4296-9394-63a51f2b2580 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:40.841452 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8dbb2853-86fb-4296-9394-63a51f2b2580 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:40.899077 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-25269e20-e57c-43ff-b53d-aff46f4aea3c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:40.909687 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-25269e20-e57c-43ff-b53d-aff46f4aea3c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4" status: 200 len: 1513 microversion: 2.1 time: 0.203079 Jan 11 15:14:40.913065 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 333/657] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:40 2022] GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4 => generated 1513 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:40.996997 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-8dbb2853-86fb-4296-9394-63a51f2b2580 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:41.005749 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8dbb2853-86fb-4296-9394-63a51f2b2580 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1548 microversion: 2.1 time: 0.186819 Jan 11 15:14:41.006319 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 325/658] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:40 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1548 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:14:41.022975 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d5d7dd8a-c2ac-4b5d-bfa4-509c50767d27 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:41.024010 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d5d7dd8a-c2ac-4b5d-bfa4-509c50767d27 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:41.031281 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d5d7dd8a-c2ac-4b5d-bfa4-509c50767d27 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:41.032033 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d5d7dd8a-c2ac-4b5d-bfa4-509c50767d27 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:41.033061 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d5d7dd8a-c2ac-4b5d-bfa4-509c50767d27 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:41.033705 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d5d7dd8a-c2ac-4b5d-bfa4-509c50767d27 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:41.061568 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-24f0743e-8fb4-4582-9705-d575856f2e5b tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:41.062866 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-24f0743e-8fb4-4582-9705-d575856f2e5b tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:41.073704 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-24f0743e-8fb4-4582-9705-d575856f2e5b tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:41.074400 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-24f0743e-8fb4-4582-9705-d575856f2e5b tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:41.075435 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-24f0743e-8fb4-4582-9705-d575856f2e5b tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:41.076002 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-24f0743e-8fb4-4582-9705-d575856f2e5b tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:41.128163 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.wsgi [None req-d5d7dd8a-c2ac-4b5d-bfa4-509c50767d27 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] HTTP exception thrown: Cannot 'detach_volume' instance 3b978091-0bf4-4e69-8053-76e49154df4c while it is in vm_state rescued Jan 11 15:14:41.128753 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d5d7dd8a-c2ac-4b5d-bfa4-509c50767d27 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Returning 409 to user: Cannot 'detach_volume' instance 3b978091-0bf4-4e69-8053-76e49154df4c while it is in vm_state rescued {{(pid=116903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:14:41.129586 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d5d7dd8a-c2ac-4b5d-bfa4-509c50767d27 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments/610c960d-8a64-4ee2-85d2-5ae3bb879fee" status: 409 len: 152 microversion: 2.1 time: 0.111054 Jan 11 15:14:41.130125 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 334/659] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jan 11 15:14:41 2022] DELETE /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments/610c960d-8a64-4ee2-85d2-5ae3bb879fee => generated 152 bytes in 112 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 11 15:14:41.138071 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-0f773e85-8ff7-4990-a6eb-5168153adf66 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:41.138659 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-0f773e85-8ff7-4990-a6eb-5168153adf66 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:41.144443 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0f773e85-8ff7-4990-a6eb-5168153adf66 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:41.144902 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0f773e85-8ff7-4990-a6eb-5168153adf66 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:41.145771 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0f773e85-8ff7-4990-a6eb-5168153adf66 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:41.146187 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0f773e85-8ff7-4990-a6eb-5168153adf66 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:41.153984 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-24f0743e-8fb4-4582-9705-d575856f2e5b tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.097267 Jan 11 15:14:41.155047 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 326/660] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:41 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:14:41.226591 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8bf9b21b-13f2-4c15-a70b-42075ad9d6f5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:41.228177 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8bf9b21b-13f2-4c15-a70b-42075ad9d6f5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:41.234997 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8bf9b21b-13f2-4c15-a70b-42075ad9d6f5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:41.235482 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8bf9b21b-13f2-4c15-a70b-42075ad9d6f5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:41.236265 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8bf9b21b-13f2-4c15-a70b-42075ad9d6f5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:41.236706 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8bf9b21b-13f2-4c15-a70b-42075ad9d6f5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:41.317266 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8bf9b21b-13f2-4c15-a70b-42075ad9d6f5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.094412 Jan 11 15:14:41.317945 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 327/661] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:41 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:14:41.436507 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-0f773e85-8ff7-4990-a6eb-5168153adf66 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "POST /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/action" status: 202 len: 0 microversion: 2.1 time: 0.301750 Jan 11 15:14:41.437376 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 335/662] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:41 2022] POST /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:14:41.446905 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f392b8d3-e7fc-4e3f-bb69-e337d97dc079 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:41.448295 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f392b8d3-e7fc-4e3f-bb69-e337d97dc079 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:41.458260 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f392b8d3-e7fc-4e3f-bb69-e337d97dc079 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:41.459135 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f392b8d3-e7fc-4e3f-bb69-e337d97dc079 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:41.460230 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [req-9056c1d6-2cf9-4d5c-96d2-9e6e1ac57597 req-b3b7019d-be0e-45a5-8ca5-82cb6de0a925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d506318-9988-434f-b8d6-bf11cbdef7b4", "name": "network-vif-deleted", "tag": "981e1962-a1ba-49a2-9065-b74c48bb46ba"}]} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:41.460757 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f392b8d3-e7fc-4e3f-bb69-e337d97dc079 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:41.461469 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f392b8d3-e7fc-4e3f-bb69-e337d97dc079 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:41.462027 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:14:41.462027 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: warnings.warn(msg) Jan 11 15:14:41.471397 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-9056c1d6-2cf9-4d5c-96d2-9e6e1ac57597 req-b3b7019d-be0e-45a5-8ca5-82cb6de0a925 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:41.471865 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-9056c1d6-2cf9-4d5c-96d2-9e6e1ac57597 req-b3b7019d-be0e-45a5-8ca5-82cb6de0a925 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:41.484226 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.compute.server_external_events [req-9056c1d6-2cf9-4d5c-96d2-9e6e1ac57597 req-b3b7019d-be0e-45a5-8ca5-82cb6de0a925 service nova] Creating event network-vif-deleted:981e1962-a1ba-49a2-9065-b74c48bb46ba for instance 1d506318-9988-434f-b8d6-bf11cbdef7b4 on hv-cinder-82418 Jan 11 15:14:41.489274 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [req-9056c1d6-2cf9-4d5c-96d2-9e6e1ac57597 req-b3b7019d-be0e-45a5-8ca5-82cb6de0a925 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033616 Jan 11 15:14:41.490359 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 336/663] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:14:41.630259 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-15d47d89-eb7d-4634-bf95-ba0fef35e81b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2102435396", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1509984335", "security_groups": [{"name": "tempest-secgroup-smoke-1051513398"}], "networks": [{"uuid": "92f12fef-9d97-467c-9053-7519d9a7115c"}], "block_device_mapping_v2": [{"uuid": "26dede4d-322d-430a-9539-6675af943646", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:41.637913 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f392b8d3-e7fc-4e3f-bb69-e337d97dc079 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:41.647930 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f392b8d3-e7fc-4e3f-bb69-e337d97dc079 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1556 microversion: 2.1 time: 0.205184 Jan 11 15:14:41.648711 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 328/664] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:41 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1556 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:41.799610 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.network.neutron [None req-15d47d89-eb7d-4634-bf95-ba0fef35e81b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] validate_networks() for [('92f12fef-9d97-467c-9053-7519d9a7115c', None, None, None, None, None)] {{(pid=116903) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 15:14:41.865542 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-162a158e-6f1b-4cfa-93ab-7bc19af35ab6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f79b82a3-79b6-4d9c-a42d-e8c32d182e55", "device": "/dev/sdb"}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:41.869017 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-162a158e-6f1b-4cfa-93ab-7bc19af35ab6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:41.883358 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-162a158e-6f1b-4cfa-93ab-7bc19af35ab6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:41.883776 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-162a158e-6f1b-4cfa-93ab-7bc19af35ab6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:41.884584 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-162a158e-6f1b-4cfa-93ab-7bc19af35ab6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:41.885020 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-162a158e-6f1b-4cfa-93ab-7bc19af35ab6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:42.316895 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-15d47d89-eb7d-4634-bf95-ba0fef35e81b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Flavor limits 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 15:14:42.317243 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-15d47d89-eb7d-4634-bf95-ba0fef35e81b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Image limits 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 15:14:42.317720 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-15d47d89-eb7d-4634-bf95-ba0fef35e81b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Flavor pref 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 15:14:42.318134 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-15d47d89-eb7d-4634-bf95-ba0fef35e81b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Image pref 0:0:0 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 15:14:42.318593 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.virt.hardware [None req-15d47d89-eb7d-4634-bf95-ba0fef35e81b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 15:14:42.329972 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-15d47d89-eb7d-4634-bf95-ba0fef35e81b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:42.330436 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-15d47d89-eb7d-4634-bf95-ba0fef35e81b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:42.331254 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-15d47d89-eb7d-4634-bf95-ba0fef35e81b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:42.331734 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-15d47d89-eb7d-4634-bf95-ba0fef35e81b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:42.349083 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.quota [None req-15d47d89-eb7d-4634-bf95-ba0fef35e81b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Getting quotas for project 650f188bc41c4e3287333c86a814f108. Resources: {'instances', 'cores', 'ram'} {{(pid=116903) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 15:14:42.353052 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.quota [None req-15d47d89-eb7d-4634-bf95-ba0fef35e81b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Getting quotas for user 7306e551d8234142977681a0d803a21a and project 650f188bc41c4e3287333c86a814f108. Resources: {'instances', 'cores', 'ram'} {{(pid=116903) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 15:14:42.407508 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-15d47d89-eb7d-4634-bf95-ba0fef35e81b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Going to run 1 instances... {{(pid=116903) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 15:14:42.409758 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-15d47d89-eb7d-4634-bf95-ba0fef35e81b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='26dede4d-322d-430a-9539-6675af943646',volume_size=None,volume_type=None)] {{(pid=116903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 15:14:42.784822 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-162a158e-6f1b-4cfa-93ab-7bc19af35ab6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "POST /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.923594 Jan 11 15:14:42.790076 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 329/665] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jan 11 15:14:41 2022] POST /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6/os-volume_attachments => generated 194 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:14:42.802408 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-021a62f2-cb9f-4a20-b1de-f319ac3812cd tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:42.803202 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-021a62f2-cb9f-4a20-b1de-f319ac3812cd tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 1d506318-9988-434f-b8d6-bf11cbdef7b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:42.815767 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-021a62f2-cb9f-4a20-b1de-f319ac3812cd tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:42.816264 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-021a62f2-cb9f-4a20-b1de-f319ac3812cd tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:42.817136 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-021a62f2-cb9f-4a20-b1de-f319ac3812cd tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:42.817529 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-021a62f2-cb9f-4a20-b1de-f319ac3812cd tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:42.890948 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-021a62f2-cb9f-4a20-b1de-f319ac3812cd tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:42.891505 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-021a62f2-cb9f-4a20-b1de-f319ac3812cd tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:42.891959 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.objects.instance [None req-021a62f2-cb9f-4a20-b1de-f319ac3812cd tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lazy-loading 'fault' on Instance uuid 1d506318-9988-434f-b8d6-bf11cbdef7b4 {{(pid=116902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 15:14:42.937907 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-15d47d89-eb7d-4634-bf95-ba0fef35e81b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.312697 Jan 11 15:14:42.941648 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-021a62f2-cb9f-4a20-b1de-f319ac3812cd tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:42.943644 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 337/666] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jan 11 15:14:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 1323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 15:14:42.952339 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-021a62f2-cb9f-4a20-b1de-f319ac3812cd tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4" status: 200 len: 1307 microversion: 2.1 time: 0.160922 Jan 11 15:14:42.954023 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 330/667] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:42 2022] GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4 => generated 1307 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:42.958283 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-49a5c773-1493-4802-9564-2116b1f23dd8 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:42.959171 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-49a5c773-1493-4802-9564-2116b1f23dd8 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:42.965905 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-49a5c773-1493-4802-9564-2116b1f23dd8 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:42.966564 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-49a5c773-1493-4802-9564-2116b1f23dd8 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:42.968613 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-49a5c773-1493-4802-9564-2116b1f23dd8 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:42.969206 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-49a5c773-1493-4802-9564-2116b1f23dd8 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:42.975864 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d4d77c91-261a-4b0f-bee1-793f38e87612 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:42.995920 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d4d77c91-261a-4b0f-bee1-793f38e87612 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:43.012594 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d4d77c91-261a-4b0f-bee1-793f38e87612 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:43.015282 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d4d77c91-261a-4b0f-bee1-793f38e87612 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:43.015282 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d4d77c91-261a-4b0f-bee1-793f38e87612 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:43.015282 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d4d77c91-261a-4b0f-bee1-793f38e87612 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:43.077961 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-49a5c773-1493-4802-9564-2116b1f23dd8 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.122699 Jan 11 15:14:43.082495 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 331/668] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:42 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:14:43.088704 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c0490e1b-6d4d-46ef-b9b3-2a2513f48b71 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:43.089570 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c0490e1b-6d4d-46ef-b9b3-2a2513f48b71 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:43.094471 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d4d77c91-261a-4b0f-bee1-793f38e87612 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.149500 Jan 11 15:14:43.095469 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 338/669] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:42 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:14:43.102745 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c0490e1b-6d4d-46ef-b9b3-2a2513f48b71 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:43.103204 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c0490e1b-6d4d-46ef-b9b3-2a2513f48b71 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:43.104278 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c0490e1b-6d4d-46ef-b9b3-2a2513f48b71 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:43.105139 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c0490e1b-6d4d-46ef-b9b3-2a2513f48b71 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:43.105239 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-29cf22d1-331c-4f30-aff0-213fcae772df tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:43.105940 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-29cf22d1-331c-4f30-aff0-213fcae772df tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:43.167511 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-29cf22d1-331c-4f30-aff0-213fcae772df tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:43.174378 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-29cf22d1-331c-4f30-aff0-213fcae772df tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1089 microversion: 2.1 time: 0.077793 Jan 11 15:14:43.174933 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 339/670] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:43 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1089 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:43.279084 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c0490e1b-6d4d-46ef-b9b3-2a2513f48b71 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:43.287220 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c0490e1b-6d4d-46ef-b9b3-2a2513f48b71 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1556 microversion: 2.1 time: 0.203553 Jan 11 15:14:43.288037 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 332/671] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:43 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1556 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:43.969764 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-30405bc8-a5ba-475f-8aed-54e4502fb554 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:43.973293 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-30405bc8-a5ba-475f-8aed-54e4502fb554 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 1d506318-9988-434f-b8d6-bf11cbdef7b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:43.979465 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-30405bc8-a5ba-475f-8aed-54e4502fb554 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:43.979857 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-30405bc8-a5ba-475f-8aed-54e4502fb554 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:43.980649 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-30405bc8-a5ba-475f-8aed-54e4502fb554 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:43.981085 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-30405bc8-a5ba-475f-8aed-54e4502fb554 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:43.995002 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.wsgi [None req-30405bc8-a5ba-475f-8aed-54e4502fb554 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] HTTP exception thrown: Instance 1d506318-9988-434f-b8d6-bf11cbdef7b4 could not be found. Jan 11 15:14:43.995864 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-30405bc8-a5ba-475f-8aed-54e4502fb554 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Returning 404 to user: Instance 1d506318-9988-434f-b8d6-bf11cbdef7b4 could not be found. {{(pid=116903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:14:43.996872 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-30405bc8-a5ba-475f-8aed-54e4502fb554 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4" status: 404 len: 111 microversion: 2.1 time: 0.030792 Jan 11 15:14:43.997888 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 340/672] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:43 2022] GET /compute/v2.1/servers/1d506318-9988-434f-b8d6-bf11cbdef7b4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 15:14:44.090054 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-82befc56-c8e7-4d67-b0ca-bdf5f7919316 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:44.091024 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-82befc56-c8e7-4d67-b0ca-bdf5f7919316 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:44.097538 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-82befc56-c8e7-4d67-b0ca-bdf5f7919316 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:44.103121 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-82befc56-c8e7-4d67-b0ca-bdf5f7919316 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:44.103121 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-82befc56-c8e7-4d67-b0ca-bdf5f7919316 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:44.103121 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-82befc56-c8e7-4d67-b0ca-bdf5f7919316 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:44.106395 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-fb9b7a77-896a-410d-b027-ebf8f2286bd7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:44.107318 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-fb9b7a77-896a-410d-b027-ebf8f2286bd7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:44.113830 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fb9b7a77-896a-410d-b027-ebf8f2286bd7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:44.114317 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fb9b7a77-896a-410d-b027-ebf8f2286bd7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:44.115080 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fb9b7a77-896a-410d-b027-ebf8f2286bd7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:44.115545 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fb9b7a77-896a-410d-b027-ebf8f2286bd7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:44.176665 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-82befc56-c8e7-4d67-b0ca-bdf5f7919316 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.090459 Jan 11 15:14:44.177414 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 333/673] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:44 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:14:44.191678 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-10c81e7f-73de-42af-887d-7d60f35cad79 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:44.192297 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-10c81e7f-73de-42af-887d-7d60f35cad79 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:44.192944 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-fb9b7a77-896a-410d-b027-ebf8f2286bd7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.090621 Jan 11 15:14:44.197319 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 341/674] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:44 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:14:44.199211 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-10c81e7f-73de-42af-887d-7d60f35cad79 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:44.199837 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-10c81e7f-73de-42af-887d-7d60f35cad79 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:44.201007 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-10c81e7f-73de-42af-887d-7d60f35cad79 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:44.201707 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-10c81e7f-73de-42af-887d-7d60f35cad79 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:44.305970 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-5a852060-0a12-4a87-9780-340933612095 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:44.306821 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-5a852060-0a12-4a87-9780-340933612095 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:44.307219 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-10c81e7f-73de-42af-887d-7d60f35cad79 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:44.315616 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5a852060-0a12-4a87-9780-340933612095 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:44.318409 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5a852060-0a12-4a87-9780-340933612095 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:44.319341 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5a852060-0a12-4a87-9780-340933612095 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:44.319883 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5a852060-0a12-4a87-9780-340933612095 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:44.321439 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-10c81e7f-73de-42af-887d-7d60f35cad79 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1139 microversion: 2.1 time: 0.133585 Jan 11 15:14:44.327066 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 334/675] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:44 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1139 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:44.562944 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-5a852060-0a12-4a87-9780-340933612095 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:44.571468 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-5a852060-0a12-4a87-9780-340933612095 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1556 microversion: 2.1 time: 0.269333 Jan 11 15:14:44.572037 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 342/676] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:44 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1556 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:14:45.189632 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2e5df343-c22e-4b22-8a28-0635234c2810 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:45.191471 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2e5df343-c22e-4b22-8a28-0635234c2810 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:45.198247 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2e5df343-c22e-4b22-8a28-0635234c2810 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:45.199451 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2e5df343-c22e-4b22-8a28-0635234c2810 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:45.200456 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2e5df343-c22e-4b22-8a28-0635234c2810 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:45.201269 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2e5df343-c22e-4b22-8a28-0635234c2810 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:45.204980 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c290c6bd-7d0f-4db9-9945-a0bbfa6a6fca tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:45.205922 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c290c6bd-7d0f-4db9-9945-a0bbfa6a6fca tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:45.215337 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c290c6bd-7d0f-4db9-9945-a0bbfa6a6fca tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:45.215337 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c290c6bd-7d0f-4db9-9945-a0bbfa6a6fca tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:45.216117 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c290c6bd-7d0f-4db9-9945-a0bbfa6a6fca tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:45.216567 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c290c6bd-7d0f-4db9-9945-a0bbfa6a6fca tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:45.274883 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2e5df343-c22e-4b22-8a28-0635234c2810 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.088960 Jan 11 15:14:45.280471 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 335/677] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:45 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:14:45.312871 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d5577e5e-16a8-42ac-b109-9b4a92c4969c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:45.313448 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d5577e5e-16a8-42ac-b109-9b4a92c4969c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 5d8b8b19-117d-4669-933b-5f86257caff6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:45.321836 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d5577e5e-16a8-42ac-b109-9b4a92c4969c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:45.322296 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d5577e5e-16a8-42ac-b109-9b4a92c4969c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:45.323091 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d5577e5e-16a8-42ac-b109-9b4a92c4969c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:45.323563 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d5577e5e-16a8-42ac-b109-9b4a92c4969c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:45.352318 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d5577e5e-16a8-42ac-b109-9b4a92c4969c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 5d8b8b19-117d-4669-933b-5f86257caff6] Going to try to terminate instance {{(pid=116902) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 15:14:45.403657 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c290c6bd-7d0f-4db9-9945-a0bbfa6a6fca tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.195995 Jan 11 15:14:45.403657 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 343/678] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:45 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:14:45.404241 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-9c92b9ea-e5b1-425a-b345-9fb913071f11 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:45.405641 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-9c92b9ea-e5b1-425a-b345-9fb913071f11 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:45.412995 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9c92b9ea-e5b1-425a-b345-9fb913071f11 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:45.413456 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9c92b9ea-e5b1-425a-b345-9fb913071f11 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:45.414260 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9c92b9ea-e5b1-425a-b345-9fb913071f11 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:45.414734 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9c92b9ea-e5b1-425a-b345-9fb913071f11 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:45.515493 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-9c92b9ea-e5b1-425a-b345-9fb913071f11 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:45.523179 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-9c92b9ea-e5b1-425a-b345-9fb913071f11 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1205 microversion: 2.1 time: 0.124316 Jan 11 15:14:45.524332 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 344/679] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:45 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1205 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:45.589372 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ec7b3aa0-1d90-4147-ae58-45772d53d9fa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:45.589956 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-ec7b3aa0-1d90-4147-ae58-45772d53d9fa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:45.596148 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ec7b3aa0-1d90-4147-ae58-45772d53d9fa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:45.596600 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ec7b3aa0-1d90-4147-ae58-45772d53d9fa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:45.597378 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ec7b3aa0-1d90-4147-ae58-45772d53d9fa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:45.597816 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ec7b3aa0-1d90-4147-ae58-45772d53d9fa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:45.724971 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d5577e5e-16a8-42ac-b109-9b4a92c4969c tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6" status: 204 len: 0 microversion: 2.1 time: 0.415706 Jan 11 15:14:45.725909 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 336/680] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jan 11 15:14:45 2022] DELETE /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 11 15:14:45.734039 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-77b329c3-258a-4f9b-980e-f0ca4c98d7f8 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:45.735178 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-77b329c3-258a-4f9b-980e-f0ca4c98d7f8 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 5d8b8b19-117d-4669-933b-5f86257caff6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:45.747685 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-77b329c3-258a-4f9b-980e-f0ca4c98d7f8 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:45.748201 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-77b329c3-258a-4f9b-980e-f0ca4c98d7f8 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:45.749585 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-ec7b3aa0-1d90-4147-ae58-45772d53d9fa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:45.750618 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-77b329c3-258a-4f9b-980e-f0ca4c98d7f8 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:45.751495 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-77b329c3-258a-4f9b-980e-f0ca4c98d7f8 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:45.757547 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-ec7b3aa0-1d90-4147-ae58-45772d53d9fa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1556 microversion: 2.1 time: 0.172708 Jan 11 15:14:45.760059 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 345/681] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:45 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1556 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:14:45.933235 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-77b329c3-258a-4f9b-980e-f0ca4c98d7f8 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:45.934940 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-77b329c3-258a-4f9b-980e-f0ca4c98d7f8 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6" status: 200 len: 1514 microversion: 2.1 time: 0.202759 Jan 11 15:14:45.936146 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 337/682] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:45 2022] GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6 => generated 1514 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:14:46.288734 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-52af9e2d-329b-4d8b-9548-84e1ed065b15 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:46.294371 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-52af9e2d-329b-4d8b-9548-84e1ed065b15 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:46.307625 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-52af9e2d-329b-4d8b-9548-84e1ed065b15 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:46.311760 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-52af9e2d-329b-4d8b-9548-84e1ed065b15 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:46.312915 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-52af9e2d-329b-4d8b-9548-84e1ed065b15 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:46.313970 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-52af9e2d-329b-4d8b-9548-84e1ed065b15 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:46.404817 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-52af9e2d-329b-4d8b-9548-84e1ed065b15 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.120422 Jan 11 15:14:46.409508 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 346/683] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:46 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:14:46.410386 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d94fe2a6-8693-4438-bf6b-ac0fa40aa8e7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:46.411483 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d94fe2a6-8693-4438-bf6b-ac0fa40aa8e7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:46.423684 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d94fe2a6-8693-4438-bf6b-ac0fa40aa8e7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:46.426664 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d94fe2a6-8693-4438-bf6b-ac0fa40aa8e7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:46.427566 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d94fe2a6-8693-4438-bf6b-ac0fa40aa8e7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:46.428026 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d94fe2a6-8693-4438-bf6b-ac0fa40aa8e7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:46.499199 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d94fe2a6-8693-4438-bf6b-ac0fa40aa8e7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.092204 Jan 11 15:14:46.499829 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 338/684] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:46 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:14:46.541450 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a7e7769c-b4b8-477a-9825-331989bb8882 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:46.551136 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a7e7769c-b4b8-477a-9825-331989bb8882 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:46.551136 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a7e7769c-b4b8-477a-9825-331989bb8882 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:46.551136 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a7e7769c-b4b8-477a-9825-331989bb8882 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:46.551846 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a7e7769c-b4b8-477a-9825-331989bb8882 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:46.552281 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a7e7769c-b4b8-477a-9825-331989bb8882 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:46.723565 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-a7e7769c-b4b8-477a-9825-331989bb8882 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:46.731688 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a7e7769c-b4b8-477a-9825-331989bb8882 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1273 microversion: 2.1 time: 0.194733 Jan 11 15:14:46.732536 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 347/685] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:46 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1273 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:46.780390 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7bdb607d-b50a-451d-b63c-d5a281ebc4b7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:46.781250 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-7bdb607d-b50a-451d-b63c-d5a281ebc4b7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:46.793149 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7bdb607d-b50a-451d-b63c-d5a281ebc4b7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:46.793681 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7bdb607d-b50a-451d-b63c-d5a281ebc4b7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:46.796421 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7bdb607d-b50a-451d-b63c-d5a281ebc4b7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:46.796942 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7bdb607d-b50a-451d-b63c-d5a281ebc4b7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:46.952527 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-cf7c29df-4a41-4eff-8169-d53d06f992d9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:46.953133 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-cf7c29df-4a41-4eff-8169-d53d06f992d9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 5d8b8b19-117d-4669-933b-5f86257caff6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:46.963952 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cf7c29df-4a41-4eff-8169-d53d06f992d9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:46.964650 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cf7c29df-4a41-4eff-8169-d53d06f992d9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:46.965627 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cf7c29df-4a41-4eff-8169-d53d06f992d9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:46.966355 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cf7c29df-4a41-4eff-8169-d53d06f992d9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:47.017256 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-7bdb607d-b50a-451d-b63c-d5a281ebc4b7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:47.028426 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7bdb607d-b50a-451d-b63c-d5a281ebc4b7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1562 microversion: 2.1 time: 0.252229 Jan 11 15:14:47.029016 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 339/686] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:46 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1562 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:47.133514 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-cf7c29df-4a41-4eff-8169-d53d06f992d9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:47.141470 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-cf7c29df-4a41-4eff-8169-d53d06f992d9 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6" status: 200 len: 1514 microversion: 2.1 time: 0.192774 Jan 11 15:14:47.142700 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 348/687] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:46 2022] GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6 => generated 1514 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:47.154792 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-c95fd789-f89c-4234-91b5-d629b05fb43f req-10b349c9-8403-46a0-bbfe-4ff41a223a89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "347a0a52-47fa-4799-97ca-551bc356aca0", "tag": "8250fb01-566c-404c-940f-8347fdacb6b4"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:47.156566 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:14:47.156566 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:14:47.164049 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-c95fd789-f89c-4234-91b5-d629b05fb43f req-10b349c9-8403-46a0-bbfe-4ff41a223a89 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:47.165077 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-c95fd789-f89c-4234-91b5-d629b05fb43f req-10b349c9-8403-46a0-bbfe-4ff41a223a89 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:47.180520 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-c95fd789-f89c-4234-91b5-d629b05fb43f req-10b349c9-8403-46a0-bbfe-4ff41a223a89 service nova] Creating event network-changed:8250fb01-566c-404c-940f-8347fdacb6b4 for instance 347a0a52-47fa-4799-97ca-551bc356aca0 on hv-cinder-82418 Jan 11 15:14:47.181393 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [req-c95fd789-f89c-4234-91b5-d629b05fb43f req-10b349c9-8403-46a0-bbfe-4ff41a223a89 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033359 Jan 11 15:14:47.182003 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 340/688] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:14:47.417315 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-00006bb9-7c58-448e-9733-0a82f55481b7 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:47.418211 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-00006bb9-7c58-448e-9733-0a82f55481b7 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:47.424883 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-00006bb9-7c58-448e-9733-0a82f55481b7 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:47.425341 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-00006bb9-7c58-448e-9733-0a82f55481b7 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:47.426118 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-00006bb9-7c58-448e-9733-0a82f55481b7 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:47.428078 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-00006bb9-7c58-448e-9733-0a82f55481b7 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:47.496780 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-00006bb9-7c58-448e-9733-0a82f55481b7 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.083969 Jan 11 15:14:47.501821 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 349/689] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:47 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:14:47.517863 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-178e1d22-8fe5-4f8d-98b4-27ef54979567 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:47.518931 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-178e1d22-8fe5-4f8d-98b4-27ef54979567 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:47.533797 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-34e5fd47-f019-41f2-9562-1e921a10773d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:47.534423 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-178e1d22-8fe5-4f8d-98b4-27ef54979567 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:47.534955 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-178e1d22-8fe5-4f8d-98b4-27ef54979567 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:47.535841 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-34e5fd47-f019-41f2-9562-1e921a10773d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:47.536554 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-178e1d22-8fe5-4f8d-98b4-27ef54979567 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:47.538416 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-178e1d22-8fe5-4f8d-98b4-27ef54979567 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:47.548116 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-34e5fd47-f019-41f2-9562-1e921a10773d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:47.548584 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-34e5fd47-f019-41f2-9562-1e921a10773d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:47.549377 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-34e5fd47-f019-41f2-9562-1e921a10773d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:47.560607 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-34e5fd47-f019-41f2-9562-1e921a10773d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:47.692038 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.objects.instance [None req-34e5fd47-f019-41f2-9562-1e921a10773d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lazy-loading 'services' on Instance uuid 3b978091-0bf4-4e69-8053-76e49154df4c {{(pid=116903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 15:14:47.720022 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-178e1d22-8fe5-4f8d-98b4-27ef54979567 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.212206 Jan 11 15:14:47.720848 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 341/690] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:47 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:14:47.749088 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8a9a3143-288f-42a1-91df-4eec50e78905 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:47.749841 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8a9a3143-288f-42a1-91df-4eec50e78905 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:47.756828 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8a9a3143-288f-42a1-91df-4eec50e78905 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:47.757302 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8a9a3143-288f-42a1-91df-4eec50e78905 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:47.758592 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8a9a3143-288f-42a1-91df-4eec50e78905 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:47.759194 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8a9a3143-288f-42a1-91df-4eec50e78905 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:47.970530 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-8a9a3143-288f-42a1-91df-4eec50e78905 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:47.980128 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-34e5fd47-f019-41f2-9562-1e921a10773d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments/610c960d-8a64-4ee2-85d2-5ae3bb879fee" status: 202 len: 0 microversion: 2.1 time: 0.456449 Jan 11 15:14:47.981216 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 350/691] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jan 11 15:14:47 2022] DELETE /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments/610c960d-8a64-4ee2-85d2-5ae3bb879fee => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:14:48.007255 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c84ccedb-32ec-41b9-8369-ddc08815f9ca tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:48.009411 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8a9a3143-288f-42a1-91df-4eec50e78905 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1273 microversion: 2.1 time: 0.264408 Jan 11 15:14:48.010471 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c84ccedb-32ec-41b9-8369-ddc08815f9ca tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:48.012382 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 342/692] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:47 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1273 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:48.017672 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c84ccedb-32ec-41b9-8369-ddc08815f9ca tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:48.018380 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c84ccedb-32ec-41b9-8369-ddc08815f9ca tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:48.019271 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c84ccedb-32ec-41b9-8369-ddc08815f9ca tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:48.019928 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c84ccedb-32ec-41b9-8369-ddc08815f9ca tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:48.049624 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c84ccedb-32ec-41b9-8369-ddc08815f9ca tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062922 Jan 11 15:14:48.050214 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 351/693] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:14:47 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:14:48.157620 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-15ee819e-b804-45a7-8d1a-dd96cbafd0eb tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:48.158671 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-15ee819e-b804-45a7-8d1a-dd96cbafd0eb tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 5d8b8b19-117d-4669-933b-5f86257caff6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:48.165170 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-15ee819e-b804-45a7-8d1a-dd96cbafd0eb tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:48.165624 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-15ee819e-b804-45a7-8d1a-dd96cbafd0eb tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:48.166511 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-15ee819e-b804-45a7-8d1a-dd96cbafd0eb tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:48.166960 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-15ee819e-b804-45a7-8d1a-dd96cbafd0eb tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:48.339010 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-15ee819e-b804-45a7-8d1a-dd96cbafd0eb tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:48.346220 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-15ee819e-b804-45a7-8d1a-dd96cbafd0eb tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6" status: 200 len: 1514 microversion: 2.1 time: 0.192244 Jan 11 15:14:48.346775 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 343/694] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:48 2022] GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6 => generated 1514 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:48.483540 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [req-68b472f8-ddb9-45e1-abaf-be33167a4b06 req-11f9e277-7782-4c2d-a5f7-797dd8fc2ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d8b8b19-117d-4669-933b-5f86257caff6", "name": "network-vif-deleted", "tag": "3ca6f955-8c4f-4a77-b65d-c28221580f8e"}]} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:48.485130 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:14:48.485130 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: warnings.warn(msg) Jan 11 15:14:48.493034 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-68b472f8-ddb9-45e1-abaf-be33167a4b06 req-11f9e277-7782-4c2d-a5f7-797dd8fc2ef9 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:48.493576 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-68b472f8-ddb9-45e1-abaf-be33167a4b06 req-11f9e277-7782-4c2d-a5f7-797dd8fc2ef9 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:48.506015 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.compute.server_external_events [req-68b472f8-ddb9-45e1-abaf-be33167a4b06 req-11f9e277-7782-4c2d-a5f7-797dd8fc2ef9 service nova] Creating event network-vif-deleted:3ca6f955-8c4f-4a77-b65d-c28221580f8e for instance 5d8b8b19-117d-4669-933b-5f86257caff6 on hv-cinder-82418 Jan 11 15:14:48.509176 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-90f3c0e2-2817-4aed-a187-6732c26849e2 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:48.510356 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-90f3c0e2-2817-4aed-a187-6732c26849e2 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:48.511278 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [req-68b472f8-ddb9-45e1-abaf-be33167a4b06 req-11f9e277-7782-4c2d-a5f7-797dd8fc2ef9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031308 Jan 11 15:14:48.513467 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 352/695] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:14:48.518516 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-90f3c0e2-2817-4aed-a187-6732c26849e2 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:48.519042 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-90f3c0e2-2817-4aed-a187-6732c26849e2 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:48.527934 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-90f3c0e2-2817-4aed-a187-6732c26849e2 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:48.528557 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-90f3c0e2-2817-4aed-a187-6732c26849e2 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:48.603311 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-90f3c0e2-2817-4aed-a187-6732c26849e2 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.097968 Jan 11 15:14:48.608545 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 344/696] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:48 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:14:48.740611 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-206348cf-3887-48e2-a899-89679c24636f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:48.740611 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-206348cf-3887-48e2-a899-89679c24636f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:48.740611 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-206348cf-3887-48e2-a899-89679c24636f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:48.741111 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-206348cf-3887-48e2-a899-89679c24636f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:48.741947 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-206348cf-3887-48e2-a899-89679c24636f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:48.742495 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-206348cf-3887-48e2-a899-89679c24636f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:48.827147 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-206348cf-3887-48e2-a899-89679c24636f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.097634 Jan 11 15:14:48.827834 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 353/697] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:48 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:14:49.028625 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-be1fdb72-1778-4eca-bfd3-1d67db238a77 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:49.029328 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-be1fdb72-1778-4eca-bfd3-1d67db238a77 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:49.035905 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-be1fdb72-1778-4eca-bfd3-1d67db238a77 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:49.036366 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-be1fdb72-1778-4eca-bfd3-1d67db238a77 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:49.037143 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-be1fdb72-1778-4eca-bfd3-1d67db238a77 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:49.037585 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-be1fdb72-1778-4eca-bfd3-1d67db238a77 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:49.061718 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3da787c7-ad5f-4e08-8333-ffc432b00436 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:49.062715 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3da787c7-ad5f-4e08-8333-ffc432b00436 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:49.069606 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3da787c7-ad5f-4e08-8333-ffc432b00436 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:49.070095 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3da787c7-ad5f-4e08-8333-ffc432b00436 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:49.071347 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3da787c7-ad5f-4e08-8333-ffc432b00436 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:49.071789 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3da787c7-ad5f-4e08-8333-ffc432b00436 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:49.102575 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3da787c7-ad5f-4e08-8333-ffc432b00436 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044360 Jan 11 15:14:49.103140 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 354/698] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:14:49 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:14:49.170860 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-be1fdb72-1778-4eca-bfd3-1d67db238a77 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:49.178393 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-be1fdb72-1778-4eca-bfd3-1d67db238a77 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1273 microversion: 2.1 time: 0.154297 Jan 11 15:14:49.178981 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 345/699] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:49 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1273 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:49.362689 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-8fe91b3c-5cb5-4205-a140-ef8018f34bcf tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:49.363347 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-8fe91b3c-5cb5-4205-a140-ef8018f34bcf tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 5d8b8b19-117d-4669-933b-5f86257caff6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:49.370132 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8fe91b3c-5cb5-4205-a140-ef8018f34bcf tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:49.370579 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8fe91b3c-5cb5-4205-a140-ef8018f34bcf tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:49.371366 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8fe91b3c-5cb5-4205-a140-ef8018f34bcf tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:49.371939 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8fe91b3c-5cb5-4205-a140-ef8018f34bcf tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:49.402028 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8fe91b3c-5cb5-4205-a140-ef8018f34bcf tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:49.402471 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8fe91b3c-5cb5-4205-a140-ef8018f34bcf tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:49.402911 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.objects.instance [None req-8fe91b3c-5cb5-4205-a140-ef8018f34bcf tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lazy-loading 'fault' on Instance uuid 5d8b8b19-117d-4669-933b-5f86257caff6 {{(pid=116903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 15:14:49.442496 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-8fe91b3c-5cb5-4205-a140-ef8018f34bcf tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:49.449828 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-8fe91b3c-5cb5-4205-a140-ef8018f34bcf tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6" status: 200 len: 1308 microversion: 2.1 time: 0.090750 Jan 11 15:14:49.450384 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 355/700] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:49 2022] GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6 => generated 1308 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:49.614736 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-cd6d732c-5b2d-42a9-bf16-e52ccf98c150 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:49.615693 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-cd6d732c-5b2d-42a9-bf16-e52ccf98c150 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:49.622609 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cd6d732c-5b2d-42a9-bf16-e52ccf98c150 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:49.623063 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cd6d732c-5b2d-42a9-bf16-e52ccf98c150 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:49.624002 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cd6d732c-5b2d-42a9-bf16-e52ccf98c150 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:49.624441 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cd6d732c-5b2d-42a9-bf16-e52ccf98c150 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:49.693190 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-cd6d732c-5b2d-42a9-bf16-e52ccf98c150 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.082162 Jan 11 15:14:49.694571 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 346/701] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:49 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:14:49.838120 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-44918bf3-0d42-4adb-8905-f2116099b6bc tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:49.839027 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-44918bf3-0d42-4adb-8905-f2116099b6bc tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:49.845242 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-44918bf3-0d42-4adb-8905-f2116099b6bc tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:49.845691 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-44918bf3-0d42-4adb-8905-f2116099b6bc tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:49.846462 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-44918bf3-0d42-4adb-8905-f2116099b6bc tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:49.846958 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-44918bf3-0d42-4adb-8905-f2116099b6bc tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:49.917470 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-44918bf3-0d42-4adb-8905-f2116099b6bc tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.083130 Jan 11 15:14:49.921515 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 356/702] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:49 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:14:50.114351 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-63f16ff1-1146-4516-bbae-17019d7a37ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:50.115403 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-63f16ff1-1146-4516-bbae-17019d7a37ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:50.122491 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-63f16ff1-1146-4516-bbae-17019d7a37ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:50.122960 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-63f16ff1-1146-4516-bbae-17019d7a37ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:50.123778 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-63f16ff1-1146-4516-bbae-17019d7a37ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:50.124228 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-63f16ff1-1146-4516-bbae-17019d7a37ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:50.160869 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-63f16ff1-1146-4516-bbae-17019d7a37ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050404 Jan 11 15:14:50.161354 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 347/703] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:14:50 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:14:50.195888 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-807b8091-e63e-4342-97c9-d9ca7b7d114e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:50.196694 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-807b8091-e63e-4342-97c9-d9ca7b7d114e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:50.203651 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-807b8091-e63e-4342-97c9-d9ca7b7d114e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:50.204103 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-807b8091-e63e-4342-97c9-d9ca7b7d114e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:50.204882 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-807b8091-e63e-4342-97c9-d9ca7b7d114e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:50.205324 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-807b8091-e63e-4342-97c9-d9ca7b7d114e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:50.344092 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-807b8091-e63e-4342-97c9-d9ca7b7d114e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:50.351722 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-807b8091-e63e-4342-97c9-d9ca7b7d114e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1273 microversion: 2.1 time: 0.159914 Jan 11 15:14:50.352293 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 357/704] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:50 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1273 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:50.473767 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-fc0614b2-a177-4fdf-b75b-e4a62ea529e3 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:50.474834 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-fc0614b2-a177-4fdf-b75b-e4a62ea529e3 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 5d8b8b19-117d-4669-933b-5f86257caff6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:50.485895 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fc0614b2-a177-4fdf-b75b-e4a62ea529e3 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:50.486639 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fc0614b2-a177-4fdf-b75b-e4a62ea529e3 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:50.488130 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fc0614b2-a177-4fdf-b75b-e4a62ea529e3 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:50.488689 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fc0614b2-a177-4fdf-b75b-e4a62ea529e3 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:50.504801 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.wsgi [None req-fc0614b2-a177-4fdf-b75b-e4a62ea529e3 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] HTTP exception thrown: Instance 5d8b8b19-117d-4669-933b-5f86257caff6 could not be found. Jan 11 15:14:50.505455 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-fc0614b2-a177-4fdf-b75b-e4a62ea529e3 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Returning 404 to user: Instance 5d8b8b19-117d-4669-933b-5f86257caff6 could not be found. {{(pid=116902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:14:50.506284 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-fc0614b2-a177-4fdf-b75b-e4a62ea529e3 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6" status: 404 len: 111 microversion: 2.1 time: 0.039791 Jan 11 15:14:50.506823 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 348/705] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:50 2022] GET /compute/v2.1/servers/5d8b8b19-117d-4669-933b-5f86257caff6 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 15:14:50.515534 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f641632b-6b4c-477e-8732-b23f6a120846 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:50.516031 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f641632b-6b4c-477e-8732-b23f6a120846 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 32a717c2-da7f-4685-813a-20f4149ce104] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:50.523272 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f641632b-6b4c-477e-8732-b23f6a120846 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:50.524554 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f641632b-6b4c-477e-8732-b23f6a120846 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:50.525354 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f641632b-6b4c-477e-8732-b23f6a120846 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:50.525812 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f641632b-6b4c-477e-8732-b23f6a120846 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:50.551651 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f641632b-6b4c-477e-8732-b23f6a120846 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 32a717c2-da7f-4685-813a-20f4149ce104] Going to try to terminate instance {{(pid=116903) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 15:14:50.706057 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-779b4f73-12e3-4acf-820d-c44bd09fa7a6 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:50.707649 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-779b4f73-12e3-4acf-820d-c44bd09fa7a6 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:50.715418 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-779b4f73-12e3-4acf-820d-c44bd09fa7a6 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:50.715874 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-779b4f73-12e3-4acf-820d-c44bd09fa7a6 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:50.716661 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-779b4f73-12e3-4acf-820d-c44bd09fa7a6 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:50.717117 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-779b4f73-12e3-4acf-820d-c44bd09fa7a6 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:50.777152 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-779b4f73-12e3-4acf-820d-c44bd09fa7a6 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.074873 Jan 11 15:14:50.777797 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 349/706] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:50 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:14:50.871515 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f641632b-6b4c-477e-8732-b23f6a120846 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "DELETE /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104" status: 204 len: 0 microversion: 2.1 time: 0.359434 Jan 11 15:14:50.873521 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 358/707] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jan 11 15:14:50 2022] DELETE /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 15:14:50.881404 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ed4feb0a-6246-44cf-880b-9440fd764b76 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:50.882105 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ed4feb0a-6246-44cf-880b-9440fd764b76 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 32a717c2-da7f-4685-813a-20f4149ce104] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:50.889679 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ed4feb0a-6246-44cf-880b-9440fd764b76 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:50.890198 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ed4feb0a-6246-44cf-880b-9440fd764b76 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:50.890922 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ed4feb0a-6246-44cf-880b-9440fd764b76 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:50.892000 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ed4feb0a-6246-44cf-880b-9440fd764b76 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:50.932225 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e4d4d433-c859-4a6a-99de-3429b49fd9a9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:50.933453 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e4d4d433-c859-4a6a-99de-3429b49fd9a9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:50.939654 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e4d4d433-c859-4a6a-99de-3429b49fd9a9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:50.940107 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e4d4d433-c859-4a6a-99de-3429b49fd9a9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:50.940894 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e4d4d433-c859-4a6a-99de-3429b49fd9a9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:50.941386 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e4d4d433-c859-4a6a-99de-3429b49fd9a9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:51.030324 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e4d4d433-c859-4a6a-99de-3429b49fd9a9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.104111 Jan 11 15:14:51.031807 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 359/708] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:50 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:14:51.084799 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ed4feb0a-6246-44cf-880b-9440fd764b76 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:51.092994 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ed4feb0a-6246-44cf-880b-9440fd764b76 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104" status: 200 len: 1513 microversion: 2.1 time: 0.216413 Jan 11 15:14:51.093609 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 350/709] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:50 2022] GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104 => generated 1513 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:51.176687 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-eb169ad5-beb0-4eeb-9b1e-5d406744b4bd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:51.176687 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-eb169ad5-beb0-4eeb-9b1e-5d406744b4bd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:51.185577 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-eb169ad5-beb0-4eeb-9b1e-5d406744b4bd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:51.186165 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-eb169ad5-beb0-4eeb-9b1e-5d406744b4bd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:51.187882 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-eb169ad5-beb0-4eeb-9b1e-5d406744b4bd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:51.188682 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-eb169ad5-beb0-4eeb-9b1e-5d406744b4bd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:51.223222 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-eb169ad5-beb0-4eeb-9b1e-5d406744b4bd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054271 Jan 11 15:14:51.224417 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 360/710] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:14:51 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:14:51.369979 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e12a22f1-0556-40f0-842f-5ea2019822f9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:51.370519 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e12a22f1-0556-40f0-842f-5ea2019822f9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:51.376984 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e12a22f1-0556-40f0-842f-5ea2019822f9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:51.377453 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e12a22f1-0556-40f0-842f-5ea2019822f9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:51.378309 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e12a22f1-0556-40f0-842f-5ea2019822f9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:51.378730 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e12a22f1-0556-40f0-842f-5ea2019822f9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:51.513654 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e12a22f1-0556-40f0-842f-5ea2019822f9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:51.520953 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e12a22f1-0556-40f0-842f-5ea2019822f9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1273 microversion: 2.1 time: 0.155528 Jan 11 15:14:51.521517 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 351/711] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:51 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1273 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:51.788576 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-8e7c9d95-6301-483f-88ac-572aab5edd01 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:51.790124 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-8e7c9d95-6301-483f-88ac-572aab5edd01 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:51.796458 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8e7c9d95-6301-483f-88ac-572aab5edd01 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:51.796865 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8e7c9d95-6301-483f-88ac-572aab5edd01 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:51.797630 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8e7c9d95-6301-483f-88ac-572aab5edd01 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:51.798079 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8e7c9d95-6301-483f-88ac-572aab5edd01 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:51.881107 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-8e7c9d95-6301-483f-88ac-572aab5edd01 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 28565 microversion: 2.20 time: 0.095985 Jan 11 15:14:51.881758 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 361/712] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:51 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 28565 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:14:52.041694 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2d6371da-c68f-4215-bec8-bc5a07bbfc42 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:52.042608 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2d6371da-c68f-4215-bec8-bc5a07bbfc42 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:52.048855 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2d6371da-c68f-4215-bec8-bc5a07bbfc42 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:52.049440 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2d6371da-c68f-4215-bec8-bc5a07bbfc42 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:52.050220 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2d6371da-c68f-4215-bec8-bc5a07bbfc42 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:52.050692 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2d6371da-c68f-4215-bec8-bc5a07bbfc42 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:52.110002 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d20148a0-bf98-49ef-9c72-98b7ec4b8dd0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:52.110695 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d20148a0-bf98-49ef-9c72-98b7ec4b8dd0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 32a717c2-da7f-4685-813a-20f4149ce104] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:52.117418 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d20148a0-bf98-49ef-9c72-98b7ec4b8dd0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:52.117872 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d20148a0-bf98-49ef-9c72-98b7ec4b8dd0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:52.118654 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d20148a0-bf98-49ef-9c72-98b7ec4b8dd0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:52.119093 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d20148a0-bf98-49ef-9c72-98b7ec4b8dd0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:52.258712 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2d6371da-c68f-4215-bec8-bc5a07bbfc42 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.219827 Jan 11 15:14:52.259465 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 352/713] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:52 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:14:52.262529 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-d20148a0-bf98-49ef-9c72-98b7ec4b8dd0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:52.264819 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1c12abbb-7186-41a8-af54-6519234ebfba tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:52.265950 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1c12abbb-7186-41a8-af54-6519234ebfba tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:52.272113 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d20148a0-bf98-49ef-9c72-98b7ec4b8dd0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104" status: 200 len: 1513 microversion: 2.1 time: 0.165940 Jan 11 15:14:52.276748 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1c12abbb-7186-41a8-af54-6519234ebfba tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:52.276896 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 362/714] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:52 2022] GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:52.276982 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1c12abbb-7186-41a8-af54-6519234ebfba tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:52.276982 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1c12abbb-7186-41a8-af54-6519234ebfba tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:52.276982 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1c12abbb-7186-41a8-af54-6519234ebfba tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:52.309802 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1c12abbb-7186-41a8-af54-6519234ebfba tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048895 Jan 11 15:14:52.310358 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 353/715] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:14:52 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:14:52.537073 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-8cda29a0-d85e-45c1-8c9e-8c28409f399f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:52.537684 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-8cda29a0-d85e-45c1-8c9e-8c28409f399f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:52.544692 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8cda29a0-d85e-45c1-8c9e-8c28409f399f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:52.546245 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8cda29a0-d85e-45c1-8c9e-8c28409f399f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:52.547034 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8cda29a0-d85e-45c1-8c9e-8c28409f399f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:52.547512 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8cda29a0-d85e-45c1-8c9e-8c28409f399f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:52.677539 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-8cda29a0-d85e-45c1-8c9e-8c28409f399f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:52.685529 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-8cda29a0-d85e-45c1-8c9e-8c28409f399f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.152093 Jan 11 15:14:52.686263 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 363/716] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:52 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:52.892851 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-39084666-817c-4803-9a05-cb6d4c7f0633 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:52.893761 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-39084666-817c-4803-9a05-cb6d4c7f0633 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:52.900490 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-39084666-817c-4803-9a05-cb6d4c7f0633 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:52.900945 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-39084666-817c-4803-9a05-cb6d4c7f0633 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:52.901714 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-39084666-817c-4803-9a05-cb6d4c7f0633 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:52.902158 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-39084666-817c-4803-9a05-cb6d4c7f0633 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:53.071542 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-39084666-817c-4803-9a05-cb6d4c7f0633 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 30125 microversion: 2.20 time: 0.182092 Jan 11 15:14:53.072301 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 354/717] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:52 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 30125 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:14:53.270238 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-8dc1b1d4-08b7-4a54-95fc-e6433bc828a9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:53.271353 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-8dc1b1d4-08b7-4a54-95fc-e6433bc828a9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:53.278166 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8dc1b1d4-08b7-4a54-95fc-e6433bc828a9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:53.278625 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8dc1b1d4-08b7-4a54-95fc-e6433bc828a9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:53.279505 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8dc1b1d4-08b7-4a54-95fc-e6433bc828a9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:53.279916 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8dc1b1d4-08b7-4a54-95fc-e6433bc828a9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:53.290425 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c0f07c0f-8234-4f0b-a8b4-bb64d1763077 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:53.291445 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c0f07c0f-8234-4f0b-a8b4-bb64d1763077 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 32a717c2-da7f-4685-813a-20f4149ce104] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:53.298848 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c0f07c0f-8234-4f0b-a8b4-bb64d1763077 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:53.300614 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c0f07c0f-8234-4f0b-a8b4-bb64d1763077 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:53.303070 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c0f07c0f-8234-4f0b-a8b4-bb64d1763077 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:53.303781 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c0f07c0f-8234-4f0b-a8b4-bb64d1763077 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:53.356747 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-8dc1b1d4-08b7-4a54-95fc-e6433bc828a9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.090190 Jan 11 15:14:53.357394 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 364/718] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:53 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:14:53.362293 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a372c29e-2210-46af-9190-4e560a9b5b20 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:53.363352 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a372c29e-2210-46af-9190-4e560a9b5b20 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:53.370349 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a372c29e-2210-46af-9190-4e560a9b5b20 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:53.370843 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a372c29e-2210-46af-9190-4e560a9b5b20 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:53.371654 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a372c29e-2210-46af-9190-4e560a9b5b20 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:53.372094 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a372c29e-2210-46af-9190-4e560a9b5b20 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:53.402820 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a372c29e-2210-46af-9190-4e560a9b5b20 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044264 Jan 11 15:14:53.403593 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 365/719] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:14:53 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:14:53.450392 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c0f07c0f-8234-4f0b-a8b4-bb64d1763077 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:53.458035 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c0f07c0f-8234-4f0b-a8b4-bb64d1763077 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104" status: 200 len: 1513 microversion: 2.1 time: 0.172377 Jan 11 15:14:53.459188 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 355/720] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:53 2022] GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104 => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:14:53.529111 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [req-9bfe426c-e424-4339-b1bd-2fc5838c0ea6 req-e60127b2-b3cc-4157-80b6-036fc9190263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a717c2-da7f-4685-813a-20f4149ce104", "name": "network-vif-deleted", "tag": "94ba84f2-19a7-465d-a25a-5495304a6ac2"}]} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:53.530519 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:14:53.530519 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: warnings.warn(msg) Jan 11 15:14:53.537822 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-9bfe426c-e424-4339-b1bd-2fc5838c0ea6 req-e60127b2-b3cc-4157-80b6-036fc9190263 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:53.538289 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-9bfe426c-e424-4339-b1bd-2fc5838c0ea6 req-e60127b2-b3cc-4157-80b6-036fc9190263 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:53.549324 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.compute.server_external_events [req-9bfe426c-e424-4339-b1bd-2fc5838c0ea6 req-e60127b2-b3cc-4157-80b6-036fc9190263 service nova] Creating event network-vif-deleted:94ba84f2-19a7-465d-a25a-5495304a6ac2 for instance 32a717c2-da7f-4685-813a-20f4149ce104 on hv-cinder-82418 Jan 11 15:14:53.554041 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [req-9bfe426c-e424-4339-b1bd-2fc5838c0ea6 req-e60127b2-b3cc-4157-80b6-036fc9190263 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028567 Jan 11 15:14:53.555526 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 366/721] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:14:53.706407 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-aa37e291-168c-4055-a82a-4b7c98187dc3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:53.706975 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-aa37e291-168c-4055-a82a-4b7c98187dc3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:53.714049 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aa37e291-168c-4055-a82a-4b7c98187dc3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:53.714507 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aa37e291-168c-4055-a82a-4b7c98187dc3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:53.715309 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aa37e291-168c-4055-a82a-4b7c98187dc3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:53.715758 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aa37e291-168c-4055-a82a-4b7c98187dc3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:53.851206 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-aa37e291-168c-4055-a82a-4b7c98187dc3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:53.859060 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-aa37e291-168c-4055-a82a-4b7c98187dc3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.156401 Jan 11 15:14:53.859663 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 356/722] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:53 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:54.084025 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-140d4d5a-538a-4bdf-b806-fdac49c1d87c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:54.085019 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-140d4d5a-538a-4bdf-b806-fdac49c1d87c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:54.091333 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-140d4d5a-538a-4bdf-b806-fdac49c1d87c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:54.091793 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-140d4d5a-538a-4bdf-b806-fdac49c1d87c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:54.092569 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-140d4d5a-538a-4bdf-b806-fdac49c1d87c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:54.093012 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-140d4d5a-538a-4bdf-b806-fdac49c1d87c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:54.172447 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-140d4d5a-538a-4bdf-b806-fdac49c1d87c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 31810 microversion: 2.20 time: 0.092639 Jan 11 15:14:54.173283 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 367/723] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:54 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 31810 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:14:54.374344 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-390fc406-37d7-4482-9215-58a47c25c2b5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:54.375329 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-390fc406-37d7-4482-9215-58a47c25c2b5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:54.381573 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-390fc406-37d7-4482-9215-58a47c25c2b5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:54.382020 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-390fc406-37d7-4482-9215-58a47c25c2b5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:54.382808 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-390fc406-37d7-4482-9215-58a47c25c2b5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:54.383251 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-390fc406-37d7-4482-9215-58a47c25c2b5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:54.415037 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-79487627-83eb-46fc-9b75-1f0fb4953223 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:54.416073 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-79487627-83eb-46fc-9b75-1f0fb4953223 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:54.423065 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-79487627-83eb-46fc-9b75-1f0fb4953223 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:54.423502 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-79487627-83eb-46fc-9b75-1f0fb4953223 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:54.424290 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-79487627-83eb-46fc-9b75-1f0fb4953223 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:54.424736 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-79487627-83eb-46fc-9b75-1f0fb4953223 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:54.447360 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-390fc406-37d7-4482-9215-58a47c25c2b5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.076396 Jan 11 15:14:54.448021 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 357/724] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:54 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:14:54.457274 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-79487627-83eb-46fc-9b75-1f0fb4953223 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046867 Jan 11 15:14:54.457837 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 368/725] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:14:54 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:14:54.477125 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-51383f6b-722d-4219-8e35-e610ec304070 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:54.477821 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-51383f6b-722d-4219-8e35-e610ec304070 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 32a717c2-da7f-4685-813a-20f4149ce104] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:54.484623 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-51383f6b-722d-4219-8e35-e610ec304070 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:54.485073 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-51383f6b-722d-4219-8e35-e610ec304070 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:54.488272 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-51383f6b-722d-4219-8e35-e610ec304070 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:54.488272 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-51383f6b-722d-4219-8e35-e610ec304070 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:54.500184 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.wsgi [None req-51383f6b-722d-4219-8e35-e610ec304070 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] HTTP exception thrown: Instance 32a717c2-da7f-4685-813a-20f4149ce104 could not be found. Jan 11 15:14:54.500764 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-51383f6b-722d-4219-8e35-e610ec304070 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Returning 404 to user: Instance 32a717c2-da7f-4685-813a-20f4149ce104 could not be found. {{(pid=116902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:14:54.501565 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-51383f6b-722d-4219-8e35-e610ec304070 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104" status: 404 len: 111 microversion: 2.1 time: 0.028973 Jan 11 15:14:54.502085 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 358/726] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:54 2022] GET /compute/v2.1/servers/32a717c2-da7f-4685-813a-20f4149ce104 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 15:14:54.875251 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-777f3460-f4f8-4e5a-a13a-7e1e48430573 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:54.875881 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-777f3460-f4f8-4e5a-a13a-7e1e48430573 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:54.882130 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-777f3460-f4f8-4e5a-a13a-7e1e48430573 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:54.882582 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-777f3460-f4f8-4e5a-a13a-7e1e48430573 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:54.884001 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-777f3460-f4f8-4e5a-a13a-7e1e48430573 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:54.884442 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-777f3460-f4f8-4e5a-a13a-7e1e48430573 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:55.016244 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-777f3460-f4f8-4e5a-a13a-7e1e48430573 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:55.024409 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-777f3460-f4f8-4e5a-a13a-7e1e48430573 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.152071 Jan 11 15:14:55.024997 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 369/727] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:54 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:55.184576 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2c769364-c5eb-4923-bdf7-4eef73bd1618 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:55.185407 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2c769364-c5eb-4923-bdf7-4eef73bd1618 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:55.191796 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2c769364-c5eb-4923-bdf7-4eef73bd1618 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:55.192252 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2c769364-c5eb-4923-bdf7-4eef73bd1618 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:55.193032 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2c769364-c5eb-4923-bdf7-4eef73bd1618 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:55.193476 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2c769364-c5eb-4923-bdf7-4eef73bd1618 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:55.269525 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2c769364-c5eb-4923-bdf7-4eef73bd1618 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 33063 microversion: 2.20 time: 0.088590 Jan 11 15:14:55.270190 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 359/728] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:55 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 33063 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:14:55.459646 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-efb498d3-27b4-478c-acf4-416acb074321 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:55.460478 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-efb498d3-27b4-478c-acf4-416acb074321 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:55.467066 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-efb498d3-27b4-478c-acf4-416acb074321 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:55.467560 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-efb498d3-27b4-478c-acf4-416acb074321 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:55.468334 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-efb498d3-27b4-478c-acf4-416acb074321 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:55.468769 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-efb498d3-27b4-478c-acf4-416acb074321 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:55.469707 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ea418b6a-cb4d-4748-982a-f057388d441e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:55.470684 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ea418b6a-cb4d-4748-982a-f057388d441e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:55.477451 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ea418b6a-cb4d-4748-982a-f057388d441e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:55.477904 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ea418b6a-cb4d-4748-982a-f057388d441e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:55.478687 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ea418b6a-cb4d-4748-982a-f057388d441e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:55.479126 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ea418b6a-cb4d-4748-982a-f057388d441e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:55.509333 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ea418b6a-cb4d-4748-982a-f057388d441e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043644 Jan 11 15:14:55.509884 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 360/729] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:14:55 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:14:55.539853 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-efb498d3-27b4-478c-acf4-416acb074321 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.083707 Jan 11 15:14:55.540491 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 370/730] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:55 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:14:56.045470 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-940e8de6-2ce9-481b-a241-2cd57900f1c6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:56.046079 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-940e8de6-2ce9-481b-a241-2cd57900f1c6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:56.052271 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-940e8de6-2ce9-481b-a241-2cd57900f1c6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:56.052723 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-940e8de6-2ce9-481b-a241-2cd57900f1c6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:56.053503 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-940e8de6-2ce9-481b-a241-2cd57900f1c6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:56.053945 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-940e8de6-2ce9-481b-a241-2cd57900f1c6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:56.184288 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-940e8de6-2ce9-481b-a241-2cd57900f1c6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:56.191472 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-940e8de6-2ce9-481b-a241-2cd57900f1c6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.149552 Jan 11 15:14:56.192030 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 361/731] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:56 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:56.281993 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e44a402e-2920-4684-8043-f62929715a41 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:56.282993 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e44a402e-2920-4684-8043-f62929715a41 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:56.289832 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e44a402e-2920-4684-8043-f62929715a41 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:56.290281 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e44a402e-2920-4684-8043-f62929715a41 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:56.291061 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e44a402e-2920-4684-8043-f62929715a41 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:56.291529 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e44a402e-2920-4684-8043-f62929715a41 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:56.365018 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e44a402e-2920-4684-8043-f62929715a41 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 33870 microversion: 2.20 time: 0.086838 Jan 11 15:14:56.365627 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 371/732] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:56 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 33870 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:14:56.520889 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f5cf2dff-56f2-4381-8aab-b46bbc6671fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:56.521714 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f5cf2dff-56f2-4381-8aab-b46bbc6671fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:56.528579 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f5cf2dff-56f2-4381-8aab-b46bbc6671fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:56.529031 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f5cf2dff-56f2-4381-8aab-b46bbc6671fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:56.529808 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f5cf2dff-56f2-4381-8aab-b46bbc6671fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:56.530245 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f5cf2dff-56f2-4381-8aab-b46bbc6671fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:56.551665 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-1201f6fa-48a1-4bca-86d3-de5a6b0d6866 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:56.552658 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-1201f6fa-48a1-4bca-86d3-de5a6b0d6866 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:56.558550 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f5cf2dff-56f2-4381-8aab-b46bbc6671fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041513 Jan 11 15:14:56.559136 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 362/733] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:14:56 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:14:56.560046 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1201f6fa-48a1-4bca-86d3-de5a6b0d6866 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:56.560495 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1201f6fa-48a1-4bca-86d3-de5a6b0d6866 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:56.561285 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1201f6fa-48a1-4bca-86d3-de5a6b0d6866 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:56.561720 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1201f6fa-48a1-4bca-86d3-de5a6b0d6866 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:56.625197 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-1201f6fa-48a1-4bca-86d3-de5a6b0d6866 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 28655 microversion: 2.1 time: 0.077394 Jan 11 15:14:56.625803 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 372/734] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:56 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 28655 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:14:57.208281 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e6775cab-4662-4d06-b892-75421a3a9f7d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:57.208898 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e6775cab-4662-4d06-b892-75421a3a9f7d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:57.215435 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e6775cab-4662-4d06-b892-75421a3a9f7d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:57.215885 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e6775cab-4662-4d06-b892-75421a3a9f7d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:57.216659 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e6775cab-4662-4d06-b892-75421a3a9f7d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:57.217099 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e6775cab-4662-4d06-b892-75421a3a9f7d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:57.347007 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e6775cab-4662-4d06-b892-75421a3a9f7d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:57.354868 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e6775cab-4662-4d06-b892-75421a3a9f7d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.150254 Jan 11 15:14:57.355465 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 363/735] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:57 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:57.377423 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-62a0bb5f-d46c-451a-9104-bb68e34aae56 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:57.378432 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-62a0bb5f-d46c-451a-9104-bb68e34aae56 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:57.385501 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-62a0bb5f-d46c-451a-9104-bb68e34aae56 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:57.386009 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-62a0bb5f-d46c-451a-9104-bb68e34aae56 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:57.386777 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-62a0bb5f-d46c-451a-9104-bb68e34aae56 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:57.387211 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-62a0bb5f-d46c-451a-9104-bb68e34aae56 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:57.468977 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-62a0bb5f-d46c-451a-9104-bb68e34aae56 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 35054 microversion: 2.20 time: 0.095455 Jan 11 15:14:57.469613 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 373/736] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:57 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 35054 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:14:57.568877 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5774f5de-84a1-4418-ad64-e287af8b88f3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:57.569714 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5774f5de-84a1-4418-ad64-e287af8b88f3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:57.575569 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5774f5de-84a1-4418-ad64-e287af8b88f3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:57.576020 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5774f5de-84a1-4418-ad64-e287af8b88f3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:57.576791 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5774f5de-84a1-4418-ad64-e287af8b88f3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:57.577228 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5774f5de-84a1-4418-ad64-e287af8b88f3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:57.605633 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5774f5de-84a1-4418-ad64-e287af8b88f3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040607 Jan 11 15:14:57.606145 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 364/737] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:14:57 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:14:57.636795 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f6c418d4-ca3e-4b9e-9aba-f327878a46d9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:57.637783 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f6c418d4-ca3e-4b9e-9aba-f327878a46d9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:57.644449 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f6c418d4-ca3e-4b9e-9aba-f327878a46d9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:57.644895 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f6c418d4-ca3e-4b9e-9aba-f327878a46d9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:57.645695 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f6c418d4-ca3e-4b9e-9aba-f327878a46d9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:57.646131 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f6c418d4-ca3e-4b9e-9aba-f327878a46d9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:57.735193 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f6c418d4-ca3e-4b9e-9aba-f327878a46d9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 29032 microversion: 2.1 time: 0.102200 Jan 11 15:14:57.735830 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 374/738] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:57 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 29032 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:14:58.370721 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ce0b2a41-ea47-4d7e-bbd1-0b28c7d29230 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:58.371477 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ce0b2a41-ea47-4d7e-bbd1-0b28c7d29230 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:58.377780 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ce0b2a41-ea47-4d7e-bbd1-0b28c7d29230 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:58.378223 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ce0b2a41-ea47-4d7e-bbd1-0b28c7d29230 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:58.379000 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ce0b2a41-ea47-4d7e-bbd1-0b28c7d29230 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:58.379467 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ce0b2a41-ea47-4d7e-bbd1-0b28c7d29230 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:58.481615 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e42f66e6-37b0-4ac4-8be6-9e0e552defd0 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:58.482614 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e42f66e6-37b0-4ac4-8be6-9e0e552defd0 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:58.489452 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e42f66e6-37b0-4ac4-8be6-9e0e552defd0 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:58.490098 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e42f66e6-37b0-4ac4-8be6-9e0e552defd0 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:58.490891 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e42f66e6-37b0-4ac4-8be6-9e0e552defd0 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:58.491353 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e42f66e6-37b0-4ac4-8be6-9e0e552defd0 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:58.506781 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ce0b2a41-ea47-4d7e-bbd1-0b28c7d29230 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:58.514008 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ce0b2a41-ea47-4d7e-bbd1-0b28c7d29230 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.147501 Jan 11 15:14:58.514579 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 365/739] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:58 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:14:58.581667 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e42f66e6-37b0-4ac4-8be6-9e0e552defd0 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 36148 microversion: 2.20 time: 0.104551 Jan 11 15:14:58.582293 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 375/740] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:58 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 36148 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:14:58.616646 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-67536aea-1013-4ed4-b2f9-835ba28cb113 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:58.617532 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-67536aea-1013-4ed4-b2f9-835ba28cb113 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:58.623618 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-67536aea-1013-4ed4-b2f9-835ba28cb113 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:58.624067 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-67536aea-1013-4ed4-b2f9-835ba28cb113 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:58.624842 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-67536aea-1013-4ed4-b2f9-835ba28cb113 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:58.625276 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-67536aea-1013-4ed4-b2f9-835ba28cb113 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:58.654527 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-67536aea-1013-4ed4-b2f9-835ba28cb113 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041542 Jan 11 15:14:58.655091 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 366/741] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:14:58 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:14:58.746946 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3841f6f4-e9a3-4e9b-9476-7b0e8d960c93 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:58.747962 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3841f6f4-e9a3-4e9b-9476-7b0e8d960c93 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:58.754840 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3841f6f4-e9a3-4e9b-9476-7b0e8d960c93 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:58.755386 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3841f6f4-e9a3-4e9b-9476-7b0e8d960c93 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:58.756229 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3841f6f4-e9a3-4e9b-9476-7b0e8d960c93 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:58.756739 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3841f6f4-e9a3-4e9b-9476-7b0e8d960c93 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:58.841023 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3841f6f4-e9a3-4e9b-9476-7b0e8d960c93 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 30729 microversion: 2.1 time: 0.097968 Jan 11 15:14:58.841647 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 376/742] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:58 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 30729 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:14:59.529437 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f617a7d3-01ac-47a5-b2d1-d927e622b208 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:59.530046 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f617a7d3-01ac-47a5-b2d1-d927e622b208 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:59.536255 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f617a7d3-01ac-47a5-b2d1-d927e622b208 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:59.536703 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f617a7d3-01ac-47a5-b2d1-d927e622b208 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:59.537471 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f617a7d3-01ac-47a5-b2d1-d927e622b208 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:59.537910 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f617a7d3-01ac-47a5-b2d1-d927e622b208 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:59.593406 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-9ad2d21e-7641-4be6-8b47-9214a8f28f0e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:59.594401 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-9ad2d21e-7641-4be6-8b47-9214a8f28f0e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:59.601146 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9ad2d21e-7641-4be6-8b47-9214a8f28f0e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:59.602094 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9ad2d21e-7641-4be6-8b47-9214a8f28f0e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:59.602871 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9ad2d21e-7641-4be6-8b47-9214a8f28f0e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:59.603332 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9ad2d21e-7641-4be6-8b47-9214a8f28f0e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:59.667496 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f617a7d3-01ac-47a5-b2d1-d927e622b208 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:14:59.674857 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f617a7d3-01ac-47a5-b2d1-d927e622b208 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.148983 Jan 11 15:14:59.675440 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 367/743] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:14:59 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:14:59.681226 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-9ad2d21e-7641-4be6-8b47-9214a8f28f0e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 37329 microversion: 2.20 time: 0.091721 Jan 11 15:14:59.681621 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-00b7850a-89e7-45d0-9f8e-20cd0ff0fbd1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:14:59.685342 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 377/744] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:14:59 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 37329 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:14:59.685501 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-00b7850a-89e7-45d0-9f8e-20cd0ff0fbd1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:59.688415 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-00b7850a-89e7-45d0-9f8e-20cd0ff0fbd1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:59.688854 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-00b7850a-89e7-45d0-9f8e-20cd0ff0fbd1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:59.689720 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-00b7850a-89e7-45d0-9f8e-20cd0ff0fbd1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:59.690159 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-00b7850a-89e7-45d0-9f8e-20cd0ff0fbd1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:59.718144 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-00b7850a-89e7-45d0-9f8e-20cd0ff0fbd1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040847 Jan 11 15:14:59.718682 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 368/745] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:14:59 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:14:59.853145 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-9766e460-53a5-4f00-9093-69649967fd6c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:14:59.854125 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-9766e460-53a5-4f00-9093-69649967fd6c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:14:59.860885 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9766e460-53a5-4f00-9093-69649967fd6c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:59.861333 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9766e460-53a5-4f00-9093-69649967fd6c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:59.862103 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9766e460-53a5-4f00-9093-69649967fd6c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:14:59.862535 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9766e460-53a5-4f00-9093-69649967fd6c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:14:59.955573 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-9766e460-53a5-4f00-9093-69649967fd6c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 32143 microversion: 2.1 time: 0.106332 Jan 11 15:14:59.957629 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 378/746] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:14:59 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 32143 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:15:00.691751 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f284ce26-fc8e-48a6-9444-d41be99bc815 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:00.692278 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f284ce26-fc8e-48a6-9444-d41be99bc815 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:00.693446 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-63b4ab81-e563-43b7-b357-0c45176d5a10 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:15:00.694445 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-63b4ab81-e563-43b7-b357-0c45176d5a10 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:00.698565 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f284ce26-fc8e-48a6-9444-d41be99bc815 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:00.699011 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f284ce26-fc8e-48a6-9444-d41be99bc815 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:00.699828 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f284ce26-fc8e-48a6-9444-d41be99bc815 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:00.700273 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f284ce26-fc8e-48a6-9444-d41be99bc815 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:00.701269 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-63b4ab81-e563-43b7-b357-0c45176d5a10 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:00.701721 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-63b4ab81-e563-43b7-b357-0c45176d5a10 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:00.702554 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-63b4ab81-e563-43b7-b357-0c45176d5a10 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:00.702936 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-63b4ab81-e563-43b7-b357-0c45176d5a10 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:00.784142 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-63b4ab81-e563-43b7-b357-0c45176d5a10 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 38119 microversion: 2.20 time: 0.094574 Jan 11 15:15:00.787854 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 379/747] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:15:00 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 38119 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:15:00.790435 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7797a178-00e6-479f-a2d8-d7ff48cc2d00 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:00.791462 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7797a178-00e6-479f-a2d8-d7ff48cc2d00 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:00.798186 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7797a178-00e6-479f-a2d8-d7ff48cc2d00 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:00.798636 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7797a178-00e6-479f-a2d8-d7ff48cc2d00 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:00.799445 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7797a178-00e6-479f-a2d8-d7ff48cc2d00 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:00.799888 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7797a178-00e6-479f-a2d8-d7ff48cc2d00 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:00.827489 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f284ce26-fc8e-48a6-9444-d41be99bc815 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:00.828310 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7797a178-00e6-479f-a2d8-d7ff48cc2d00 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042202 Jan 11 15:15:00.828875 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 380/748] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:00 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:00.834661 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f284ce26-fc8e-48a6-9444-d41be99bc815 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.146585 Jan 11 15:15:00.835208 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 369/749] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:00 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:00.967574 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-41121e15-f836-4bb5-816d-ae68fbff5fad tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:15:00.968487 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-41121e15-f836-4bb5-816d-ae68fbff5fad tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:00.974640 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-41121e15-f836-4bb5-816d-ae68fbff5fad tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:00.975092 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-41121e15-f836-4bb5-816d-ae68fbff5fad tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:00.975921 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-41121e15-f836-4bb5-816d-ae68fbff5fad tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:00.976488 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-41121e15-f836-4bb5-816d-ae68fbff5fad tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:01.065686 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-41121e15-f836-4bb5-816d-ae68fbff5fad tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 32908 microversion: 2.1 time: 0.101574 Jan 11 15:15:01.066612 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 381/750] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:15:00 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 32908 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:15:01.795690 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7b8c6e48-2a31-4c04-9de4-c672b4d6d52a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:15:01.796598 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-7b8c6e48-2a31-4c04-9de4-c672b4d6d52a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:01.802714 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7b8c6e48-2a31-4c04-9de4-c672b4d6d52a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:01.803159 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7b8c6e48-2a31-4c04-9de4-c672b4d6d52a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:01.804004 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7b8c6e48-2a31-4c04-9de4-c672b4d6d52a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:01.804441 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7b8c6e48-2a31-4c04-9de4-c672b4d6d52a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:01.841007 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f961cdcb-59eb-4ffb-94ae-afa4c9adca22 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:01.842034 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f961cdcb-59eb-4ffb-94ae-afa4c9adca22 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:01.848940 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f961cdcb-59eb-4ffb-94ae-afa4c9adca22 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:01.849393 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f961cdcb-59eb-4ffb-94ae-afa4c9adca22 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:01.850171 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f961cdcb-59eb-4ffb-94ae-afa4c9adca22 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:01.850612 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f961cdcb-59eb-4ffb-94ae-afa4c9adca22 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:01.868410 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7b8c6e48-2a31-4c04-9de4-c672b4d6d52a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 38119 microversion: 2.20 time: 0.076145 Jan 11 15:15:01.872512 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 370/751] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:15:01 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 38119 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:15:01.873979 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b8e258c8-bd1b-4157-ae41-81595440117b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:01.874672 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b8e258c8-bd1b-4157-ae41-81595440117b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:01.881473 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b8e258c8-bd1b-4157-ae41-81595440117b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:01.881925 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b8e258c8-bd1b-4157-ae41-81595440117b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:01.883211 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b8e258c8-bd1b-4157-ae41-81595440117b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:01.883680 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b8e258c8-bd1b-4157-ae41-81595440117b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:01.884620 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f961cdcb-59eb-4ffb-94ae-afa4c9adca22 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048609 Jan 11 15:15:01.885181 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 382/752] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:01 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:15:02.015972 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b8e258c8-bd1b-4157-ae41-81595440117b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:02.023307 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b8e258c8-bd1b-4157-ae41-81595440117b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.153027 Jan 11 15:15:02.024341 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 371/753] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:01 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:02.077041 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-5dae8270-8359-4a15-813b-f61d0ac4d882 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:15:02.077877 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-5dae8270-8359-4a15-813b-f61d0ac4d882 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:02.084130 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5dae8270-8359-4a15-813b-f61d0ac4d882 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:02.084583 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5dae8270-8359-4a15-813b-f61d0ac4d882 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:02.085386 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5dae8270-8359-4a15-813b-f61d0ac4d882 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:02.086116 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5dae8270-8359-4a15-813b-f61d0ac4d882 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:02.171053 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-5dae8270-8359-4a15-813b-f61d0ac4d882 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 33734 microversion: 2.1 time: 0.097525 Jan 11 15:15:02.171703 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 383/754] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:15:02 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 33734 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:15:02.880142 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-80a3980b-603b-46c8-b542-cb9ffebcb7ec tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:15:02.880981 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-80a3980b-603b-46c8-b542-cb9ffebcb7ec tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:02.887820 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-80a3980b-603b-46c8-b542-cb9ffebcb7ec tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:02.888270 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-80a3980b-603b-46c8-b542-cb9ffebcb7ec tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:02.889038 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-80a3980b-603b-46c8-b542-cb9ffebcb7ec tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:02.889502 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-80a3980b-603b-46c8-b542-cb9ffebcb7ec tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:02.896311 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-70764ed1-8eb0-4f5f-baf9-f0e2c8c234b5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:02.897300 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-70764ed1-8eb0-4f5f-baf9-f0e2c8c234b5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:02.904145 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-70764ed1-8eb0-4f5f-baf9-f0e2c8c234b5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:02.904598 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-70764ed1-8eb0-4f5f-baf9-f0e2c8c234b5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:02.905379 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-70764ed1-8eb0-4f5f-baf9-f0e2c8c234b5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:02.905817 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-70764ed1-8eb0-4f5f-baf9-f0e2c8c234b5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:02.935072 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-70764ed1-8eb0-4f5f-baf9-f0e2c8c234b5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042804 Jan 11 15:15:02.935655 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 384/755] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:02 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:15:02.969404 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-80a3980b-603b-46c8-b542-cb9ffebcb7ec tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 38119 microversion: 2.20 time: 0.092845 Jan 11 15:15:02.970029 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 372/756] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:15:02 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 38119 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:15:03.039982 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c5358e4c-f91c-4e78-b0d8-df117714fa71 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:03.040594 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c5358e4c-f91c-4e78-b0d8-df117714fa71 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:03.047050 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c5358e4c-f91c-4e78-b0d8-df117714fa71 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:03.047545 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c5358e4c-f91c-4e78-b0d8-df117714fa71 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:03.048372 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c5358e4c-f91c-4e78-b0d8-df117714fa71 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:03.048814 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c5358e4c-f91c-4e78-b0d8-df117714fa71 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:03.176736 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-c5358e4c-f91c-4e78-b0d8-df117714fa71 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:03.182945 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-556fc9d7-357c-45df-97cd-8888a5a9f03e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:15:03.183977 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-556fc9d7-357c-45df-97cd-8888a5a9f03e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:03.184519 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c5358e4c-f91c-4e78-b0d8-df117714fa71 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.148162 Jan 11 15:15:03.185078 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 385/757] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:03 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:03.190963 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-556fc9d7-357c-45df-97cd-8888a5a9f03e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:03.191442 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-556fc9d7-357c-45df-97cd-8888a5a9f03e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:03.192225 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-556fc9d7-357c-45df-97cd-8888a5a9f03e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:03.192666 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-556fc9d7-357c-45df-97cd-8888a5a9f03e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:03.270883 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-556fc9d7-357c-45df-97cd-8888a5a9f03e tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 34601 microversion: 2.1 time: 0.092203 Jan 11 15:15:03.271577 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 373/758] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:15:03 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 34601 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 15:15:03.945997 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e89018d6-553e-447c-866e-734b0b8c2e39 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:03.946928 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e89018d6-553e-447c-866e-734b0b8c2e39 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:03.953276 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e89018d6-553e-447c-866e-734b0b8c2e39 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:03.953733 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e89018d6-553e-447c-866e-734b0b8c2e39 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:03.954516 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e89018d6-553e-447c-866e-734b0b8c2e39 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:03.954963 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e89018d6-553e-447c-866e-734b0b8c2e39 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:03.982287 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b83b6de5-7c46-4653-b02a-47ce1c131d22 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:15:03.983311 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b83b6de5-7c46-4653-b02a-47ce1c131d22 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:03.990265 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e89018d6-553e-447c-866e-734b0b8c2e39 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048028 Jan 11 15:15:03.993918 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 386/759] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:03 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:03.994626 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b83b6de5-7c46-4653-b02a-47ce1c131d22 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:03.995091 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b83b6de5-7c46-4653-b02a-47ce1c131d22 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:03.995935 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b83b6de5-7c46-4653-b02a-47ce1c131d22 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:03.996376 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b83b6de5-7c46-4653-b02a-47ce1c131d22 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:04.076442 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b83b6de5-7c46-4653-b02a-47ce1c131d22 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action" status: 200 len: 38262 microversion: 2.20 time: 0.098069 Jan 11 15:15:04.077374 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 374/760] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:15:03 2022] POST /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/action => generated 38262 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 15:15:04.087105 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ac7530ea-7c5c-42ae-84ab-6484d3e33710 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:04.087630 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-ac7530ea-7c5c-42ae-84ab-6484d3e33710 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:04.093454 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ac7530ea-7c5c-42ae-84ab-6484d3e33710 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:04.093910 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ac7530ea-7c5c-42ae-84ab-6484d3e33710 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:04.094681 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ac7530ea-7c5c-42ae-84ab-6484d3e33710 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:04.095122 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ac7530ea-7c5c-42ae-84ab-6484d3e33710 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:04.119237 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-ac7530ea-7c5c-42ae-84ab-6484d3e33710 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/ips" status: 200 len: 151 microversion: 2.20 time: 0.035972 Jan 11 15:15:04.125184 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 387/761] 10.222.0.52 () {60 vars in 1288 bytes} [Tue Jan 11 15:15:04 2022] GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:15:04.201496 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8d335eec-aa75-450a-a0fb-1e7da334a582 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:04.202424 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8d335eec-aa75-450a-a0fb-1e7da334a582 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:04.209321 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8d335eec-aa75-450a-a0fb-1e7da334a582 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:04.209778 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8d335eec-aa75-450a-a0fb-1e7da334a582 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:04.211130 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8d335eec-aa75-450a-a0fb-1e7da334a582 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:04.211704 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8d335eec-aa75-450a-a0fb-1e7da334a582 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:04.282229 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d1fdedc3-2707-4028-b39a-bba45a67c8b9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:15:04.283255 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d1fdedc3-2707-4028-b39a-bba45a67c8b9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:04.290105 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d1fdedc3-2707-4028-b39a-bba45a67c8b9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:04.290563 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d1fdedc3-2707-4028-b39a-bba45a67c8b9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:04.297895 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d1fdedc3-2707-4028-b39a-bba45a67c8b9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:04.297895 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d1fdedc3-2707-4028-b39a-bba45a67c8b9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:04.379921 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d1fdedc3-2707-4028-b39a-bba45a67c8b9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 35697 microversion: 2.1 time: 0.101140 Jan 11 15:15:04.380846 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 388/762] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:15:04 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 35697 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:15:04.626381 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-8d335eec-aa75-450a-a0fb-1e7da334a582 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:04.635005 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8d335eec-aa75-450a-a0fb-1e7da334a582 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.437430 Jan 11 15:15:04.635663 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 375/763] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:04 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:05.002260 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-779d6378-44fa-4cb9-bd11-3bff5c6bef02 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:05.003274 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-779d6378-44fa-4cb9-bd11-3bff5c6bef02 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:05.011480 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-779d6378-44fa-4cb9-bd11-3bff5c6bef02 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:05.011935 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-779d6378-44fa-4cb9-bd11-3bff5c6bef02 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:05.012713 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-779d6378-44fa-4cb9-bd11-3bff5c6bef02 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:05.013151 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-779d6378-44fa-4cb9-bd11-3bff5c6bef02 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:05.043906 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-779d6378-44fa-4cb9-bd11-3bff5c6bef02 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045691 Jan 11 15:15:05.044819 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 389/764] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:04 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:05.391100 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a38620ca-f501-46be-9b28-fac8e0c9c647 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:15:05.392113 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a38620ca-f501-46be-9b28-fac8e0c9c647 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:05.400610 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a38620ca-f501-46be-9b28-fac8e0c9c647 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:05.401016 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a38620ca-f501-46be-9b28-fac8e0c9c647 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:05.401979 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a38620ca-f501-46be-9b28-fac8e0c9c647 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:05.402448 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a38620ca-f501-46be-9b28-fac8e0c9c647 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:05.499579 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a38620ca-f501-46be-9b28-fac8e0c9c647 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 36773 microversion: 2.1 time: 0.111881 Jan 11 15:15:05.500461 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 376/765] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:15:05 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 36773 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:15:05.651138 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-eb7b7644-5082-411c-bfc6-1a441d7cadc1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:05.651709 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-eb7b7644-5082-411c-bfc6-1a441d7cadc1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:05.657930 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-eb7b7644-5082-411c-bfc6-1a441d7cadc1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:05.658353 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-eb7b7644-5082-411c-bfc6-1a441d7cadc1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:05.659135 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-eb7b7644-5082-411c-bfc6-1a441d7cadc1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:05.659602 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-eb7b7644-5082-411c-bfc6-1a441d7cadc1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:05.790141 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-eb7b7644-5082-411c-bfc6-1a441d7cadc1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:05.797276 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-eb7b7644-5082-411c-bfc6-1a441d7cadc1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.149837 Jan 11 15:15:05.797825 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 390/766] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:05 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:06.056737 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9241f164-4cd9-451c-8930-64991cfe9938 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:06.057724 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9241f164-4cd9-451c-8930-64991cfe9938 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:06.064638 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9241f164-4cd9-451c-8930-64991cfe9938 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:06.065086 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9241f164-4cd9-451c-8930-64991cfe9938 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:06.065864 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9241f164-4cd9-451c-8930-64991cfe9938 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:06.066301 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9241f164-4cd9-451c-8930-64991cfe9938 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:06.095384 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9241f164-4cd9-451c-8930-64991cfe9938 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043294 Jan 11 15:15:06.095940 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 377/767] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:06 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:06.510946 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2ae8de97-3fde-4465-a266-612f3c6ce143 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:15:06.511912 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2ae8de97-3fde-4465-a266-612f3c6ce143 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:06.518040 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2ae8de97-3fde-4465-a266-612f3c6ce143 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:06.518487 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2ae8de97-3fde-4465-a266-612f3c6ce143 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:06.519255 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2ae8de97-3fde-4465-a266-612f3c6ce143 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:06.519720 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2ae8de97-3fde-4465-a266-612f3c6ce143 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:06.603244 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2ae8de97-3fde-4465-a266-612f3c6ce143 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 38042 microversion: 2.1 time: 0.095781 Jan 11 15:15:06.603887 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 391/768] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:15:06 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 38042 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:15:06.813512 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-66946f96-98b5-4e8f-aac2-ce6b6a3e0608 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:06.814306 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-66946f96-98b5-4e8f-aac2-ce6b6a3e0608 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:06.820774 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-66946f96-98b5-4e8f-aac2-ce6b6a3e0608 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:06.821318 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-66946f96-98b5-4e8f-aac2-ce6b6a3e0608 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:06.822178 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-66946f96-98b5-4e8f-aac2-ce6b6a3e0608 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:06.822694 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-66946f96-98b5-4e8f-aac2-ce6b6a3e0608 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:06.953534 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-66946f96-98b5-4e8f-aac2-ce6b6a3e0608 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:06.961551 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-66946f96-98b5-4e8f-aac2-ce6b6a3e0608 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.151615 Jan 11 15:15:06.962062 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 378/769] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:06 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:07.106283 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ede2fe36-b138-4599-b20b-b803d69a01ae tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:07.107269 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-ede2fe36-b138-4599-b20b-b803d69a01ae tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:07.114133 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ede2fe36-b138-4599-b20b-b803d69a01ae tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:07.114582 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ede2fe36-b138-4599-b20b-b803d69a01ae tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:07.115381 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ede2fe36-b138-4599-b20b-b803d69a01ae tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:07.115817 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ede2fe36-b138-4599-b20b-b803d69a01ae tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:07.144144 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-ede2fe36-b138-4599-b20b-b803d69a01ae tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041929 Jan 11 15:15:07.144672 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 392/770] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:07 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:07.614832 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-658beb4a-a83b-452a-98f9-8063986cbfcf tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:15:07.615903 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-658beb4a-a83b-452a-98f9-8063986cbfcf tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:07.622553 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-658beb4a-a83b-452a-98f9-8063986cbfcf tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:07.623003 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-658beb4a-a83b-452a-98f9-8063986cbfcf tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:07.623806 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-658beb4a-a83b-452a-98f9-8063986cbfcf tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:07.624254 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-658beb4a-a83b-452a-98f9-8063986cbfcf tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:07.701855 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-658beb4a-a83b-452a-98f9-8063986cbfcf tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 38186 microversion: 2.1 time: 0.090470 Jan 11 15:15:07.702500 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 379/771] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:15:07 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 38186 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:15:07.977928 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a1e162ec-aa2c-482f-bc48-4575a3023044 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:07.978548 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a1e162ec-aa2c-482f-bc48-4575a3023044 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:07.984746 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a1e162ec-aa2c-482f-bc48-4575a3023044 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:07.985197 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a1e162ec-aa2c-482f-bc48-4575a3023044 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:07.985959 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a1e162ec-aa2c-482f-bc48-4575a3023044 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:07.986392 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a1e162ec-aa2c-482f-bc48-4575a3023044 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:08.114561 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-a1e162ec-aa2c-482f-bc48-4575a3023044 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:08.122313 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a1e162ec-aa2c-482f-bc48-4575a3023044 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.148540 Jan 11 15:15:08.122870 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 393/772] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:07 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:08.155581 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-db45b12f-fe90-4774-9bc7-302585a11447 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:08.156587 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-db45b12f-fe90-4774-9bc7-302585a11447 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:08.163523 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-db45b12f-fe90-4774-9bc7-302585a11447 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:08.164544 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-db45b12f-fe90-4774-9bc7-302585a11447 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:08.165333 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-db45b12f-fe90-4774-9bc7-302585a11447 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:08.165776 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-db45b12f-fe90-4774-9bc7-302585a11447 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:08.194899 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-db45b12f-fe90-4774-9bc7-302585a11447 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043317 Jan 11 15:15:08.195494 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 380/773] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:08 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:08.714883 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d700a620-0e6e-4a74-959c-3203ef2da8a5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:15:08.715822 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d700a620-0e6e-4a74-959c-3203ef2da8a5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:08.721924 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d700a620-0e6e-4a74-959c-3203ef2da8a5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:08.722394 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d700a620-0e6e-4a74-959c-3203ef2da8a5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:08.723159 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d700a620-0e6e-4a74-959c-3203ef2da8a5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:08.723633 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d700a620-0e6e-4a74-959c-3203ef2da8a5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:08.792890 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d700a620-0e6e-4a74-959c-3203ef2da8a5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 38186 microversion: 2.1 time: 0.082073 Jan 11 15:15:08.794347 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 394/774] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:15:08 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 38186 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:15:09.139028 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ccb84edb-0b71-4c77-a3c1-8bfbc67d2b03 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:09.139790 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ccb84edb-0b71-4c77-a3c1-8bfbc67d2b03 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:09.146041 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ccb84edb-0b71-4c77-a3c1-8bfbc67d2b03 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:09.146489 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ccb84edb-0b71-4c77-a3c1-8bfbc67d2b03 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:09.147268 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ccb84edb-0b71-4c77-a3c1-8bfbc67d2b03 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:09.147725 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ccb84edb-0b71-4c77-a3c1-8bfbc67d2b03 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:09.206618 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2e4d22e8-1a4d-4f77-9e22-f9eedd1975f9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:09.208324 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2e4d22e8-1a4d-4f77-9e22-f9eedd1975f9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:09.215316 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2e4d22e8-1a4d-4f77-9e22-f9eedd1975f9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:09.215778 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2e4d22e8-1a4d-4f77-9e22-f9eedd1975f9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:09.216580 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2e4d22e8-1a4d-4f77-9e22-f9eedd1975f9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:09.217008 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2e4d22e8-1a4d-4f77-9e22-f9eedd1975f9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:09.248298 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2e4d22e8-1a4d-4f77-9e22-f9eedd1975f9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045875 Jan 11 15:15:09.248863 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 395/775] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:09 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:15:09.281305 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ccb84edb-0b71-4c77-a3c1-8bfbc67d2b03 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:09.289193 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ccb84edb-0b71-4c77-a3c1-8bfbc67d2b03 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.153404 Jan 11 15:15:09.289760 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 381/776] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:09 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:09.805215 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a1d742e0-a594-4d29-b79e-abd864b72ebb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:15:09.806124 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a1d742e0-a594-4d29-b79e-abd864b72ebb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:09.812302 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a1d742e0-a594-4d29-b79e-abd864b72ebb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:09.812758 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a1d742e0-a594-4d29-b79e-abd864b72ebb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:09.813530 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a1d742e0-a594-4d29-b79e-abd864b72ebb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:09.814021 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a1d742e0-a594-4d29-b79e-abd864b72ebb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:09.888366 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a1d742e0-a594-4d29-b79e-abd864b72ebb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 38186 microversion: 2.1 time: 0.087225 Jan 11 15:15:09.889041 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 396/777] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:15:09 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 38186 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:15:10.259706 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7c705fdf-0e0c-4772-aeed-d2a62c7cb44b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:10.260637 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-7c705fdf-0e0c-4772-aeed-d2a62c7cb44b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:10.266970 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7c705fdf-0e0c-4772-aeed-d2a62c7cb44b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:10.267460 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7c705fdf-0e0c-4772-aeed-d2a62c7cb44b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:10.268235 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7c705fdf-0e0c-4772-aeed-d2a62c7cb44b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:10.268669 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7c705fdf-0e0c-4772-aeed-d2a62c7cb44b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:10.296911 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7c705fdf-0e0c-4772-aeed-d2a62c7cb44b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040986 Jan 11 15:15:10.297553 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 382/778] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:10 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:10.306587 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a59d42d4-e613-403b-96e8-dd90797de4ff tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:10.307308 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a59d42d4-e613-403b-96e8-dd90797de4ff tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:10.314018 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a59d42d4-e613-403b-96e8-dd90797de4ff tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:10.324498 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a59d42d4-e613-403b-96e8-dd90797de4ff tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:10.324498 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a59d42d4-e613-403b-96e8-dd90797de4ff tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:10.324498 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a59d42d4-e613-403b-96e8-dd90797de4ff tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:10.448092 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-a59d42d4-e613-403b-96e8-dd90797de4ff tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:10.455558 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a59d42d4-e613-403b-96e8-dd90797de4ff tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.153438 Jan 11 15:15:10.456458 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 397/779] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:10 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:10.900881 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7472f587-fe0a-4bdf-996f-2ce6619d7830 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:15:10.901787 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-7472f587-fe0a-4bdf-996f-2ce6619d7830 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:10.908017 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7472f587-fe0a-4bdf-996f-2ce6619d7830 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:10.908490 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7472f587-fe0a-4bdf-996f-2ce6619d7830 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:10.909264 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7472f587-fe0a-4bdf-996f-2ce6619d7830 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:10.909699 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7472f587-fe0a-4bdf-996f-2ce6619d7830 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:10.979818 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7472f587-fe0a-4bdf-996f-2ce6619d7830 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action" status: 200 len: 38317 microversion: 2.1 time: 0.083097 Jan 11 15:15:10.981949 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 383/780] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:15:10 2022] POST /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/action => generated 38317 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:15:10.990050 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d8b33f56-90e9-42ac-aec9-0ab9e579395c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:10.990622 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d8b33f56-90e9-42ac-aec9-0ab9e579395c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:10.997051 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d8b33f56-90e9-42ac-aec9-0ab9e579395c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:10.997509 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d8b33f56-90e9-42ac-aec9-0ab9e579395c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:10.998295 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d8b33f56-90e9-42ac-aec9-0ab9e579395c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:10.998732 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d8b33f56-90e9-42ac-aec9-0ab9e579395c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:11.024493 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d8b33f56-90e9-42ac-aec9-0ab9e579395c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/ips" status: 200 len: 146 microversion: 2.1 time: 0.038192 Jan 11 15:15:11.025057 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 398/781] 10.222.0.52 () {58 vars in 1247 bytes} [Tue Jan 11 15:15:10 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:11.309421 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-48ee5feb-f8c6-40fd-82f9-634157abdc79 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:11.310416 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-48ee5feb-f8c6-40fd-82f9-634157abdc79 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:11.317209 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-48ee5feb-f8c6-40fd-82f9-634157abdc79 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:11.317665 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-48ee5feb-f8c6-40fd-82f9-634157abdc79 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:11.318518 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-48ee5feb-f8c6-40fd-82f9-634157abdc79 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:11.318960 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-48ee5feb-f8c6-40fd-82f9-634157abdc79 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:11.349184 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-48ee5feb-f8c6-40fd-82f9-634157abdc79 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043877 Jan 11 15:15:11.349735 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 384/782] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:11 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:15:11.471630 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-30d0d89b-8d9c-44a7-a1cc-c27079af6519 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:11.472239 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-30d0d89b-8d9c-44a7-a1cc-c27079af6519 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:11.478895 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-30d0d89b-8d9c-44a7-a1cc-c27079af6519 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:11.479376 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-30d0d89b-8d9c-44a7-a1cc-c27079af6519 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:11.480154 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-30d0d89b-8d9c-44a7-a1cc-c27079af6519 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:11.480589 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-30d0d89b-8d9c-44a7-a1cc-c27079af6519 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:11.605134 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-30d0d89b-8d9c-44a7-a1cc-c27079af6519 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:11.612309 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-30d0d89b-8d9c-44a7-a1cc-c27079af6519 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.144277 Jan 11 15:15:11.612863 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 399/783] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:11 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:12.360589 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3a77bc79-5a1d-4670-baef-36df3b41b856 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:12.361498 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3a77bc79-5a1d-4670-baef-36df3b41b856 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:12.368014 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3a77bc79-5a1d-4670-baef-36df3b41b856 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:12.368523 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3a77bc79-5a1d-4670-baef-36df3b41b856 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:12.369286 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3a77bc79-5a1d-4670-baef-36df3b41b856 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:12.369716 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3a77bc79-5a1d-4670-baef-36df3b41b856 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:12.400825 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3a77bc79-5a1d-4670-baef-36df3b41b856 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043980 Jan 11 15:15:12.401504 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 385/784] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:12 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:12.628142 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d915079d-e832-4d2d-b0aa-35702a40a1ab tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:12.628755 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d915079d-e832-4d2d-b0aa-35702a40a1ab tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:12.635680 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d915079d-e832-4d2d-b0aa-35702a40a1ab tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:12.637583 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d915079d-e832-4d2d-b0aa-35702a40a1ab tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:12.637583 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d915079d-e832-4d2d-b0aa-35702a40a1ab tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:12.637583 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d915079d-e832-4d2d-b0aa-35702a40a1ab tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:12.770142 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-d915079d-e832-4d2d-b0aa-35702a40a1ab tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:12.778009 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d915079d-e832-4d2d-b0aa-35702a40a1ab tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.153540 Jan 11 15:15:12.778869 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 400/785] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:12 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:13.412346 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6b1fd702-a3ff-4eb1-a6f4-b22832c5eeb7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:13.413252 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6b1fd702-a3ff-4eb1-a6f4-b22832c5eeb7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:13.419951 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6b1fd702-a3ff-4eb1-a6f4-b22832c5eeb7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:13.420401 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6b1fd702-a3ff-4eb1-a6f4-b22832c5eeb7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:13.421171 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6b1fd702-a3ff-4eb1-a6f4-b22832c5eeb7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:13.421602 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6b1fd702-a3ff-4eb1-a6f4-b22832c5eeb7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:13.449203 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6b1fd702-a3ff-4eb1-a6f4-b22832c5eeb7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040591 Jan 11 15:15:13.449748 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 386/786] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:13 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:13.793550 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ea5a3e03-2840-4f0a-b23a-90dc5647e307 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:13.794194 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-ea5a3e03-2840-4f0a-b23a-90dc5647e307 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:13.800514 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ea5a3e03-2840-4f0a-b23a-90dc5647e307 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:13.800970 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ea5a3e03-2840-4f0a-b23a-90dc5647e307 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:13.801749 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ea5a3e03-2840-4f0a-b23a-90dc5647e307 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:13.802178 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ea5a3e03-2840-4f0a-b23a-90dc5647e307 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:13.927560 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-ea5a3e03-2840-4f0a-b23a-90dc5647e307 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:13.934738 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-ea5a3e03-2840-4f0a-b23a-90dc5647e307 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.144848 Jan 11 15:15:13.935326 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 401/787] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:13 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:14.461301 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c8a091eb-3524-4779-a5f4-61b4c5b506cc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:14.462165 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c8a091eb-3524-4779-a5f4-61b4c5b506cc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:14.468426 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c8a091eb-3524-4779-a5f4-61b4c5b506cc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:14.468879 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c8a091eb-3524-4779-a5f4-61b4c5b506cc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:14.469659 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c8a091eb-3524-4779-a5f4-61b4c5b506cc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:14.470098 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c8a091eb-3524-4779-a5f4-61b4c5b506cc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:14.499624 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c8a091eb-3524-4779-a5f4-61b4c5b506cc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042650 Jan 11 15:15:14.500165 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 387/788] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:14 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:14.950914 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b8d498d8-dc0b-4f73-8672-8fe059dda06a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:14.951552 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b8d498d8-dc0b-4f73-8672-8fe059dda06a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:14.957759 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b8d498d8-dc0b-4f73-8672-8fe059dda06a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:14.958209 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b8d498d8-dc0b-4f73-8672-8fe059dda06a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:14.958984 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b8d498d8-dc0b-4f73-8672-8fe059dda06a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:14.959462 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b8d498d8-dc0b-4f73-8672-8fe059dda06a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:15.087416 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-b8d498d8-dc0b-4f73-8672-8fe059dda06a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:15.094698 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b8d498d8-dc0b-4f73-8672-8fe059dda06a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.147405 Jan 11 15:15:15.095262 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 402/789] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:14 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:15.511135 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-46baf089-ae9f-4237-b8d2-fd5f7a61f53c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:15.512072 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-46baf089-ae9f-4237-b8d2-fd5f7a61f53c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:15.518264 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-46baf089-ae9f-4237-b8d2-fd5f7a61f53c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:15.518710 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-46baf089-ae9f-4237-b8d2-fd5f7a61f53c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:15.519515 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-46baf089-ae9f-4237-b8d2-fd5f7a61f53c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:15.519951 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-46baf089-ae9f-4237-b8d2-fd5f7a61f53c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:15.548523 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-46baf089-ae9f-4237-b8d2-fd5f7a61f53c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041606 Jan 11 15:15:15.549059 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 388/790] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:15 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:16.111979 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3ec59b73-e548-4874-a776-1d90cef06d2e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:16.112532 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3ec59b73-e548-4874-a776-1d90cef06d2e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:16.119405 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3ec59b73-e548-4874-a776-1d90cef06d2e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:16.119894 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3ec59b73-e548-4874-a776-1d90cef06d2e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:16.120686 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3ec59b73-e548-4874-a776-1d90cef06d2e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:16.121131 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3ec59b73-e548-4874-a776-1d90cef06d2e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:16.257213 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-3ec59b73-e548-4874-a776-1d90cef06d2e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:16.264740 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3ec59b73-e548-4874-a776-1d90cef06d2e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.156542 Jan 11 15:15:16.265234 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 403/791] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:16 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:16.560308 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f8a6aa4d-1438-463e-ab09-5d7d07d5bf50 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:16.561243 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f8a6aa4d-1438-463e-ab09-5d7d07d5bf50 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:16.567653 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f8a6aa4d-1438-463e-ab09-5d7d07d5bf50 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:16.568135 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f8a6aa4d-1438-463e-ab09-5d7d07d5bf50 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:16.568916 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f8a6aa4d-1438-463e-ab09-5d7d07d5bf50 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:16.569355 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f8a6aa4d-1438-463e-ab09-5d7d07d5bf50 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:16.598527 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f8a6aa4d-1438-463e-ab09-5d7d07d5bf50 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041953 Jan 11 15:15:16.599113 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 389/792] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:16 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:17.280579 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-0e7c1ba9-1dca-4931-94bc-a207a1f411f2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:17.281197 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-0e7c1ba9-1dca-4931-94bc-a207a1f411f2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:17.290757 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0e7c1ba9-1dca-4931-94bc-a207a1f411f2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:17.290757 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0e7c1ba9-1dca-4931-94bc-a207a1f411f2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:17.290757 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0e7c1ba9-1dca-4931-94bc-a207a1f411f2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:17.290757 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0e7c1ba9-1dca-4931-94bc-a207a1f411f2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:17.441708 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-0e7c1ba9-1dca-4931-94bc-a207a1f411f2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:17.448910 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-0e7c1ba9-1dca-4931-94bc-a207a1f411f2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.171991 Jan 11 15:15:17.449466 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 404/793] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:17 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:17.609832 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3a3e8c62-b258-40bc-a0ce-94dff0cf1732 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:17.610733 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3a3e8c62-b258-40bc-a0ce-94dff0cf1732 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:17.616879 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3a3e8c62-b258-40bc-a0ce-94dff0cf1732 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:17.617328 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3a3e8c62-b258-40bc-a0ce-94dff0cf1732 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:17.618097 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3a3e8c62-b258-40bc-a0ce-94dff0cf1732 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:17.618529 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3a3e8c62-b258-40bc-a0ce-94dff0cf1732 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:17.646390 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3a3e8c62-b258-40bc-a0ce-94dff0cf1732 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040292 Jan 11 15:15:17.646925 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 390/794] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:17 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:18.465969 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-fbb69219-3437-49e9-a982-35666c0db32f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:18.466571 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-fbb69219-3437-49e9-a982-35666c0db32f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:18.472833 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fbb69219-3437-49e9-a982-35666c0db32f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:18.473290 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fbb69219-3437-49e9-a982-35666c0db32f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:18.474074 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fbb69219-3437-49e9-a982-35666c0db32f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:18.474521 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fbb69219-3437-49e9-a982-35666c0db32f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:18.603320 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-fbb69219-3437-49e9-a982-35666c0db32f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:18.610482 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-fbb69219-3437-49e9-a982-35666c0db32f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.148288 Jan 11 15:15:18.611039 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 405/795] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:18 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:18.658028 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c0246ec8-c723-42fd-9d93-589610cb9944 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:18.658926 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c0246ec8-c723-42fd-9d93-589610cb9944 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:18.665150 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c0246ec8-c723-42fd-9d93-589610cb9944 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:18.665633 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c0246ec8-c723-42fd-9d93-589610cb9944 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:18.666327 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c0246ec8-c723-42fd-9d93-589610cb9944 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:18.666760 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c0246ec8-c723-42fd-9d93-589610cb9944 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:18.695671 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c0246ec8-c723-42fd-9d93-589610cb9944 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040667 Jan 11 15:15:18.696223 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 391/796] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:18 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:19.627052 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-0d0dd606-4ca7-4771-b2b3-fee9e17aa7f9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:19.627690 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-0d0dd606-4ca7-4771-b2b3-fee9e17aa7f9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:19.633953 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0d0dd606-4ca7-4771-b2b3-fee9e17aa7f9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:19.634411 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0d0dd606-4ca7-4771-b2b3-fee9e17aa7f9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:19.635185 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0d0dd606-4ca7-4771-b2b3-fee9e17aa7f9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:19.635649 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0d0dd606-4ca7-4771-b2b3-fee9e17aa7f9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:19.705951 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2d24e71b-d8a2-45ad-b66b-7b0ab1a23312 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:19.706941 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2d24e71b-d8a2-45ad-b66b-7b0ab1a23312 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:19.714253 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2d24e71b-d8a2-45ad-b66b-7b0ab1a23312 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:19.714701 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2d24e71b-d8a2-45ad-b66b-7b0ab1a23312 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:19.715498 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2d24e71b-d8a2-45ad-b66b-7b0ab1a23312 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:19.715930 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2d24e71b-d8a2-45ad-b66b-7b0ab1a23312 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:19.744928 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2d24e71b-d8a2-45ad-b66b-7b0ab1a23312 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042690 Jan 11 15:15:19.745493 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 392/797] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:19 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:15:19.763399 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-0d0dd606-4ca7-4771-b2b3-fee9e17aa7f9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:19.770573 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-0d0dd606-4ca7-4771-b2b3-fee9e17aa7f9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.147162 Jan 11 15:15:19.771128 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 406/798] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:19 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:15:20.756387 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6d044d4e-6163-418f-a996-c88207fa3c51 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:20.757295 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6d044d4e-6163-418f-a996-c88207fa3c51 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:20.763562 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6d044d4e-6163-418f-a996-c88207fa3c51 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:20.764075 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6d044d4e-6163-418f-a996-c88207fa3c51 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:20.764856 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6d044d4e-6163-418f-a996-c88207fa3c51 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:20.765330 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6d044d4e-6163-418f-a996-c88207fa3c51 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:20.787274 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-801c8eba-a327-4fe3-99c3-7f07c0c2d1e7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:20.787911 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-801c8eba-a327-4fe3-99c3-7f07c0c2d1e7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:20.794073 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6d044d4e-6163-418f-a996-c88207fa3c51 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041442 Jan 11 15:15:20.794513 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-801c8eba-a327-4fe3-99c3-7f07c0c2d1e7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:20.794956 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 393/799] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:20 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:20.795073 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-801c8eba-a327-4fe3-99c3-7f07c0c2d1e7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:20.795770 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-801c8eba-a327-4fe3-99c3-7f07c0c2d1e7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:20.796209 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-801c8eba-a327-4fe3-99c3-7f07c0c2d1e7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:20.927391 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-801c8eba-a327-4fe3-99c3-7f07c0c2d1e7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:20.934612 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-801c8eba-a327-4fe3-99c3-7f07c0c2d1e7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.151061 Jan 11 15:15:20.935399 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 407/800] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:20 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:15:21.806029 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1e2a5f9c-22e0-4732-99d0-1619b594e253 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:21.806935 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1e2a5f9c-22e0-4732-99d0-1619b594e253 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:21.813143 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1e2a5f9c-22e0-4732-99d0-1619b594e253 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:21.813596 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1e2a5f9c-22e0-4732-99d0-1619b594e253 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:21.814379 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1e2a5f9c-22e0-4732-99d0-1619b594e253 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:21.814822 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1e2a5f9c-22e0-4732-99d0-1619b594e253 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:21.843242 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1e2a5f9c-22e0-4732-99d0-1619b594e253 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041538 Jan 11 15:15:21.843824 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 394/801] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:21 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:21.951828 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ff86c72a-02b2-42a3-b07d-2a90a7c93ed9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:21.952434 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-ff86c72a-02b2-42a3-b07d-2a90a7c93ed9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:21.958568 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ff86c72a-02b2-42a3-b07d-2a90a7c93ed9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:21.959014 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ff86c72a-02b2-42a3-b07d-2a90a7c93ed9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:21.959805 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ff86c72a-02b2-42a3-b07d-2a90a7c93ed9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:21.960238 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ff86c72a-02b2-42a3-b07d-2a90a7c93ed9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:22.092219 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-ff86c72a-02b2-42a3-b07d-2a90a7c93ed9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:22.099374 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-ff86c72a-02b2-42a3-b07d-2a90a7c93ed9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.151145 Jan 11 15:15:22.099930 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 408/802] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:21 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:22.854389 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1c1db5b3-073c-4c91-b4a9-ed96df695743 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:22.855215 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1c1db5b3-073c-4c91-b4a9-ed96df695743 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:22.861489 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1c1db5b3-073c-4c91-b4a9-ed96df695743 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:22.861939 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1c1db5b3-073c-4c91-b4a9-ed96df695743 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:22.862718 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1c1db5b3-073c-4c91-b4a9-ed96df695743 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:22.863161 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1c1db5b3-073c-4c91-b4a9-ed96df695743 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:22.891756 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1c1db5b3-073c-4c91-b4a9-ed96df695743 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041615 Jan 11 15:15:22.892307 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 395/803] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:22 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:23.115241 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b60b68f8-a351-4081-84c2-ba5e80dc1211 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:23.115815 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b60b68f8-a351-4081-84c2-ba5e80dc1211 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:23.122713 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b60b68f8-a351-4081-84c2-ba5e80dc1211 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:23.123161 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b60b68f8-a351-4081-84c2-ba5e80dc1211 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:23.123969 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b60b68f8-a351-4081-84c2-ba5e80dc1211 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:23.124416 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b60b68f8-a351-4081-84c2-ba5e80dc1211 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:23.252818 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-b60b68f8-a351-4081-84c2-ba5e80dc1211 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:23.260088 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b60b68f8-a351-4081-84c2-ba5e80dc1211 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.148499 Jan 11 15:15:23.260853 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 409/804] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:23 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:23.902328 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b027b93c-51f8-462b-9759-285310569c8d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:23.903236 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b027b93c-51f8-462b-9759-285310569c8d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:23.909498 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b027b93c-51f8-462b-9759-285310569c8d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:23.909949 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b027b93c-51f8-462b-9759-285310569c8d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:23.910723 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b027b93c-51f8-462b-9759-285310569c8d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:23.911170 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b027b93c-51f8-462b-9759-285310569c8d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:23.945428 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b027b93c-51f8-462b-9759-285310569c8d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046233 Jan 11 15:15:23.945987 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 396/805] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:23 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:24.276341 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4cc0dea7-442e-4460-99bb-ccb2ff559a9a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:24.276986 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4cc0dea7-442e-4460-99bb-ccb2ff559a9a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:24.283184 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4cc0dea7-442e-4460-99bb-ccb2ff559a9a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:24.283683 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4cc0dea7-442e-4460-99bb-ccb2ff559a9a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:24.284457 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4cc0dea7-442e-4460-99bb-ccb2ff559a9a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:24.284905 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4cc0dea7-442e-4460-99bb-ccb2ff559a9a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:24.415585 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-4cc0dea7-442e-4460-99bb-ccb2ff559a9a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:24.422739 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4cc0dea7-442e-4460-99bb-ccb2ff559a9a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.150009 Jan 11 15:15:24.423321 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 410/806] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:24 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:24.955921 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-bf2a5029-2f08-43c5-a976-4e3266d754eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:24.956864 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-bf2a5029-2f08-43c5-a976-4e3266d754eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:24.963657 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bf2a5029-2f08-43c5-a976-4e3266d754eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:24.964102 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bf2a5029-2f08-43c5-a976-4e3266d754eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:24.964877 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bf2a5029-2f08-43c5-a976-4e3266d754eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:24.965313 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bf2a5029-2f08-43c5-a976-4e3266d754eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:24.994929 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-bf2a5029-2f08-43c5-a976-4e3266d754eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042714 Jan 11 15:15:24.995520 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 397/807] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:24 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:25.439444 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-0dfabc21-cbd3-4dc2-8d0b-7b6368498e6e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:25.440084 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-0dfabc21-cbd3-4dc2-8d0b-7b6368498e6e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:25.446472 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0dfabc21-cbd3-4dc2-8d0b-7b6368498e6e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:25.446921 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0dfabc21-cbd3-4dc2-8d0b-7b6368498e6e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:25.447730 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0dfabc21-cbd3-4dc2-8d0b-7b6368498e6e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:25.448168 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0dfabc21-cbd3-4dc2-8d0b-7b6368498e6e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:25.575537 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-0dfabc21-cbd3-4dc2-8d0b-7b6368498e6e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:25.582791 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-0dfabc21-cbd3-4dc2-8d0b-7b6368498e6e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.147003 Jan 11 15:15:25.583374 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 411/808] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:25 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:26.006146 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-edf51382-6ca0-4e78-a155-320b2cbe5adb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:26.007135 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-edf51382-6ca0-4e78-a155-320b2cbe5adb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:26.013345 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-edf51382-6ca0-4e78-a155-320b2cbe5adb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:26.013793 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-edf51382-6ca0-4e78-a155-320b2cbe5adb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:26.014562 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-edf51382-6ca0-4e78-a155-320b2cbe5adb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:26.014995 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-edf51382-6ca0-4e78-a155-320b2cbe5adb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:26.042912 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-edf51382-6ca0-4e78-a155-320b2cbe5adb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040459 Jan 11 15:15:26.043482 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 398/809] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:26 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:26.599627 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-9d3c8780-f75e-4521-9a82-92380af98316 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:26.600234 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-9d3c8780-f75e-4521-9a82-92380af98316 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:26.607055 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9d3c8780-f75e-4521-9a82-92380af98316 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:26.607518 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9d3c8780-f75e-4521-9a82-92380af98316 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:26.608297 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9d3c8780-f75e-4521-9a82-92380af98316 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:26.608729 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9d3c8780-f75e-4521-9a82-92380af98316 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:26.739549 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-9d3c8780-f75e-4521-9a82-92380af98316 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:26.747317 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-9d3c8780-f75e-4521-9a82-92380af98316 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.151336 Jan 11 15:15:26.747892 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 412/810] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:26 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:27.054022 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9ed1a0e4-7e8f-406e-8e93-c2a948cbd719 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:27.054938 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9ed1a0e4-7e8f-406e-8e93-c2a948cbd719 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:27.061209 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9ed1a0e4-7e8f-406e-8e93-c2a948cbd719 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:27.061668 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9ed1a0e4-7e8f-406e-8e93-c2a948cbd719 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:27.062448 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9ed1a0e4-7e8f-406e-8e93-c2a948cbd719 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:27.062892 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9ed1a0e4-7e8f-406e-8e93-c2a948cbd719 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:27.092738 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9ed1a0e4-7e8f-406e-8e93-c2a948cbd719 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042503 Jan 11 15:15:27.093322 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 399/811] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:27 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:27.763391 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c0f9cf27-3738-49c5-9946-0c9f751b65a2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:27.764006 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c0f9cf27-3738-49c5-9946-0c9f751b65a2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:27.770269 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c0f9cf27-3738-49c5-9946-0c9f751b65a2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:27.770724 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c0f9cf27-3738-49c5-9946-0c9f751b65a2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:27.771530 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c0f9cf27-3738-49c5-9946-0c9f751b65a2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:27.771973 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c0f9cf27-3738-49c5-9946-0c9f751b65a2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:27.899393 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-c0f9cf27-3738-49c5-9946-0c9f751b65a2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:27.906780 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c0f9cf27-3738-49c5-9946-0c9f751b65a2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.146944 Jan 11 15:15:27.907377 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 413/812] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:27 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:28.104330 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e2ef5fcc-de69-48dc-b47d-ded1cecf70a5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:28.105223 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e2ef5fcc-de69-48dc-b47d-ded1cecf70a5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:28.111894 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e2ef5fcc-de69-48dc-b47d-ded1cecf70a5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:28.112337 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e2ef5fcc-de69-48dc-b47d-ded1cecf70a5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:28.113121 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e2ef5fcc-de69-48dc-b47d-ded1cecf70a5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:28.113551 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e2ef5fcc-de69-48dc-b47d-ded1cecf70a5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:28.143390 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e2ef5fcc-de69-48dc-b47d-ded1cecf70a5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042748 Jan 11 15:15:28.143959 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 400/813] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:28 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:28.926873 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4932e082-2c42-4588-8b6e-311932d07867 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:28.927468 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4932e082-2c42-4588-8b6e-311932d07867 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:28.934223 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4932e082-2c42-4588-8b6e-311932d07867 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:28.934671 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4932e082-2c42-4588-8b6e-311932d07867 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:28.935484 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4932e082-2c42-4588-8b6e-311932d07867 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:28.935923 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4932e082-2c42-4588-8b6e-311932d07867 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:29.060818 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-4932e082-2c42-4588-8b6e-311932d07867 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:29.068068 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4932e082-2c42-4588-8b6e-311932d07867 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.144869 Jan 11 15:15:29.068638 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 414/814] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:28 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:29.154540 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2544dc23-f305-4719-8504-6df03c263141 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:29.155489 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2544dc23-f305-4719-8504-6df03c263141 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:29.161687 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2544dc23-f305-4719-8504-6df03c263141 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:29.162148 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2544dc23-f305-4719-8504-6df03c263141 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:29.164459 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2544dc23-f305-4719-8504-6df03c263141 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:29.164916 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2544dc23-f305-4719-8504-6df03c263141 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:29.197194 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2544dc23-f305-4719-8504-6df03c263141 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046246 Jan 11 15:15:29.198038 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 401/815] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:29 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:30.084679 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-88a1b6be-7528-429e-be1d-d6ad18321809 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:30.086068 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-88a1b6be-7528-429e-be1d-d6ad18321809 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:30.092260 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-88a1b6be-7528-429e-be1d-d6ad18321809 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:30.092711 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-88a1b6be-7528-429e-be1d-d6ad18321809 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:30.093485 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-88a1b6be-7528-429e-be1d-d6ad18321809 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:30.093918 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-88a1b6be-7528-429e-be1d-d6ad18321809 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:30.208438 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b1ea5901-befc-437e-8a1b-da801ac5f7fc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:30.209374 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b1ea5901-befc-437e-8a1b-da801ac5f7fc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:30.216273 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b1ea5901-befc-437e-8a1b-da801ac5f7fc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:30.216720 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b1ea5901-befc-437e-8a1b-da801ac5f7fc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:30.217524 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b1ea5901-befc-437e-8a1b-da801ac5f7fc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:30.218208 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b1ea5901-befc-437e-8a1b-da801ac5f7fc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:30.230489 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-88a1b6be-7528-429e-be1d-d6ad18321809 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:30.240574 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-88a1b6be-7528-429e-be1d-d6ad18321809 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.159372 Jan 11 15:15:30.241416 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 415/816] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:30 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:30.256911 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b1ea5901-befc-437e-8a1b-da801ac5f7fc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052246 Jan 11 15:15:30.257599 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 402/817] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:30 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:15:31.257113 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-fa57d64d-9a90-41c3-9e7b-ab1c493bdbf0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:31.273063 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-fa57d64d-9a90-41c3-9e7b-ab1c493bdbf0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:31.273063 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fa57d64d-9a90-41c3-9e7b-ab1c493bdbf0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:31.273063 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fa57d64d-9a90-41c3-9e7b-ab1c493bdbf0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:31.273063 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fa57d64d-9a90-41c3-9e7b-ab1c493bdbf0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:31.274172 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fa57d64d-9a90-41c3-9e7b-ab1c493bdbf0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:31.274269 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-728832b7-44dc-4818-8a46-6757967bc792 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:31.274269 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-728832b7-44dc-4818-8a46-6757967bc792 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:31.277702 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-728832b7-44dc-4818-8a46-6757967bc792 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:31.278155 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-728832b7-44dc-4818-8a46-6757967bc792 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:31.278940 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-728832b7-44dc-4818-8a46-6757967bc792 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:31.279415 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-728832b7-44dc-4818-8a46-6757967bc792 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:31.315587 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-728832b7-44dc-4818-8a46-6757967bc792 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045623 Jan 11 15:15:31.315587 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 403/818] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:31 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:15:31.395560 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-fa57d64d-9a90-41c3-9e7b-ab1c493bdbf0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:31.402818 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-fa57d64d-9a90-41c3-9e7b-ab1c493bdbf0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.149533 Jan 11 15:15:31.403588 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 416/819] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:31 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:32.321191 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1721c2df-0739-46a8-b9ba-360d18625590 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:32.322106 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1721c2df-0739-46a8-b9ba-360d18625590 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:32.328394 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1721c2df-0739-46a8-b9ba-360d18625590 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:32.328840 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1721c2df-0739-46a8-b9ba-360d18625590 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:32.329616 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1721c2df-0739-46a8-b9ba-360d18625590 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:32.330054 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1721c2df-0739-46a8-b9ba-360d18625590 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:32.359406 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1721c2df-0739-46a8-b9ba-360d18625590 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042142 Jan 11 15:15:32.359948 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 404/820] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:32 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:32.419488 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-01be7b3f-bb4e-4c32-a070-c70839f6f624 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:32.420104 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-01be7b3f-bb4e-4c32-a070-c70839f6f624 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:32.426448 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-01be7b3f-bb4e-4c32-a070-c70839f6f624 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:32.426907 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-01be7b3f-bb4e-4c32-a070-c70839f6f624 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:32.427715 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-01be7b3f-bb4e-4c32-a070-c70839f6f624 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:32.428158 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-01be7b3f-bb4e-4c32-a070-c70839f6f624 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:32.557237 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-01be7b3f-bb4e-4c32-a070-c70839f6f624 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:32.564389 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-01be7b3f-bb4e-4c32-a070-c70839f6f624 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.148442 Jan 11 15:15:32.564957 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 417/821] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:32 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:33.370491 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-814a6431-c283-49fb-bddb-acb81635e896 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:33.371443 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-814a6431-c283-49fb-bddb-acb81635e896 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:33.377664 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-814a6431-c283-49fb-bddb-acb81635e896 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:33.378115 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-814a6431-c283-49fb-bddb-acb81635e896 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:33.378908 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-814a6431-c283-49fb-bddb-acb81635e896 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:33.379370 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-814a6431-c283-49fb-bddb-acb81635e896 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:33.407952 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-814a6431-c283-49fb-bddb-acb81635e896 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041144 Jan 11 15:15:33.408501 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 405/822] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:33 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:33.579821 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7408e0a4-d971-4b18-9fa1-557a7a403c52 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:33.580370 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7408e0a4-d971-4b18-9fa1-557a7a403c52 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:33.587317 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7408e0a4-d971-4b18-9fa1-557a7a403c52 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:33.587766 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7408e0a4-d971-4b18-9fa1-557a7a403c52 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:33.588580 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7408e0a4-d971-4b18-9fa1-557a7a403c52 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:33.589024 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7408e0a4-d971-4b18-9fa1-557a7a403c52 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:33.715647 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-7408e0a4-d971-4b18-9fa1-557a7a403c52 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:33.722922 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7408e0a4-d971-4b18-9fa1-557a7a403c52 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.146865 Jan 11 15:15:33.723512 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 418/823] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:33 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:34.419154 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0330b171-ef7d-4829-bdfa-791897919b20 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:34.420092 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0330b171-ef7d-4829-bdfa-791897919b20 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:34.426646 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0330b171-ef7d-4829-bdfa-791897919b20 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:34.426855 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0330b171-ef7d-4829-bdfa-791897919b20 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:34.427696 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0330b171-ef7d-4829-bdfa-791897919b20 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:34.428145 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0330b171-ef7d-4829-bdfa-791897919b20 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:34.457116 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0330b171-ef7d-4829-bdfa-791897919b20 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041704 Jan 11 15:15:34.457664 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 406/824] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:34 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:34.739661 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d1c2875b-67de-40e6-808f-67fbe97ae0c9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:34.740297 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d1c2875b-67de-40e6-808f-67fbe97ae0c9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:34.747070 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d1c2875b-67de-40e6-808f-67fbe97ae0c9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:34.747546 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d1c2875b-67de-40e6-808f-67fbe97ae0c9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:34.748313 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d1c2875b-67de-40e6-808f-67fbe97ae0c9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:34.748744 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d1c2875b-67de-40e6-808f-67fbe97ae0c9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:34.877452 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-d1c2875b-67de-40e6-808f-67fbe97ae0c9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:34.885221 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d1c2875b-67de-40e6-808f-67fbe97ae0c9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.149184 Jan 11 15:15:34.885815 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 419/825] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:34 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:35.469003 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c63d8a05-e0b5-43fd-bca1-85f14bb81e0b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:35.469913 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c63d8a05-e0b5-43fd-bca1-85f14bb81e0b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:35.476809 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c63d8a05-e0b5-43fd-bca1-85f14bb81e0b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:35.477262 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c63d8a05-e0b5-43fd-bca1-85f14bb81e0b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:35.478051 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c63d8a05-e0b5-43fd-bca1-85f14bb81e0b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:35.478491 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c63d8a05-e0b5-43fd-bca1-85f14bb81e0b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:35.506774 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c63d8a05-e0b5-43fd-bca1-85f14bb81e0b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041439 Jan 11 15:15:35.507381 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 407/826] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:35 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:35.901438 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-56344e00-fd12-4bb7-a898-3789a987d626 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:35.901991 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-56344e00-fd12-4bb7-a898-3789a987d626 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:35.909064 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-56344e00-fd12-4bb7-a898-3789a987d626 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:35.909517 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-56344e00-fd12-4bb7-a898-3789a987d626 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:35.910298 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-56344e00-fd12-4bb7-a898-3789a987d626 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:35.910737 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-56344e00-fd12-4bb7-a898-3789a987d626 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:36.038671 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-56344e00-fd12-4bb7-a898-3789a987d626 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:36.045879 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-56344e00-fd12-4bb7-a898-3789a987d626 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.148156 Jan 11 15:15:36.046456 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 420/827] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:35 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:36.517734 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e706c0b9-1929-48b4-ac72-047b57f78fe1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:36.518600 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e706c0b9-1929-48b4-ac72-047b57f78fe1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:36.525419 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e706c0b9-1929-48b4-ac72-047b57f78fe1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:36.525865 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e706c0b9-1929-48b4-ac72-047b57f78fe1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:36.526634 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e706c0b9-1929-48b4-ac72-047b57f78fe1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:36.527066 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e706c0b9-1929-48b4-ac72-047b57f78fe1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:36.554888 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e706c0b9-1929-48b4-ac72-047b57f78fe1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040870 Jan 11 15:15:36.555464 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 408/828] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:36 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:37.061497 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-340dd243-00bb-445a-b793-be017ec8d8cd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:37.062107 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-340dd243-00bb-445a-b793-be017ec8d8cd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:37.068488 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-340dd243-00bb-445a-b793-be017ec8d8cd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:37.068936 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-340dd243-00bb-445a-b793-be017ec8d8cd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:37.069703 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-340dd243-00bb-445a-b793-be017ec8d8cd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:37.070140 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-340dd243-00bb-445a-b793-be017ec8d8cd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:37.197679 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-340dd243-00bb-445a-b793-be017ec8d8cd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:37.204825 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-340dd243-00bb-445a-b793-be017ec8d8cd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.146925 Jan 11 15:15:37.205378 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 421/829] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:37 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:37.565708 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9218ada5-f8e9-4f26-90d8-510b33e87b1c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:37.566615 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9218ada5-f8e9-4f26-90d8-510b33e87b1c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:37.573296 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9218ada5-f8e9-4f26-90d8-510b33e87b1c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:37.573746 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9218ada5-f8e9-4f26-90d8-510b33e87b1c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:37.574527 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9218ada5-f8e9-4f26-90d8-510b33e87b1c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:37.574969 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9218ada5-f8e9-4f26-90d8-510b33e87b1c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:37.604344 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9218ada5-f8e9-4f26-90d8-510b33e87b1c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042330 Jan 11 15:15:37.604890 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 409/830] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:37 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:38.221587 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-af55e34b-8e84-4e96-af44-336aad0b8341 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:38.222182 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-af55e34b-8e84-4e96-af44-336aad0b8341 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:38.228726 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-af55e34b-8e84-4e96-af44-336aad0b8341 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:38.229171 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-af55e34b-8e84-4e96-af44-336aad0b8341 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:38.229941 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-af55e34b-8e84-4e96-af44-336aad0b8341 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:38.230377 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-af55e34b-8e84-4e96-af44-336aad0b8341 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:38.363142 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-af55e34b-8e84-4e96-af44-336aad0b8341 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:38.370996 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-af55e34b-8e84-4e96-af44-336aad0b8341 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.153088 Jan 11 15:15:38.371588 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 422/831] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:38 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:38.615375 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b9447a77-e3d3-4903-a317-ddfc90d363c7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:38.616867 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b9447a77-e3d3-4903-a317-ddfc90d363c7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:38.622546 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b9447a77-e3d3-4903-a317-ddfc90d363c7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:38.623002 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b9447a77-e3d3-4903-a317-ddfc90d363c7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:38.623811 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b9447a77-e3d3-4903-a317-ddfc90d363c7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:38.624256 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b9447a77-e3d3-4903-a317-ddfc90d363c7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:38.652868 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b9447a77-e3d3-4903-a317-ddfc90d363c7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041196 Jan 11 15:15:38.653420 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 410/832] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:38 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:39.387739 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a06e19c8-8e55-4fd8-9733-d504803c196e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:39.388390 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a06e19c8-8e55-4fd8-9733-d504803c196e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:39.394619 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a06e19c8-8e55-4fd8-9733-d504803c196e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:39.395066 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a06e19c8-8e55-4fd8-9733-d504803c196e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:39.395863 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a06e19c8-8e55-4fd8-9733-d504803c196e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:39.396298 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a06e19c8-8e55-4fd8-9733-d504803c196e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:39.523930 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-a06e19c8-8e55-4fd8-9733-d504803c196e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:39.531065 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a06e19c8-8e55-4fd8-9733-d504803c196e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.147205 Jan 11 15:15:39.531657 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 423/833] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:39 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:39.664669 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-06562ffe-b049-49ff-ad46-7f08ceeea8da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:39.665572 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-06562ffe-b049-49ff-ad46-7f08ceeea8da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:39.671783 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-06562ffe-b049-49ff-ad46-7f08ceeea8da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:39.672493 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-06562ffe-b049-49ff-ad46-7f08ceeea8da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:39.679879 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-06562ffe-b049-49ff-ad46-7f08ceeea8da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:39.680383 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-06562ffe-b049-49ff-ad46-7f08ceeea8da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:39.709442 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-06562ffe-b049-49ff-ad46-7f08ceeea8da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049069 Jan 11 15:15:39.710268 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 411/834] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:39 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:40.548766 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-bcfc46e4-1581-419e-b877-7c9d10d4c52f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:40.549480 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-bcfc46e4-1581-419e-b877-7c9d10d4c52f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:40.556803 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bcfc46e4-1581-419e-b877-7c9d10d4c52f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:40.557251 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bcfc46e4-1581-419e-b877-7c9d10d4c52f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:40.558020 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bcfc46e4-1581-419e-b877-7c9d10d4c52f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:40.558453 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bcfc46e4-1581-419e-b877-7c9d10d4c52f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:40.689290 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-bcfc46e4-1581-419e-b877-7c9d10d4c52f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:40.703386 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-bcfc46e4-1581-419e-b877-7c9d10d4c52f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.152401 Jan 11 15:15:40.703386 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 424/835] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:40 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:40.721825 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-294f00c5-8e93-421b-9e5b-35bd00fa81b4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:40.721825 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-294f00c5-8e93-421b-9e5b-35bd00fa81b4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:40.728662 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-294f00c5-8e93-421b-9e5b-35bd00fa81b4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:40.729112 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-294f00c5-8e93-421b-9e5b-35bd00fa81b4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:40.729886 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-294f00c5-8e93-421b-9e5b-35bd00fa81b4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:40.730320 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-294f00c5-8e93-421b-9e5b-35bd00fa81b4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:40.758349 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-294f00c5-8e93-421b-9e5b-35bd00fa81b4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041526 Jan 11 15:15:40.758898 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 412/836] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:40 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:41.712800 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-bacea2f3-c344-489b-8e86-049f730083c8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:41.713410 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-bacea2f3-c344-489b-8e86-049f730083c8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:41.719707 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bacea2f3-c344-489b-8e86-049f730083c8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:41.720087 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bacea2f3-c344-489b-8e86-049f730083c8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:41.720862 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bacea2f3-c344-489b-8e86-049f730083c8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:41.721299 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bacea2f3-c344-489b-8e86-049f730083c8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:41.769508 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a32828cd-be54-4e7a-b253-5bc2a455f839 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:41.770809 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a32828cd-be54-4e7a-b253-5bc2a455f839 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:41.777142 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a32828cd-be54-4e7a-b253-5bc2a455f839 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:41.777697 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a32828cd-be54-4e7a-b253-5bc2a455f839 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:41.778493 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a32828cd-be54-4e7a-b253-5bc2a455f839 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:41.778935 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a32828cd-be54-4e7a-b253-5bc2a455f839 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:41.808413 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a32828cd-be54-4e7a-b253-5bc2a455f839 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042508 Jan 11 15:15:41.812189 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 413/837] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:41 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:15:41.849506 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-bacea2f3-c344-489b-8e86-049f730083c8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:41.857194 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-bacea2f3-c344-489b-8e86-049f730083c8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.148317 Jan 11 15:15:41.857757 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 425/838] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:41 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:42.819879 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-65c9f183-58a4-475b-9c79-c640de22b5f9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:42.820789 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-65c9f183-58a4-475b-9c79-c640de22b5f9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:42.827020 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-65c9f183-58a4-475b-9c79-c640de22b5f9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:42.827517 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-65c9f183-58a4-475b-9c79-c640de22b5f9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:42.828290 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-65c9f183-58a4-475b-9c79-c640de22b5f9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:42.828726 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-65c9f183-58a4-475b-9c79-c640de22b5f9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:42.857071 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-65c9f183-58a4-475b-9c79-c640de22b5f9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041456 Jan 11 15:15:42.857619 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 414/839] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:42 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:42.873549 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a1646a7f-19e0-4151-b574-132773f7240c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:42.874156 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a1646a7f-19e0-4151-b574-132773f7240c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:42.880416 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a1646a7f-19e0-4151-b574-132773f7240c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:42.880939 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a1646a7f-19e0-4151-b574-132773f7240c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:42.882424 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a1646a7f-19e0-4151-b574-132773f7240c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:42.882922 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a1646a7f-19e0-4151-b574-132773f7240c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:43.012645 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-a1646a7f-19e0-4151-b574-132773f7240c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:43.019944 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a1646a7f-19e0-4151-b574-132773f7240c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.150082 Jan 11 15:15:43.020517 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 426/840] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:42 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:43.868201 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9634b699-f92e-4cbb-9cdf-b1238944b63b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:43.869104 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9634b699-f92e-4cbb-9cdf-b1238944b63b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:43.875308 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9634b699-f92e-4cbb-9cdf-b1238944b63b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:43.875762 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9634b699-f92e-4cbb-9cdf-b1238944b63b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:43.876526 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9634b699-f92e-4cbb-9cdf-b1238944b63b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:43.876964 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9634b699-f92e-4cbb-9cdf-b1238944b63b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:43.906475 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9634b699-f92e-4cbb-9cdf-b1238944b63b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041842 Jan 11 15:15:43.909443 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 415/841] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:43 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:44.036490 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b07aa65c-1677-48fb-9406-843ea53a3067 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:44.037133 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b07aa65c-1677-48fb-9406-843ea53a3067 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:44.043952 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b07aa65c-1677-48fb-9406-843ea53a3067 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:44.044588 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b07aa65c-1677-48fb-9406-843ea53a3067 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:44.045433 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b07aa65c-1677-48fb-9406-843ea53a3067 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:44.045806 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b07aa65c-1677-48fb-9406-843ea53a3067 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:44.175916 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-b07aa65c-1677-48fb-9406-843ea53a3067 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:44.183752 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b07aa65c-1677-48fb-9406-843ea53a3067 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.150905 Jan 11 15:15:44.184313 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 427/842] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:44 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:44.918415 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-199d34c5-a8e1-46b6-931b-1465f82ad69e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:44.919382 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-199d34c5-a8e1-46b6-931b-1465f82ad69e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:44.925718 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-199d34c5-a8e1-46b6-931b-1465f82ad69e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:44.926182 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-199d34c5-a8e1-46b6-931b-1465f82ad69e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:44.926966 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-199d34c5-a8e1-46b6-931b-1465f82ad69e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:44.927496 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-199d34c5-a8e1-46b6-931b-1465f82ad69e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:44.956384 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-199d34c5-a8e1-46b6-931b-1465f82ad69e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041916 Jan 11 15:15:44.956980 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 416/843] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:44 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:45.199833 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-69bda829-a1cc-4bbe-994c-0284bd0c8d4e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:45.200377 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-69bda829-a1cc-4bbe-994c-0284bd0c8d4e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:45.206466 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-69bda829-a1cc-4bbe-994c-0284bd0c8d4e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:45.206912 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-69bda829-a1cc-4bbe-994c-0284bd0c8d4e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:45.207710 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-69bda829-a1cc-4bbe-994c-0284bd0c8d4e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:45.208149 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-69bda829-a1cc-4bbe-994c-0284bd0c8d4e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:45.336361 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-69bda829-a1cc-4bbe-994c-0284bd0c8d4e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:45.343521 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-69bda829-a1cc-4bbe-994c-0284bd0c8d4e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.147279 Jan 11 15:15:45.344084 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 428/844] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:45 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:45.889380 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-3990a7a9-5fab-4517-9fef-4c76ad6760b0 req-6b271367-5a22-4b18-89af-eb280e2e3750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "347a0a52-47fa-4799-97ca-551bc356aca0", "name": "network-vif-plugged", "status": "completed", "tag": "8250fb01-566c-404c-940f-8347fdacb6b4"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:15:45.890882 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:15:45.890882 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:15:45.898483 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-3990a7a9-5fab-4517-9fef-4c76ad6760b0 req-6b271367-5a22-4b18-89af-eb280e2e3750 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:45.898931 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-3990a7a9-5fab-4517-9fef-4c76ad6760b0 req-6b271367-5a22-4b18-89af-eb280e2e3750 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:45.909727 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-3990a7a9-5fab-4517-9fef-4c76ad6760b0 req-6b271367-5a22-4b18-89af-eb280e2e3750 service nova] Creating event network-vif-plugged:8250fb01-566c-404c-940f-8347fdacb6b4 for instance 347a0a52-47fa-4799-97ca-551bc356aca0 on hv-cinder-82418 Jan 11 15:15:45.915476 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [req-3990a7a9-5fab-4517-9fef-4c76ad6760b0 req-6b271367-5a22-4b18-89af-eb280e2e3750 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029566 Jan 11 15:15:45.916055 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 417/845] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:45.968173 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2573686b-b18e-4cfc-bae8-a976e1cb3eec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:45.969115 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2573686b-b18e-4cfc-bae8-a976e1cb3eec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:45.975327 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2573686b-b18e-4cfc-bae8-a976e1cb3eec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:45.975813 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2573686b-b18e-4cfc-bae8-a976e1cb3eec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:45.977132 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2573686b-b18e-4cfc-bae8-a976e1cb3eec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:45.977569 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2573686b-b18e-4cfc-bae8-a976e1cb3eec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:46.013487 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2573686b-b18e-4cfc-bae8-a976e1cb3eec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049162 Jan 11 15:15:46.014131 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 429/846] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:45 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:46.361318 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e5fda14b-d679-49d4-917f-68d9bf1d59db tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:46.362016 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e5fda14b-d679-49d4-917f-68d9bf1d59db tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:46.368783 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e5fda14b-d679-49d4-917f-68d9bf1d59db tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:46.369238 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e5fda14b-d679-49d4-917f-68d9bf1d59db tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:46.370014 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e5fda14b-d679-49d4-917f-68d9bf1d59db tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:46.370455 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e5fda14b-d679-49d4-917f-68d9bf1d59db tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:46.498457 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e5fda14b-d679-49d4-917f-68d9bf1d59db tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:46.505662 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e5fda14b-d679-49d4-917f-68d9bf1d59db tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.148784 Jan 11 15:15:46.506233 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 418/847] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:46 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:47.025456 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ca9a65fb-72ca-40b3-81a1-595d745ea423 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:47.026365 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-ca9a65fb-72ca-40b3-81a1-595d745ea423 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:47.032498 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ca9a65fb-72ca-40b3-81a1-595d745ea423 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:47.032945 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ca9a65fb-72ca-40b3-81a1-595d745ea423 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:47.033710 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ca9a65fb-72ca-40b3-81a1-595d745ea423 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:47.034145 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ca9a65fb-72ca-40b3-81a1-595d745ea423 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:47.062720 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-ca9a65fb-72ca-40b3-81a1-595d745ea423 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041639 Jan 11 15:15:47.063228 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 430/848] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:47 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:47.521602 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-32e161b9-040e-436f-ac57-c458381bdce9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:47.522663 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-32e161b9-040e-436f-ac57-c458381bdce9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:47.528881 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-32e161b9-040e-436f-ac57-c458381bdce9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:47.529330 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-32e161b9-040e-436f-ac57-c458381bdce9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:47.530106 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-32e161b9-040e-436f-ac57-c458381bdce9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:47.530595 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-32e161b9-040e-436f-ac57-c458381bdce9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:47.662404 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-32e161b9-040e-436f-ac57-c458381bdce9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:47.669646 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-32e161b9-040e-436f-ac57-c458381bdce9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1261 microversion: 2.1 time: 0.151760 Jan 11 15:15:47.670205 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 419/849] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:47 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:48.073597 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e56b5473-5ad5-47fd-9fa0-d81552ecdfd6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:48.074502 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e56b5473-5ad5-47fd-9fa0-d81552ecdfd6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:48.080743 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e56b5473-5ad5-47fd-9fa0-d81552ecdfd6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:48.081192 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e56b5473-5ad5-47fd-9fa0-d81552ecdfd6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:48.081963 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e56b5473-5ad5-47fd-9fa0-d81552ecdfd6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:48.082397 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e56b5473-5ad5-47fd-9fa0-d81552ecdfd6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:48.113686 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e56b5473-5ad5-47fd-9fa0-d81552ecdfd6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043852 Jan 11 15:15:48.114254 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 431/850] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:48 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:48.685508 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d7f18ea0-58f6-451a-8d14-b544787c8939 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:48.686136 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d7f18ea0-58f6-451a-8d14-b544787c8939 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:48.692381 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d7f18ea0-58f6-451a-8d14-b544787c8939 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:48.692827 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d7f18ea0-58f6-451a-8d14-b544787c8939 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:48.694097 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d7f18ea0-58f6-451a-8d14-b544787c8939 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:48.694768 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d7f18ea0-58f6-451a-8d14-b544787c8939 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:48.824121 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d7f18ea0-58f6-451a-8d14-b544787c8939 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:48.831282 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d7f18ea0-58f6-451a-8d14-b544787c8939 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1445 microversion: 2.1 time: 0.149388 Jan 11 15:15:48.831884 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 420/851] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:48 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1445 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:48.848305 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-bbf15ea2-437b-4fb1-a9ba-83c1239e923d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:48.848917 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-bbf15ea2-437b-4fb1-a9ba-83c1239e923d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:48.854679 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bbf15ea2-437b-4fb1-a9ba-83c1239e923d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:48.855131 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bbf15ea2-437b-4fb1-a9ba-83c1239e923d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:48.855936 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bbf15ea2-437b-4fb1-a9ba-83c1239e923d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:48.856375 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bbf15ea2-437b-4fb1-a9ba-83c1239e923d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:48.983032 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-bbf15ea2-437b-4fb1-a9ba-83c1239e923d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:15:48.990212 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-bbf15ea2-437b-4fb1-a9ba-83c1239e923d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1445 microversion: 2.1 time: 0.145490 Jan 11 15:15:48.990773 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 432/852] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:15:48 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1445 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:15:49.125071 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-36b86ac0-c2c1-4a2d-a17d-ec62e699f84c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:49.126177 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-36b86ac0-c2c1-4a2d-a17d-ec62e699f84c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:49.132445 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-36b86ac0-c2c1-4a2d-a17d-ec62e699f84c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:49.132895 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-36b86ac0-c2c1-4a2d-a17d-ec62e699f84c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:49.133675 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-36b86ac0-c2c1-4a2d-a17d-ec62e699f84c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:49.134116 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-36b86ac0-c2c1-4a2d-a17d-ec62e699f84c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:49.164239 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-36b86ac0-c2c1-4a2d-a17d-ec62e699f84c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042832 Jan 11 15:15:49.165130 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 421/853] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:49 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:50.175870 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-185a6065-aecd-4653-b044-b4ce924078f1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:50.176726 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-185a6065-aecd-4653-b044-b4ce924078f1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:50.183493 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-185a6065-aecd-4653-b044-b4ce924078f1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:50.189967 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-185a6065-aecd-4653-b044-b4ce924078f1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:50.189967 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-185a6065-aecd-4653-b044-b4ce924078f1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:50.189967 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-185a6065-aecd-4653-b044-b4ce924078f1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:50.215696 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-185a6065-aecd-4653-b044-b4ce924078f1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043522 Jan 11 15:15:50.216489 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 433/854] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:50 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:51.030380 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-2f82d0eb-8276-4fd5-b404-8c0ea64fb9fe req-f6afa610-12b1-462f-a780-35eb3a75009d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "347a0a52-47fa-4799-97ca-551bc356aca0", "tag": "8250fb01-566c-404c-940f-8347fdacb6b4"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:15:51.031898 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:15:51.031898 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:15:51.040729 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-2f82d0eb-8276-4fd5-b404-8c0ea64fb9fe req-f6afa610-12b1-462f-a780-35eb3a75009d service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:51.040729 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-2f82d0eb-8276-4fd5-b404-8c0ea64fb9fe req-f6afa610-12b1-462f-a780-35eb3a75009d service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:51.050662 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-2f82d0eb-8276-4fd5-b404-8c0ea64fb9fe req-f6afa610-12b1-462f-a780-35eb3a75009d service nova] Creating event network-changed:8250fb01-566c-404c-940f-8347fdacb6b4 for instance 347a0a52-47fa-4799-97ca-551bc356aca0 on hv-cinder-82418 Jan 11 15:15:51.056266 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [req-2f82d0eb-8276-4fd5-b404-8c0ea64fb9fe req-f6afa610-12b1-462f-a780-35eb3a75009d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029368 Jan 11 15:15:51.057025 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 422/855] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:51.227625 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-aa2ab438-6789-44d4-a260-1fa31026195b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:51.229220 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-aa2ab438-6789-44d4-a260-1fa31026195b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:51.235559 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-aa2ab438-6789-44d4-a260-1fa31026195b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:51.236007 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-aa2ab438-6789-44d4-a260-1fa31026195b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:51.236965 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-aa2ab438-6789-44d4-a260-1fa31026195b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:51.239092 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-aa2ab438-6789-44d4-a260-1fa31026195b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:51.274894 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-aa2ab438-6789-44d4-a260-1fa31026195b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051390 Jan 11 15:15:51.279537 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 434/856] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:51 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:52.287578 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-807cb6a7-21fd-4be1-9885-77521db35c23 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:52.288612 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-807cb6a7-21fd-4be1-9885-77521db35c23 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:52.294598 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-807cb6a7-21fd-4be1-9885-77521db35c23 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:52.295053 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-807cb6a7-21fd-4be1-9885-77521db35c23 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:52.295857 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-807cb6a7-21fd-4be1-9885-77521db35c23 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:52.296299 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-807cb6a7-21fd-4be1-9885-77521db35c23 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:52.325385 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-807cb6a7-21fd-4be1-9885-77521db35c23 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042400 Jan 11 15:15:52.325947 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 423/857] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:52 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:53.337441 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-77547ba7-6037-415c-9453-e41142630608 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:53.338351 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-77547ba7-6037-415c-9453-e41142630608 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:53.344638 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-77547ba7-6037-415c-9453-e41142630608 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:53.345087 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-77547ba7-6037-415c-9453-e41142630608 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:53.345854 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-77547ba7-6037-415c-9453-e41142630608 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:53.346288 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-77547ba7-6037-415c-9453-e41142630608 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:53.374897 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-77547ba7-6037-415c-9453-e41142630608 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041996 Jan 11 15:15:53.375618 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 435/858] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:53 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:54.386405 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2679eddb-57dd-454a-a095-d5761eb27107 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:54.387320 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2679eddb-57dd-454a-a095-d5761eb27107 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:54.393531 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2679eddb-57dd-454a-a095-d5761eb27107 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:54.393979 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2679eddb-57dd-454a-a095-d5761eb27107 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:54.394755 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2679eddb-57dd-454a-a095-d5761eb27107 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:54.395193 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2679eddb-57dd-454a-a095-d5761eb27107 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:54.425030 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2679eddb-57dd-454a-a095-d5761eb27107 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042400 Jan 11 15:15:54.427257 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 424/859] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:54 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:55.435422 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-80e1e9f4-a22a-4e61-9bad-481a1925ae14 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:55.436327 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-80e1e9f4-a22a-4e61-9bad-481a1925ae14 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:55.442452 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-80e1e9f4-a22a-4e61-9bad-481a1925ae14 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:55.442905 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-80e1e9f4-a22a-4e61-9bad-481a1925ae14 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:55.443743 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-80e1e9f4-a22a-4e61-9bad-481a1925ae14 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:55.444202 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-80e1e9f4-a22a-4e61-9bad-481a1925ae14 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:55.473789 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-80e1e9f4-a22a-4e61-9bad-481a1925ae14 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042058 Jan 11 15:15:55.474338 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 436/860] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:55 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:56.485455 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-bc683d6e-a77b-4552-9312-cceaf40a2846 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:56.486457 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-bc683d6e-a77b-4552-9312-cceaf40a2846 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:56.492771 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bc683d6e-a77b-4552-9312-cceaf40a2846 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:56.493222 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bc683d6e-a77b-4552-9312-cceaf40a2846 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:56.494001 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bc683d6e-a77b-4552-9312-cceaf40a2846 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:56.494443 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bc683d6e-a77b-4552-9312-cceaf40a2846 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:56.523154 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-bc683d6e-a77b-4552-9312-cceaf40a2846 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041384 Jan 11 15:15:56.523768 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 425/861] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:56 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:15:57.534034 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-1a3ea35a-31ae-4b42-9283-2c60ee4745ed tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:57.534943 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-1a3ea35a-31ae-4b42-9283-2c60ee4745ed tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:57.541082 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1a3ea35a-31ae-4b42-9283-2c60ee4745ed tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:57.541529 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1a3ea35a-31ae-4b42-9283-2c60ee4745ed tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:57.542297 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1a3ea35a-31ae-4b42-9283-2c60ee4745ed tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:57.542730 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1a3ea35a-31ae-4b42-9283-2c60ee4745ed tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:57.572117 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-1a3ea35a-31ae-4b42-9283-2c60ee4745ed tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041807 Jan 11 15:15:57.572680 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 437/862] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:57 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:58.583265 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b3a29f68-ec5f-48b3-9b37-ebafb260c5b6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:58.584196 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b3a29f68-ec5f-48b3-9b37-ebafb260c5b6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:58.590766 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b3a29f68-ec5f-48b3-9b37-ebafb260c5b6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:58.591222 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b3a29f68-ec5f-48b3-9b37-ebafb260c5b6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:58.592028 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b3a29f68-ec5f-48b3-9b37-ebafb260c5b6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:58.592472 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b3a29f68-ec5f-48b3-9b37-ebafb260c5b6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:58.621294 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b3a29f68-ec5f-48b3-9b37-ebafb260c5b6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041742 Jan 11 15:15:58.621841 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 426/863] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:58 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:15:59.632427 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a9ef2774-9796-48f6-828f-f38094dd7f97 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:15:59.633381 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a9ef2774-9796-48f6-828f-f38094dd7f97 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:15:59.639766 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a9ef2774-9796-48f6-828f-f38094dd7f97 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:59.640222 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a9ef2774-9796-48f6-828f-f38094dd7f97 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:59.641003 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a9ef2774-9796-48f6-828f-f38094dd7f97 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:15:59.641443 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a9ef2774-9796-48f6-828f-f38094dd7f97 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:15:59.670867 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a9ef2774-9796-48f6-828f-f38094dd7f97 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042123 Jan 11 15:15:59.671466 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 438/864] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:15:59 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:00.681914 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1ea185ec-49f9-4612-8866-4aba844c4d9b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:00.682832 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1ea185ec-49f9-4612-8866-4aba844c4d9b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:00.689067 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1ea185ec-49f9-4612-8866-4aba844c4d9b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:00.690463 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1ea185ec-49f9-4612-8866-4aba844c4d9b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:00.690463 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1ea185ec-49f9-4612-8866-4aba844c4d9b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:00.690703 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1ea185ec-49f9-4612-8866-4aba844c4d9b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:00.720455 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1ea185ec-49f9-4612-8866-4aba844c4d9b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042183 Jan 11 15:16:00.721014 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 427/865] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:00 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:01.733656 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-61249fb5-10b7-4785-8031-1ad44d7b0374 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:01.734607 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-61249fb5-10b7-4785-8031-1ad44d7b0374 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:01.740838 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-61249fb5-10b7-4785-8031-1ad44d7b0374 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:01.741292 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-61249fb5-10b7-4785-8031-1ad44d7b0374 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:01.742071 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-61249fb5-10b7-4785-8031-1ad44d7b0374 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:01.742510 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-61249fb5-10b7-4785-8031-1ad44d7b0374 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:01.770934 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-61249fb5-10b7-4785-8031-1ad44d7b0374 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040910 Jan 11 15:16:01.771510 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 439/866] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:01 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:02.781723 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d79e6985-82a8-408b-8318-921ba07cd1b8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:02.782892 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d79e6985-82a8-408b-8318-921ba07cd1b8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:02.789478 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d79e6985-82a8-408b-8318-921ba07cd1b8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:02.790194 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d79e6985-82a8-408b-8318-921ba07cd1b8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:02.791214 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d79e6985-82a8-408b-8318-921ba07cd1b8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:02.791986 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d79e6985-82a8-408b-8318-921ba07cd1b8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:02.823690 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d79e6985-82a8-408b-8318-921ba07cd1b8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045606 Jan 11 15:16:02.824350 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 428/867] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:02 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:03.836026 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-259ebb96-884d-4ee7-94d1-3540c39e54e2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:03.836822 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-259ebb96-884d-4ee7-94d1-3540c39e54e2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:03.842924 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-259ebb96-884d-4ee7-94d1-3540c39e54e2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:03.843417 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-259ebb96-884d-4ee7-94d1-3540c39e54e2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:03.844192 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-259ebb96-884d-4ee7-94d1-3540c39e54e2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:03.844633 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-259ebb96-884d-4ee7-94d1-3540c39e54e2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:03.873461 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-259ebb96-884d-4ee7-94d1-3540c39e54e2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041982 Jan 11 15:16:03.874016 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 440/868] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:03 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:04.885640 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-121f7acf-1811-4dc6-823e-43884521c7bf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:04.886601 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-121f7acf-1811-4dc6-823e-43884521c7bf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:04.893367 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-121f7acf-1811-4dc6-823e-43884521c7bf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:04.893826 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-121f7acf-1811-4dc6-823e-43884521c7bf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:04.894634 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-121f7acf-1811-4dc6-823e-43884521c7bf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:04.895078 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-121f7acf-1811-4dc6-823e-43884521c7bf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:04.935732 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-121f7acf-1811-4dc6-823e-43884521c7bf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046113 Jan 11 15:16:04.935732 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 429/869] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:04 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:05.944995 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-006065e3-1d99-4980-88d2-678809ae3d3e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:05.945900 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-006065e3-1d99-4980-88d2-678809ae3d3e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:05.952066 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-006065e3-1d99-4980-88d2-678809ae3d3e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:05.952514 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-006065e3-1d99-4980-88d2-678809ae3d3e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:05.953279 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-006065e3-1d99-4980-88d2-678809ae3d3e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:05.953714 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-006065e3-1d99-4980-88d2-678809ae3d3e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:05.982327 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-006065e3-1d99-4980-88d2-678809ae3d3e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041566 Jan 11 15:16:05.982883 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 441/870] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:05 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:06.972103 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:16:06.972579 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: Tue Jan 11 15:16:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:16:07.173498 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-bc0dabb6-71d8-4620-aef4-3f17fb3f7fe3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:07.174564 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-bc0dabb6-71d8-4620-aef4-3f17fb3f7fe3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:07.181215 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bc0dabb6-71d8-4620-aef4-3f17fb3f7fe3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:07.181767 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bc0dabb6-71d8-4620-aef4-3f17fb3f7fe3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:07.182563 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bc0dabb6-71d8-4620-aef4-3f17fb3f7fe3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:07.183054 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bc0dabb6-71d8-4620-aef4-3f17fb3f7fe3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:07.212179 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-bc0dabb6-71d8-4620-aef4-3f17fb3f7fe3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.223279 Jan 11 15:16:07.212724 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 430/871] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:06 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:16:08.223083 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d03b965c-5360-4ffe-9ecd-ade5b952256b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:08.224099 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d03b965c-5360-4ffe-9ecd-ade5b952256b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:08.230132 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d03b965c-5360-4ffe-9ecd-ade5b952256b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:08.230579 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d03b965c-5360-4ffe-9ecd-ade5b952256b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:08.231410 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d03b965c-5360-4ffe-9ecd-ade5b952256b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:08.231847 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d03b965c-5360-4ffe-9ecd-ade5b952256b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:08.265728 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d03b965c-5360-4ffe-9ecd-ade5b952256b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042014 Jan 11 15:16:08.265728 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 442/872] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:08 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:09.275734 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6a272139-a0d2-48ac-81d1-6b9a7ef9b9e1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:09.276710 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6a272139-a0d2-48ac-81d1-6b9a7ef9b9e1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:09.283087 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6a272139-a0d2-48ac-81d1-6b9a7ef9b9e1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:09.283652 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6a272139-a0d2-48ac-81d1-6b9a7ef9b9e1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:09.284500 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6a272139-a0d2-48ac-81d1-6b9a7ef9b9e1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:09.285003 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6a272139-a0d2-48ac-81d1-6b9a7ef9b9e1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:09.313812 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6a272139-a0d2-48ac-81d1-6b9a7ef9b9e1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042506 Jan 11 15:16:09.314359 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 431/873] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:09 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:10.324961 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-14aea0fc-b6c7-4cb6-9014-b24ed1d57eea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:10.325911 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-14aea0fc-b6c7-4cb6-9014-b24ed1d57eea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:10.332433 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-14aea0fc-b6c7-4cb6-9014-b24ed1d57eea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:10.332888 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-14aea0fc-b6c7-4cb6-9014-b24ed1d57eea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:10.333660 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-14aea0fc-b6c7-4cb6-9014-b24ed1d57eea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:10.334095 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-14aea0fc-b6c7-4cb6-9014-b24ed1d57eea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:10.365987 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-14aea0fc-b6c7-4cb6-9014-b24ed1d57eea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044666 Jan 11 15:16:10.366706 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 443/874] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:10 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:11.377183 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-95d9ea7a-a26d-4a6f-906c-a8725818fa63 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:11.378084 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-95d9ea7a-a26d-4a6f-906c-a8725818fa63 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:11.384395 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-95d9ea7a-a26d-4a6f-906c-a8725818fa63 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:11.384842 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-95d9ea7a-a26d-4a6f-906c-a8725818fa63 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:11.391928 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-95d9ea7a-a26d-4a6f-906c-a8725818fa63 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:11.391928 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-95d9ea7a-a26d-4a6f-906c-a8725818fa63 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:11.416854 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-95d9ea7a-a26d-4a6f-906c-a8725818fa63 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043363 Jan 11 15:16:11.417426 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 432/875] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:11 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:12.430222 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4850e8ca-9ca3-4f11-93e1-f1d865579a54 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:12.431156 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4850e8ca-9ca3-4f11-93e1-f1d865579a54 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:12.437570 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4850e8ca-9ca3-4f11-93e1-f1d865579a54 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:12.438021 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4850e8ca-9ca3-4f11-93e1-f1d865579a54 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:12.438900 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4850e8ca-9ca3-4f11-93e1-f1d865579a54 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:12.439369 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4850e8ca-9ca3-4f11-93e1-f1d865579a54 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:12.469653 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4850e8ca-9ca3-4f11-93e1-f1d865579a54 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044926 Jan 11 15:16:12.470387 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 444/876] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:12 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:13.481000 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e07f93d1-c6be-4713-9231-c28b6dc1f1eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:13.481912 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e07f93d1-c6be-4713-9231-c28b6dc1f1eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:13.488017 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e07f93d1-c6be-4713-9231-c28b6dc1f1eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:13.488474 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e07f93d1-c6be-4713-9231-c28b6dc1f1eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:13.489270 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e07f93d1-c6be-4713-9231-c28b6dc1f1eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:13.489712 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e07f93d1-c6be-4713-9231-c28b6dc1f1eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:13.520228 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e07f93d1-c6be-4713-9231-c28b6dc1f1eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042952 Jan 11 15:16:13.520801 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 433/877] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:13 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:14.531918 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-8ac3e7f4-736a-4dcc-9839-913dfb4acf1b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:14.532830 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-8ac3e7f4-736a-4dcc-9839-913dfb4acf1b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:14.539563 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8ac3e7f4-736a-4dcc-9839-913dfb4acf1b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:14.540110 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8ac3e7f4-736a-4dcc-9839-913dfb4acf1b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:14.540899 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8ac3e7f4-736a-4dcc-9839-913dfb4acf1b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:14.541340 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8ac3e7f4-736a-4dcc-9839-913dfb4acf1b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:14.569968 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-8ac3e7f4-736a-4dcc-9839-913dfb4acf1b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041690 Jan 11 15:16:14.570521 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 445/878] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:14 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:15.580969 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-66234730-6721-4d2a-935f-32bdc066c4d1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:15.581880 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-66234730-6721-4d2a-935f-32bdc066c4d1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:15.588582 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-66234730-6721-4d2a-935f-32bdc066c4d1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:15.589033 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-66234730-6721-4d2a-935f-32bdc066c4d1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:15.589801 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-66234730-6721-4d2a-935f-32bdc066c4d1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:15.590234 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-66234730-6721-4d2a-935f-32bdc066c4d1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:15.619786 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-66234730-6721-4d2a-935f-32bdc066c4d1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042413 Jan 11 15:16:15.620343 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 434/879] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:15 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:16.630935 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-5cfc762d-19c2-4768-b894-cd5718c0165f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:16.632495 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-5cfc762d-19c2-4768-b894-cd5718c0165f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:16.638602 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5cfc762d-19c2-4768-b894-cd5718c0165f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:16.639060 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5cfc762d-19c2-4768-b894-cd5718c0165f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:16.639882 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5cfc762d-19c2-4768-b894-cd5718c0165f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:16.640326 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5cfc762d-19c2-4768-b894-cd5718c0165f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:16.668970 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-5cfc762d-19c2-4768-b894-cd5718c0165f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041771 Jan 11 15:16:16.669639 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 446/880] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:16 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:17.679895 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-abaa1b49-5895-46e9-8f81-7df404175cda tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:17.680861 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-abaa1b49-5895-46e9-8f81-7df404175cda tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:17.686967 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-abaa1b49-5895-46e9-8f81-7df404175cda tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:17.687461 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-abaa1b49-5895-46e9-8f81-7df404175cda tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:17.688275 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-abaa1b49-5895-46e9-8f81-7df404175cda tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:17.688718 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-abaa1b49-5895-46e9-8f81-7df404175cda tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:17.718683 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-abaa1b49-5895-46e9-8f81-7df404175cda tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042483 Jan 11 15:16:17.719242 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 435/881] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:17 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:18.730207 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-01abebcc-d4eb-4c0c-8ef5-d5bda09863d7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:18.731211 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-01abebcc-d4eb-4c0c-8ef5-d5bda09863d7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:18.737702 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-01abebcc-d4eb-4c0c-8ef5-d5bda09863d7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:18.737963 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-01abebcc-d4eb-4c0c-8ef5-d5bda09863d7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:18.738687 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-01abebcc-d4eb-4c0c-8ef5-d5bda09863d7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:18.739126 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-01abebcc-d4eb-4c0c-8ef5-d5bda09863d7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:18.769677 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-01abebcc-d4eb-4c0c-8ef5-d5bda09863d7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043178 Jan 11 15:16:18.770235 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 447/882] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:18 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:16:19.780791 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8b1ea409-3135-4b0e-91bb-5e4b0a7de49f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:19.781784 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8b1ea409-3135-4b0e-91bb-5e4b0a7de49f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:19.795529 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8b1ea409-3135-4b0e-91bb-5e4b0a7de49f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:19.795529 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8b1ea409-3135-4b0e-91bb-5e4b0a7de49f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:19.795529 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8b1ea409-3135-4b0e-91bb-5e4b0a7de49f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:19.795529 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8b1ea409-3135-4b0e-91bb-5e4b0a7de49f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:19.822607 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8b1ea409-3135-4b0e-91bb-5e4b0a7de49f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045806 Jan 11 15:16:19.823384 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 436/883] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:19 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:20.833776 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-38f31fe4-04f4-472e-937e-ec104f5d3c91 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:20.835744 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-38f31fe4-04f4-472e-937e-ec104f5d3c91 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:20.842755 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-38f31fe4-04f4-472e-937e-ec104f5d3c91 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:20.843212 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-38f31fe4-04f4-472e-937e-ec104f5d3c91 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:20.844035 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-38f31fe4-04f4-472e-937e-ec104f5d3c91 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:20.844479 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-38f31fe4-04f4-472e-937e-ec104f5d3c91 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:20.873618 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-38f31fe4-04f4-472e-937e-ec104f5d3c91 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042665 Jan 11 15:16:20.873618 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 448/884] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:20 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:21.884446 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1e29c23c-b0f7-4c82-a119-46d4759fd3ed tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:21.885348 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1e29c23c-b0f7-4c82-a119-46d4759fd3ed tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:21.891352 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1e29c23c-b0f7-4c82-a119-46d4759fd3ed tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:21.891805 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1e29c23c-b0f7-4c82-a119-46d4759fd3ed tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:21.892584 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1e29c23c-b0f7-4c82-a119-46d4759fd3ed tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:21.893020 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1e29c23c-b0f7-4c82-a119-46d4759fd3ed tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:21.921067 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1e29c23c-b0f7-4c82-a119-46d4759fd3ed tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040873 Jan 11 15:16:21.921612 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 437/885] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:21 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:22.932144 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7a4da22d-194f-4cd6-b269-775bff8ad9c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:22.933109 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7a4da22d-194f-4cd6-b269-775bff8ad9c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:22.939205 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7a4da22d-194f-4cd6-b269-775bff8ad9c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:22.939689 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7a4da22d-194f-4cd6-b269-775bff8ad9c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:22.940468 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7a4da22d-194f-4cd6-b269-775bff8ad9c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:22.940945 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7a4da22d-194f-4cd6-b269-775bff8ad9c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:22.970966 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7a4da22d-194f-4cd6-b269-775bff8ad9c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042486 Jan 11 15:16:22.971543 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 449/886] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:22 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:23.981597 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a28c0d2c-3d58-4a52-bdd8-e6b79db221a6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:23.982537 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a28c0d2c-3d58-4a52-bdd8-e6b79db221a6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:23.988780 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a28c0d2c-3d58-4a52-bdd8-e6b79db221a6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:23.989235 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a28c0d2c-3d58-4a52-bdd8-e6b79db221a6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:23.990013 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a28c0d2c-3d58-4a52-bdd8-e6b79db221a6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:23.990452 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a28c0d2c-3d58-4a52-bdd8-e6b79db221a6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:24.018906 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a28c0d2c-3d58-4a52-bdd8-e6b79db221a6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040994 Jan 11 15:16:24.019486 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 438/887] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:23 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:25.029898 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-fcc13178-8b4d-403a-807c-372749e5e9d9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:25.030811 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-fcc13178-8b4d-403a-807c-372749e5e9d9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:25.036793 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fcc13178-8b4d-403a-807c-372749e5e9d9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:25.037241 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fcc13178-8b4d-403a-807c-372749e5e9d9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:25.038319 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fcc13178-8b4d-403a-807c-372749e5e9d9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:25.038761 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fcc13178-8b4d-403a-807c-372749e5e9d9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:25.067419 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-fcc13178-8b4d-403a-807c-372749e5e9d9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041446 Jan 11 15:16:25.068157 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 450/888] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:25 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:26.078916 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1ab46987-b2c3-459d-bea3-57836bdc1bbd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:26.080016 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1ab46987-b2c3-459d-bea3-57836bdc1bbd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:26.087375 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1ab46987-b2c3-459d-bea3-57836bdc1bbd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:26.087834 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1ab46987-b2c3-459d-bea3-57836bdc1bbd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:26.088628 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1ab46987-b2c3-459d-bea3-57836bdc1bbd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:26.089073 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1ab46987-b2c3-459d-bea3-57836bdc1bbd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:26.117758 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1ab46987-b2c3-459d-bea3-57836bdc1bbd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042508 Jan 11 15:16:26.118323 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 439/889] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:26 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:27.128775 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-aa16adf7-cf44-4ac5-b18d-33b4abb426db tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:27.129682 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-aa16adf7-cf44-4ac5-b18d-33b4abb426db tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:27.135841 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-aa16adf7-cf44-4ac5-b18d-33b4abb426db tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:27.136291 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-aa16adf7-cf44-4ac5-b18d-33b4abb426db tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:27.137066 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-aa16adf7-cf44-4ac5-b18d-33b4abb426db tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:27.137502 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-aa16adf7-cf44-4ac5-b18d-33b4abb426db tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:27.166554 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-aa16adf7-cf44-4ac5-b18d-33b4abb426db tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041492 Jan 11 15:16:27.167106 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 451/890] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:27 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:28.177491 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-490aea7b-f68f-4db1-9835-ce9e86351295 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:28.179027 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-490aea7b-f68f-4db1-9835-ce9e86351295 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:28.185210 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-490aea7b-f68f-4db1-9835-ce9e86351295 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:28.185660 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-490aea7b-f68f-4db1-9835-ce9e86351295 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:28.186430 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-490aea7b-f68f-4db1-9835-ce9e86351295 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:28.186864 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-490aea7b-f68f-4db1-9835-ce9e86351295 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:28.215125 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-490aea7b-f68f-4db1-9835-ce9e86351295 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041245 Jan 11 15:16:28.215712 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 440/891] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:28 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:29.226235 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-edc70e94-58f5-4e6f-87aa-75e7f66638be tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:29.227237 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-edc70e94-58f5-4e6f-87aa-75e7f66638be tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:29.235338 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-edc70e94-58f5-4e6f-87aa-75e7f66638be tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:29.235338 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-edc70e94-58f5-4e6f-87aa-75e7f66638be tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:29.235338 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-edc70e94-58f5-4e6f-87aa-75e7f66638be tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:29.235673 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-edc70e94-58f5-4e6f-87aa-75e7f66638be tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:29.265430 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-edc70e94-58f5-4e6f-87aa-75e7f66638be tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043287 Jan 11 15:16:29.265954 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 452/892] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:29 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:30.277182 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a1ec435c-bb76-4dc6-98f2-407cc786d5ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:30.278193 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a1ec435c-bb76-4dc6-98f2-407cc786d5ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:30.284518 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a1ec435c-bb76-4dc6-98f2-407cc786d5ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:30.284973 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a1ec435c-bb76-4dc6-98f2-407cc786d5ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:30.285755 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a1ec435c-bb76-4dc6-98f2-407cc786d5ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:30.286189 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a1ec435c-bb76-4dc6-98f2-407cc786d5ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:30.316215 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a1ec435c-bb76-4dc6-98f2-407cc786d5ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043095 Jan 11 15:16:30.316778 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 441/893] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:30 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:31.327687 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f9d9a550-b9d7-455b-a259-c6c6041a3cea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:31.328708 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f9d9a550-b9d7-455b-a259-c6c6041a3cea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:31.335178 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f9d9a550-b9d7-455b-a259-c6c6041a3cea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:31.335663 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f9d9a550-b9d7-455b-a259-c6c6041a3cea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:31.336995 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f9d9a550-b9d7-455b-a259-c6c6041a3cea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:31.337435 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f9d9a550-b9d7-455b-a259-c6c6041a3cea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:31.368144 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f9d9a550-b9d7-455b-a259-c6c6041a3cea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044428 Jan 11 15:16:31.368729 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 453/894] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:31 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:32.378975 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5071f0d7-55d0-4953-959e-2d8ab62c288a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:32.379913 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5071f0d7-55d0-4953-959e-2d8ab62c288a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:32.386716 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5071f0d7-55d0-4953-959e-2d8ab62c288a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:32.387169 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5071f0d7-55d0-4953-959e-2d8ab62c288a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:32.388003 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5071f0d7-55d0-4953-959e-2d8ab62c288a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:32.388453 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5071f0d7-55d0-4953-959e-2d8ab62c288a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:32.416705 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5071f0d7-55d0-4953-959e-2d8ab62c288a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041345 Jan 11 15:16:32.417257 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 442/895] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:32 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:33.427709 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-6e4d1cf5-06d0-4b55-a478-9a94d9f530e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:33.428565 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-6e4d1cf5-06d0-4b55-a478-9a94d9f530e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:33.434654 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6e4d1cf5-06d0-4b55-a478-9a94d9f530e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:33.435110 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6e4d1cf5-06d0-4b55-a478-9a94d9f530e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:33.435929 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6e4d1cf5-06d0-4b55-a478-9a94d9f530e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:33.436370 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6e4d1cf5-06d0-4b55-a478-9a94d9f530e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:33.466146 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-6e4d1cf5-06d0-4b55-a478-9a94d9f530e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042148 Jan 11 15:16:33.466692 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 454/896] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:33 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:34.476959 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4d2e1e0d-cf46-4229-868c-767279c74079 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:34.477883 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-4d2e1e0d-cf46-4229-868c-767279c74079 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:34.484130 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4d2e1e0d-cf46-4229-868c-767279c74079 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:34.484586 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4d2e1e0d-cf46-4229-868c-767279c74079 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:34.485375 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4d2e1e0d-cf46-4229-868c-767279c74079 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:34.485818 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4d2e1e0d-cf46-4229-868c-767279c74079 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:34.514518 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4d2e1e0d-cf46-4229-868c-767279c74079 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041334 Jan 11 15:16:34.515100 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 443/897] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:34 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:35.525117 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-9a7895cf-3f3e-4d5c-92e5-08dba0a78f8c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:35.526027 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-9a7895cf-3f3e-4d5c-92e5-08dba0a78f8c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:35.532174 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9a7895cf-3f3e-4d5c-92e5-08dba0a78f8c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:35.532621 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9a7895cf-3f3e-4d5c-92e5-08dba0a78f8c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:35.533393 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9a7895cf-3f3e-4d5c-92e5-08dba0a78f8c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:35.533834 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9a7895cf-3f3e-4d5c-92e5-08dba0a78f8c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:35.563172 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-9a7895cf-3f3e-4d5c-92e5-08dba0a78f8c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042245 Jan 11 15:16:35.563748 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 455/898] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:35 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:36.573608 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c0cc9526-1aef-4fbb-89d6-85125cce9e87 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:36.574551 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c0cc9526-1aef-4fbb-89d6-85125cce9e87 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:36.580754 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c0cc9526-1aef-4fbb-89d6-85125cce9e87 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:36.581212 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c0cc9526-1aef-4fbb-89d6-85125cce9e87 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:36.581995 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c0cc9526-1aef-4fbb-89d6-85125cce9e87 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:36.582446 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c0cc9526-1aef-4fbb-89d6-85125cce9e87 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:36.612209 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c0cc9526-1aef-4fbb-89d6-85125cce9e87 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042261 Jan 11 15:16:36.612773 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 444/899] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:36 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:37.623653 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f7706503-3054-40c5-96cf-2b80a10d08d0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:37.624560 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f7706503-3054-40c5-96cf-2b80a10d08d0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:37.630975 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f7706503-3054-40c5-96cf-2b80a10d08d0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:37.631615 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f7706503-3054-40c5-96cf-2b80a10d08d0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:37.633190 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f7706503-3054-40c5-96cf-2b80a10d08d0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:37.633608 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f7706503-3054-40c5-96cf-2b80a10d08d0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:37.661615 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f7706503-3054-40c5-96cf-2b80a10d08d0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041650 Jan 11 15:16:37.662148 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 456/900] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:37 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:38.672853 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4e7e85a2-caaa-4c9a-8881-43ae10c89a38 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:38.674038 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-4e7e85a2-caaa-4c9a-8881-43ae10c89a38 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:38.680543 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4e7e85a2-caaa-4c9a-8881-43ae10c89a38 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:38.680997 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4e7e85a2-caaa-4c9a-8881-43ae10c89a38 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:38.681816 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4e7e85a2-caaa-4c9a-8881-43ae10c89a38 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:38.682517 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4e7e85a2-caaa-4c9a-8881-43ae10c89a38 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:38.716465 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4e7e85a2-caaa-4c9a-8881-43ae10c89a38 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047278 Jan 11 15:16:38.717028 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 445/901] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:38 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:39.728193 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-6d06b24c-f18f-449e-ae83-a874ecc701e3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:39.729125 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-6d06b24c-f18f-449e-ae83-a874ecc701e3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:39.735589 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6d06b24c-f18f-449e-ae83-a874ecc701e3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:39.736044 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6d06b24c-f18f-449e-ae83-a874ecc701e3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:39.736821 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6d06b24c-f18f-449e-ae83-a874ecc701e3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:39.737259 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6d06b24c-f18f-449e-ae83-a874ecc701e3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:39.765759 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-6d06b24c-f18f-449e-ae83-a874ecc701e3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041944 Jan 11 15:16:39.766304 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 457/902] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:39 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:40.778789 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3c75d3bf-de54-4ef4-b9c5-7efd8021f514 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:40.778789 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3c75d3bf-de54-4ef4-b9c5-7efd8021f514 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:40.784174 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c75d3bf-de54-4ef4-b9c5-7efd8021f514 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:40.784645 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c75d3bf-de54-4ef4-b9c5-7efd8021f514 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:40.785420 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c75d3bf-de54-4ef4-b9c5-7efd8021f514 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:40.785857 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c75d3bf-de54-4ef4-b9c5-7efd8021f514 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:40.813832 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3c75d3bf-de54-4ef4-b9c5-7efd8021f514 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040589 Jan 11 15:16:40.814373 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 446/903] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:40 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:41.825428 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-83d74cca-b47d-40c4-9332-f0d62c5e668d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:41.826352 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-83d74cca-b47d-40c4-9332-f0d62c5e668d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:41.832531 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-83d74cca-b47d-40c4-9332-f0d62c5e668d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:41.832982 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-83d74cca-b47d-40c4-9332-f0d62c5e668d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:41.834024 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-83d74cca-b47d-40c4-9332-f0d62c5e668d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:41.834461 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-83d74cca-b47d-40c4-9332-f0d62c5e668d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:41.862683 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-83d74cca-b47d-40c4-9332-f0d62c5e668d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040977 Jan 11 15:16:41.863213 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 458/904] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:41 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:42.873736 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6c479968-b6ba-4f19-b9b0-d5a720514d24 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:42.874638 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6c479968-b6ba-4f19-b9b0-d5a720514d24 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:42.880794 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6c479968-b6ba-4f19-b9b0-d5a720514d24 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:42.881242 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6c479968-b6ba-4f19-b9b0-d5a720514d24 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:42.882007 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6c479968-b6ba-4f19-b9b0-d5a720514d24 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:42.883066 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6c479968-b6ba-4f19-b9b0-d5a720514d24 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:42.910530 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6c479968-b6ba-4f19-b9b0-d5a720514d24 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040582 Jan 11 15:16:42.911073 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 447/905] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:42 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:43.921539 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-fa99fd91-3371-4ab8-ae8e-738810e2a545 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:43.922459 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-fa99fd91-3371-4ab8-ae8e-738810e2a545 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:43.928663 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fa99fd91-3371-4ab8-ae8e-738810e2a545 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:43.929121 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fa99fd91-3371-4ab8-ae8e-738810e2a545 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:43.929903 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fa99fd91-3371-4ab8-ae8e-738810e2a545 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:43.930346 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fa99fd91-3371-4ab8-ae8e-738810e2a545 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:43.958966 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-fa99fd91-3371-4ab8-ae8e-738810e2a545 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040861 Jan 11 15:16:43.959560 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 459/906] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:43 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:44.969831 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-20cd49e0-d129-40ca-9c41-752bf716e954 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:44.970775 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-20cd49e0-d129-40ca-9c41-752bf716e954 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:44.977626 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-20cd49e0-d129-40ca-9c41-752bf716e954 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:44.978082 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-20cd49e0-d129-40ca-9c41-752bf716e954 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:44.978864 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-20cd49e0-d129-40ca-9c41-752bf716e954 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:44.979326 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-20cd49e0-d129-40ca-9c41-752bf716e954 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:45.008166 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-20cd49e0-d129-40ca-9c41-752bf716e954 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042087 Jan 11 15:16:45.008765 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 448/907] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:44 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:46.018594 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-9691c09b-2581-42ba-a78f-1892aa81887d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:46.019537 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-9691c09b-2581-42ba-a78f-1892aa81887d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:46.025714 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9691c09b-2581-42ba-a78f-1892aa81887d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:46.026169 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9691c09b-2581-42ba-a78f-1892aa81887d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:46.026940 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9691c09b-2581-42ba-a78f-1892aa81887d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:46.027414 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9691c09b-2581-42ba-a78f-1892aa81887d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:46.055537 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-9691c09b-2581-42ba-a78f-1892aa81887d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040655 Jan 11 15:16:46.056075 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 460/908] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:46 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:47.066557 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e6017e1c-5e3c-48b4-93a7-0391765cca17 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:47.067491 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e6017e1c-5e3c-48b4-93a7-0391765cca17 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:47.073665 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e6017e1c-5e3c-48b4-93a7-0391765cca17 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:47.074117 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e6017e1c-5e3c-48b4-93a7-0391765cca17 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:47.074891 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e6017e1c-5e3c-48b4-93a7-0391765cca17 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:47.075363 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e6017e1c-5e3c-48b4-93a7-0391765cca17 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:47.103841 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e6017e1c-5e3c-48b4-93a7-0391765cca17 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041016 Jan 11 15:16:47.104393 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 449/909] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:47 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:48.114374 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-9c3c3847-aa89-4d56-8664-a910be3aa164 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:48.115306 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-9c3c3847-aa89-4d56-8664-a910be3aa164 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:48.122148 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9c3c3847-aa89-4d56-8664-a910be3aa164 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:48.122603 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9c3c3847-aa89-4d56-8664-a910be3aa164 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:48.123411 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9c3c3847-aa89-4d56-8664-a910be3aa164 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:48.123856 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9c3c3847-aa89-4d56-8664-a910be3aa164 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:48.152022 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-9c3c3847-aa89-4d56-8664-a910be3aa164 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041391 Jan 11 15:16:48.152566 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 461/910] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:48 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:49.162933 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a068ea32-7520-4fa7-b191-ea7080555eca tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:49.164371 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a068ea32-7520-4fa7-b191-ea7080555eca tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:49.170484 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a068ea32-7520-4fa7-b191-ea7080555eca tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:49.170931 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a068ea32-7520-4fa7-b191-ea7080555eca tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:49.171739 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a068ea32-7520-4fa7-b191-ea7080555eca tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:49.172177 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a068ea32-7520-4fa7-b191-ea7080555eca tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:49.200349 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a068ea32-7520-4fa7-b191-ea7080555eca tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041232 Jan 11 15:16:49.200888 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 450/911] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:49 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:50.212100 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a2f602af-151d-47f7-b9a3-03cebb2252c8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:50.213002 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a2f602af-151d-47f7-b9a3-03cebb2252c8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:50.219074 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a2f602af-151d-47f7-b9a3-03cebb2252c8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:50.219548 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a2f602af-151d-47f7-b9a3-03cebb2252c8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:50.220312 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a2f602af-151d-47f7-b9a3-03cebb2252c8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:50.220746 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a2f602af-151d-47f7-b9a3-03cebb2252c8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:50.248547 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a2f602af-151d-47f7-b9a3-03cebb2252c8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040963 Jan 11 15:16:50.249096 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 462/912] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:50 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:51.259776 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-84cef15b-4655-4ebb-8ce3-fc9b73d30fd3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:51.260755 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-84cef15b-4655-4ebb-8ce3-fc9b73d30fd3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:51.267064 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-84cef15b-4655-4ebb-8ce3-fc9b73d30fd3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:51.267556 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-84cef15b-4655-4ebb-8ce3-fc9b73d30fd3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:51.268377 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-84cef15b-4655-4ebb-8ce3-fc9b73d30fd3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:51.268813 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-84cef15b-4655-4ebb-8ce3-fc9b73d30fd3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:51.297851 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-84cef15b-4655-4ebb-8ce3-fc9b73d30fd3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041794 Jan 11 15:16:51.298398 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 451/913] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:51 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:52.309914 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-cb11b07e-3421-43ff-ae2e-b571cf3d678e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:52.310903 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-cb11b07e-3421-43ff-ae2e-b571cf3d678e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:52.317133 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cb11b07e-3421-43ff-ae2e-b571cf3d678e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:52.317586 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cb11b07e-3421-43ff-ae2e-b571cf3d678e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:52.318361 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cb11b07e-3421-43ff-ae2e-b571cf3d678e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:52.318801 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cb11b07e-3421-43ff-ae2e-b571cf3d678e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:52.346692 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-cb11b07e-3421-43ff-ae2e-b571cf3d678e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040724 Jan 11 15:16:52.347227 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 463/914] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:52 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:53.357700 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-206af4b8-3a10-4d48-851a-2a25c8edc68d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:53.358613 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-206af4b8-3a10-4d48-851a-2a25c8edc68d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:53.364515 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-206af4b8-3a10-4d48-851a-2a25c8edc68d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:53.364965 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-206af4b8-3a10-4d48-851a-2a25c8edc68d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:53.365743 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-206af4b8-3a10-4d48-851a-2a25c8edc68d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:53.366727 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-206af4b8-3a10-4d48-851a-2a25c8edc68d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:53.394855 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-206af4b8-3a10-4d48-851a-2a25c8edc68d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040855 Jan 11 15:16:53.395424 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 452/915] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:53 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:54.406131 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-74970abe-2a7a-47a6-bdaa-8742bb728f4d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:54.407048 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-74970abe-2a7a-47a6-bdaa-8742bb728f4d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:54.415280 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-74970abe-2a7a-47a6-bdaa-8742bb728f4d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:54.415744 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-74970abe-2a7a-47a6-bdaa-8742bb728f4d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:54.416528 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-74970abe-2a7a-47a6-bdaa-8742bb728f4d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:54.416967 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-74970abe-2a7a-47a6-bdaa-8742bb728f4d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:54.446268 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-74970abe-2a7a-47a6-bdaa-8742bb728f4d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043999 Jan 11 15:16:54.446828 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 464/916] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:54 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:55.457304 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6c22687f-82d2-43e2-b50f-72a84dfd5512 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:55.458545 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6c22687f-82d2-43e2-b50f-72a84dfd5512 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:55.464736 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6c22687f-82d2-43e2-b50f-72a84dfd5512 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:55.465186 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6c22687f-82d2-43e2-b50f-72a84dfd5512 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:55.465955 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6c22687f-82d2-43e2-b50f-72a84dfd5512 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:55.466389 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6c22687f-82d2-43e2-b50f-72a84dfd5512 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:55.494831 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6c22687f-82d2-43e2-b50f-72a84dfd5512 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041282 Jan 11 15:16:55.495382 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 453/917] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:55 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:56.505722 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e850bf87-1bc2-40fb-8024-6288633e0412 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:56.507459 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e850bf87-1bc2-40fb-8024-6288633e0412 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:56.513651 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e850bf87-1bc2-40fb-8024-6288633e0412 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:56.514109 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e850bf87-1bc2-40fb-8024-6288633e0412 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:56.514887 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e850bf87-1bc2-40fb-8024-6288633e0412 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:56.515356 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e850bf87-1bc2-40fb-8024-6288633e0412 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:56.542857 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e850bf87-1bc2-40fb-8024-6288633e0412 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040883 Jan 11 15:16:56.543433 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 465/918] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:56 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:57.554276 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1084c118-3b94-4c25-902c-216f01ed2fa7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:57.555193 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1084c118-3b94-4c25-902c-216f01ed2fa7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:57.561362 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1084c118-3b94-4c25-902c-216f01ed2fa7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:57.561817 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1084c118-3b94-4c25-902c-216f01ed2fa7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:57.562596 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1084c118-3b94-4c25-902c-216f01ed2fa7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:57.563040 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1084c118-3b94-4c25-902c-216f01ed2fa7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:57.593034 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1084c118-3b94-4c25-902c-216f01ed2fa7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042785 Jan 11 15:16:57.593585 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 454/919] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:57 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:58.604952 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-10545bcc-5a94-4970-b819-28058730adc4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:58.605854 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-10545bcc-5a94-4970-b819-28058730adc4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:58.612023 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-10545bcc-5a94-4970-b819-28058730adc4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:58.612474 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-10545bcc-5a94-4970-b819-28058730adc4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:58.613268 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-10545bcc-5a94-4970-b819-28058730adc4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:58.613701 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-10545bcc-5a94-4970-b819-28058730adc4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:58.641379 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-10545bcc-5a94-4970-b819-28058730adc4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040750 Jan 11 15:16:58.641910 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 466/920] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:58 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:16:59.652628 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-98fc0abf-c311-4137-ac24-6c4433bb16b1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:16:59.653538 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-98fc0abf-c311-4137-ac24-6c4433bb16b1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:16:59.659738 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-98fc0abf-c311-4137-ac24-6c4433bb16b1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:59.660193 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-98fc0abf-c311-4137-ac24-6c4433bb16b1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:59.660970 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-98fc0abf-c311-4137-ac24-6c4433bb16b1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:16:59.661409 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-98fc0abf-c311-4137-ac24-6c4433bb16b1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:16:59.690078 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-98fc0abf-c311-4137-ac24-6c4433bb16b1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041119 Jan 11 15:16:59.690617 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 455/921] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:16:59 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:00.701381 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-fa65e83a-35ef-4f16-bc1d-8859ad81577d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:00.702290 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-fa65e83a-35ef-4f16-bc1d-8859ad81577d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:00.708896 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fa65e83a-35ef-4f16-bc1d-8859ad81577d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:00.709344 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fa65e83a-35ef-4f16-bc1d-8859ad81577d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:00.710809 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fa65e83a-35ef-4f16-bc1d-8859ad81577d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:00.711243 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fa65e83a-35ef-4f16-bc1d-8859ad81577d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:00.740191 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-fa65e83a-35ef-4f16-bc1d-8859ad81577d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042587 Jan 11 15:17:00.743871 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 467/922] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:00 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:01.751261 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-04dd69be-7531-4433-9d06-c55932a12dfc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:01.752191 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-04dd69be-7531-4433-9d06-c55932a12dfc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:01.758334 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-04dd69be-7531-4433-9d06-c55932a12dfc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:01.758786 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-04dd69be-7531-4433-9d06-c55932a12dfc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:01.759593 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-04dd69be-7531-4433-9d06-c55932a12dfc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:01.760039 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-04dd69be-7531-4433-9d06-c55932a12dfc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:01.789469 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-04dd69be-7531-4433-9d06-c55932a12dfc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042005 Jan 11 15:17:01.789953 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 456/923] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:01 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:02.800746 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d57d18e6-9341-465b-9bc0-429f270c6d2c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:02.801705 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d57d18e6-9341-465b-9bc0-429f270c6d2c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:02.808182 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d57d18e6-9341-465b-9bc0-429f270c6d2c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:02.808635 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d57d18e6-9341-465b-9bc0-429f270c6d2c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:02.809410 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d57d18e6-9341-465b-9bc0-429f270c6d2c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:02.809849 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d57d18e6-9341-465b-9bc0-429f270c6d2c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:02.838967 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d57d18e6-9341-465b-9bc0-429f270c6d2c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041951 Jan 11 15:17:02.839534 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 468/924] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:02 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:03.849909 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-89434510-23a3-47e7-b51b-c8c84af15eb9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:03.851466 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-89434510-23a3-47e7-b51b-c8c84af15eb9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:03.857688 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-89434510-23a3-47e7-b51b-c8c84af15eb9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:03.858135 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-89434510-23a3-47e7-b51b-c8c84af15eb9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:03.858908 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-89434510-23a3-47e7-b51b-c8c84af15eb9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:03.859365 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-89434510-23a3-47e7-b51b-c8c84af15eb9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:03.887718 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-89434510-23a3-47e7-b51b-c8c84af15eb9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041554 Jan 11 15:17:03.888282 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 457/925] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:03 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:04.898800 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2f91a114-f47d-4de3-a0d1-744abbb4a701 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:04.899669 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2f91a114-f47d-4de3-a0d1-744abbb4a701 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:04.905843 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2f91a114-f47d-4de3-a0d1-744abbb4a701 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:04.906297 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2f91a114-f47d-4de3-a0d1-744abbb4a701 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:04.907067 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2f91a114-f47d-4de3-a0d1-744abbb4a701 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:04.907538 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2f91a114-f47d-4de3-a0d1-744abbb4a701 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:04.936860 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2f91a114-f47d-4de3-a0d1-744abbb4a701 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041782 Jan 11 15:17:04.945081 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 469/926] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:04 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:05.954205 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3e97dcb8-ac87-4dd5-a8a3-b6cbb7c3ff01 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:05.955035 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3e97dcb8-ac87-4dd5-a8a3-b6cbb7c3ff01 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:05.962086 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3e97dcb8-ac87-4dd5-a8a3-b6cbb7c3ff01 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:05.962532 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3e97dcb8-ac87-4dd5-a8a3-b6cbb7c3ff01 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:05.963315 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3e97dcb8-ac87-4dd5-a8a3-b6cbb7c3ff01 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:05.963759 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3e97dcb8-ac87-4dd5-a8a3-b6cbb7c3ff01 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:05.992847 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3e97dcb8-ac87-4dd5-a8a3-b6cbb7c3ff01 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042328 Jan 11 15:17:05.993586 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 458/927] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:05 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:07.004069 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ad3fc833-81c4-44d9-90a7-13e284d0c820 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:07.004929 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-ad3fc833-81c4-44d9-90a7-13e284d0c820 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:07.011124 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ad3fc833-81c4-44d9-90a7-13e284d0c820 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:07.011612 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ad3fc833-81c4-44d9-90a7-13e284d0c820 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:07.012383 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ad3fc833-81c4-44d9-90a7-13e284d0c820 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:07.012817 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ad3fc833-81c4-44d9-90a7-13e284d0c820 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:07.041597 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-ad3fc833-81c4-44d9-90a7-13e284d0c820 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041254 Jan 11 15:17:07.042132 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 470/928] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:06 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:08.052837 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-926a2c1d-5208-4fbb-91d5-e7520fa42116 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:08.054329 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-926a2c1d-5208-4fbb-91d5-e7520fa42116 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:08.060629 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-926a2c1d-5208-4fbb-91d5-e7520fa42116 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:08.061085 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-926a2c1d-5208-4fbb-91d5-e7520fa42116 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:08.061867 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-926a2c1d-5208-4fbb-91d5-e7520fa42116 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:08.062314 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-926a2c1d-5208-4fbb-91d5-e7520fa42116 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:08.090821 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-926a2c1d-5208-4fbb-91d5-e7520fa42116 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041741 Jan 11 15:17:08.091716 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 459/929] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:08 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:09.101765 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-895c213e-4172-45c0-b2d7-71236e1d47e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:09.102675 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-895c213e-4172-45c0-b2d7-71236e1d47e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:09.109446 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-895c213e-4172-45c0-b2d7-71236e1d47e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:09.109891 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-895c213e-4172-45c0-b2d7-71236e1d47e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:09.110662 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-895c213e-4172-45c0-b2d7-71236e1d47e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:09.111098 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-895c213e-4172-45c0-b2d7-71236e1d47e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:09.140396 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-895c213e-4172-45c0-b2d7-71236e1d47e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042376 Jan 11 15:17:09.140937 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 471/930] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:09 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:10.152363 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-eeb2080f-e67a-4542-9594-64c3f543c9c9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:10.153181 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-eeb2080f-e67a-4542-9594-64c3f543c9c9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:10.159311 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-eeb2080f-e67a-4542-9594-64c3f543c9c9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:10.159785 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-eeb2080f-e67a-4542-9594-64c3f543c9c9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:10.160555 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-eeb2080f-e67a-4542-9594-64c3f543c9c9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:10.160990 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-eeb2080f-e67a-4542-9594-64c3f543c9c9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:10.189683 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-eeb2080f-e67a-4542-9594-64c3f543c9c9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041083 Jan 11 15:17:10.190235 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 460/931] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:10 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:11.200997 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-6d584842-db25-4357-ade7-cd28d698e560 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:11.201906 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-6d584842-db25-4357-ade7-cd28d698e560 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:11.208334 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6d584842-db25-4357-ade7-cd28d698e560 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:11.208775 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6d584842-db25-4357-ade7-cd28d698e560 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:11.210171 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6d584842-db25-4357-ade7-cd28d698e560 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:11.210606 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6d584842-db25-4357-ade7-cd28d698e560 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:11.238971 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-6d584842-db25-4357-ade7-cd28d698e560 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041734 Jan 11 15:17:11.239559 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 472/932] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:11 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:12.249933 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c5a9d4dd-2c28-486c-8ced-daa4d19eaaee tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:12.251412 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c5a9d4dd-2c28-486c-8ced-daa4d19eaaee tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:12.262752 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c5a9d4dd-2c28-486c-8ced-daa4d19eaaee tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:12.262752 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c5a9d4dd-2c28-486c-8ced-daa4d19eaaee tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:12.262752 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c5a9d4dd-2c28-486c-8ced-daa4d19eaaee tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:12.262752 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c5a9d4dd-2c28-486c-8ced-daa4d19eaaee tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:12.291328 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c5a9d4dd-2c28-486c-8ced-daa4d19eaaee tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045077 Jan 11 15:17:12.297825 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 461/933] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:12 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:13.304489 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7f0b2364-d145-4b21-a700-d213839bc112 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:13.305336 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7f0b2364-d145-4b21-a700-d213839bc112 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:13.311823 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7f0b2364-d145-4b21-a700-d213839bc112 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:13.312272 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7f0b2364-d145-4b21-a700-d213839bc112 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:13.313042 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7f0b2364-d145-4b21-a700-d213839bc112 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:13.313482 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7f0b2364-d145-4b21-a700-d213839bc112 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:13.342280 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7f0b2364-d145-4b21-a700-d213839bc112 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042236 Jan 11 15:17:13.342832 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 473/934] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:13 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:14.353570 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8c0f0441-46e3-4070-9e7f-63062361681c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:14.354506 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8c0f0441-46e3-4070-9e7f-63062361681c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:14.360918 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8c0f0441-46e3-4070-9e7f-63062361681c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:14.361364 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8c0f0441-46e3-4070-9e7f-63062361681c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:14.362135 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8c0f0441-46e3-4070-9e7f-63062361681c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:14.362569 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8c0f0441-46e3-4070-9e7f-63062361681c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:14.391665 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8c0f0441-46e3-4070-9e7f-63062361681c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041880 Jan 11 15:17:14.392224 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 462/935] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:14 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:15.402997 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4f165ad8-831f-4937-9485-981693d91c03 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:15.403944 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4f165ad8-831f-4937-9485-981693d91c03 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:15.410247 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4f165ad8-831f-4937-9485-981693d91c03 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:15.410702 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4f165ad8-831f-4937-9485-981693d91c03 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:15.411512 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4f165ad8-831f-4937-9485-981693d91c03 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:15.411953 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4f165ad8-831f-4937-9485-981693d91c03 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:15.446444 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4f165ad8-831f-4937-9485-981693d91c03 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047169 Jan 11 15:17:15.447126 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 474/936] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:15 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:16.457994 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4897a5b1-f20a-41e4-ac5b-363a087a083c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:16.458847 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-4897a5b1-f20a-41e4-ac5b-363a087a083c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:16.465085 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4897a5b1-f20a-41e4-ac5b-363a087a083c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:16.465537 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4897a5b1-f20a-41e4-ac5b-363a087a083c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:16.466310 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4897a5b1-f20a-41e4-ac5b-363a087a083c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:16.466751 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4897a5b1-f20a-41e4-ac5b-363a087a083c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:16.496920 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4897a5b1-f20a-41e4-ac5b-363a087a083c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042913 Jan 11 15:17:16.497691 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 463/937] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:16 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:17.510771 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-9746afc2-1472-41e2-89aa-dc66bf4a27cd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:17.511726 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-9746afc2-1472-41e2-89aa-dc66bf4a27cd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:17.517874 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9746afc2-1472-41e2-89aa-dc66bf4a27cd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:17.518326 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9746afc2-1472-41e2-89aa-dc66bf4a27cd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:17.519095 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9746afc2-1472-41e2-89aa-dc66bf4a27cd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:17.519554 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9746afc2-1472-41e2-89aa-dc66bf4a27cd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:17.550096 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-9746afc2-1472-41e2-89aa-dc66bf4a27cd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043678 Jan 11 15:17:17.550660 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 475/938] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:17 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:18.571254 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1520de55-72f6-438f-9201-a70defa81a43 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:18.572198 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1520de55-72f6-438f-9201-a70defa81a43 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:18.578392 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1520de55-72f6-438f-9201-a70defa81a43 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:18.578846 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1520de55-72f6-438f-9201-a70defa81a43 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:18.579659 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1520de55-72f6-438f-9201-a70defa81a43 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:18.580097 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1520de55-72f6-438f-9201-a70defa81a43 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:18.611081 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1520de55-72f6-438f-9201-a70defa81a43 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043962 Jan 11 15:17:18.611668 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 464/939] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:18 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:19.621866 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-8cad3cfc-ae59-4c0b-8481-a5ce3b46df7f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:19.622782 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-8cad3cfc-ae59-4c0b-8481-a5ce3b46df7f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:19.629079 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8cad3cfc-ae59-4c0b-8481-a5ce3b46df7f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:19.629726 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8cad3cfc-ae59-4c0b-8481-a5ce3b46df7f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:19.630297 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8cad3cfc-ae59-4c0b-8481-a5ce3b46df7f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:19.630736 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8cad3cfc-ae59-4c0b-8481-a5ce3b46df7f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:19.659567 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-8cad3cfc-ae59-4c0b-8481-a5ce3b46df7f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041324 Jan 11 15:17:19.660125 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 476/940] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:19 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:20.671024 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-db462e46-9514-402e-bf31-3cbd3bae03ce tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:20.671959 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-db462e46-9514-402e-bf31-3cbd3bae03ce tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:20.678237 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-db462e46-9514-402e-bf31-3cbd3bae03ce tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:20.678689 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-db462e46-9514-402e-bf31-3cbd3bae03ce tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:20.679755 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-db462e46-9514-402e-bf31-3cbd3bae03ce tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:20.679969 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-db462e46-9514-402e-bf31-3cbd3bae03ce tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:20.711536 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-db462e46-9514-402e-bf31-3cbd3bae03ce tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044033 Jan 11 15:17:20.712103 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 465/941] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:20 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:21.722205 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d1f4a5e8-f181-4930-96e5-5cd6f551d65d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:21.723255 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d1f4a5e8-f181-4930-96e5-5cd6f551d65d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:21.729970 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d1f4a5e8-f181-4930-96e5-5cd6f551d65d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:21.730416 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d1f4a5e8-f181-4930-96e5-5cd6f551d65d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:21.731196 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d1f4a5e8-f181-4930-96e5-5cd6f551d65d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:21.731774 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d1f4a5e8-f181-4930-96e5-5cd6f551d65d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:21.761396 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d1f4a5e8-f181-4930-96e5-5cd6f551d65d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042838 Jan 11 15:17:21.762143 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 477/942] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:21 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:22.773868 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-bac2c6c2-cfa0-493a-9a07-37e700f5c055 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:22.774819 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-bac2c6c2-cfa0-493a-9a07-37e700f5c055 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:22.781010 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bac2c6c2-cfa0-493a-9a07-37e700f5c055 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:22.781468 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bac2c6c2-cfa0-493a-9a07-37e700f5c055 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:22.782341 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bac2c6c2-cfa0-493a-9a07-37e700f5c055 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:22.782784 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bac2c6c2-cfa0-493a-9a07-37e700f5c055 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:22.813192 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-bac2c6c2-cfa0-493a-9a07-37e700f5c055 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043496 Jan 11 15:17:22.813743 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 466/943] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:22 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:23.824439 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3b3ac7a9-04bc-4e31-8197-729a6b28b6ca tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:23.825358 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3b3ac7a9-04bc-4e31-8197-729a6b28b6ca tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:23.831055 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3b3ac7a9-04bc-4e31-8197-729a6b28b6ca tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:23.831547 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3b3ac7a9-04bc-4e31-8197-729a6b28b6ca tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:23.832325 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3b3ac7a9-04bc-4e31-8197-729a6b28b6ca tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:23.833034 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3b3ac7a9-04bc-4e31-8197-729a6b28b6ca tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:23.862399 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3b3ac7a9-04bc-4e31-8197-729a6b28b6ca tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041832 Jan 11 15:17:23.862945 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 478/944] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:23 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:24.873562 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b5894a0b-3660-42d1-a23e-fa73439f6b31 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:24.874473 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b5894a0b-3660-42d1-a23e-fa73439f6b31 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:24.880984 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b5894a0b-3660-42d1-a23e-fa73439f6b31 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:24.881433 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b5894a0b-3660-42d1-a23e-fa73439f6b31 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:24.882859 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b5894a0b-3660-42d1-a23e-fa73439f6b31 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:24.883323 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b5894a0b-3660-42d1-a23e-fa73439f6b31 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:24.912186 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b5894a0b-3660-42d1-a23e-fa73439f6b31 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042575 Jan 11 15:17:24.912736 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 467/945] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:24 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:25.923115 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-85aa5d54-2673-43f2-9c87-fa2078b26afc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:25.924046 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-85aa5d54-2673-43f2-9c87-fa2078b26afc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:25.930156 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-85aa5d54-2673-43f2-9c87-fa2078b26afc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:25.930836 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-85aa5d54-2673-43f2-9c87-fa2078b26afc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:25.931408 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-85aa5d54-2673-43f2-9c87-fa2078b26afc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:25.931845 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-85aa5d54-2673-43f2-9c87-fa2078b26afc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:25.961980 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-85aa5d54-2673-43f2-9c87-fa2078b26afc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042568 Jan 11 15:17:25.962526 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 479/946] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:25 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:26.972828 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-428f49ae-ff1f-4453-8f7c-cc20dfec4dfe tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:26.973807 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-428f49ae-ff1f-4453-8f7c-cc20dfec4dfe tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:26.980054 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-428f49ae-ff1f-4453-8f7c-cc20dfec4dfe tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:26.980535 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-428f49ae-ff1f-4453-8f7c-cc20dfec4dfe tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:26.981260 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-428f49ae-ff1f-4453-8f7c-cc20dfec4dfe tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:26.981698 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-428f49ae-ff1f-4453-8f7c-cc20dfec4dfe tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:27.011596 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-428f49ae-ff1f-4453-8f7c-cc20dfec4dfe tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042420 Jan 11 15:17:27.012147 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 468/947] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:26 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:28.021687 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3d51f420-a67a-4d2f-bec6-50613a347b35 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:28.023164 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3d51f420-a67a-4d2f-bec6-50613a347b35 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:28.029623 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3d51f420-a67a-4d2f-bec6-50613a347b35 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:28.030074 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3d51f420-a67a-4d2f-bec6-50613a347b35 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:28.030850 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3d51f420-a67a-4d2f-bec6-50613a347b35 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:28.031309 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3d51f420-a67a-4d2f-bec6-50613a347b35 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:28.060220 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3d51f420-a67a-4d2f-bec6-50613a347b35 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042166 Jan 11 15:17:28.060759 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 480/948] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:28 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:29.071668 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b339ab08-84b4-4dc4-8506-47156be738c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:29.072721 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b339ab08-84b4-4dc4-8506-47156be738c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:29.078948 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b339ab08-84b4-4dc4-8506-47156be738c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:29.079562 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b339ab08-84b4-4dc4-8506-47156be738c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:29.080354 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b339ab08-84b4-4dc4-8506-47156be738c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:29.080742 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b339ab08-84b4-4dc4-8506-47156be738c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:29.109731 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b339ab08-84b4-4dc4-8506-47156be738c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042261 Jan 11 15:17:29.110284 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 469/949] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:29 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:30.121232 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-df424adb-84a2-4d4d-8c8f-1688df3e3e0d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:30.122139 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-df424adb-84a2-4d4d-8c8f-1688df3e3e0d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:30.128312 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-df424adb-84a2-4d4d-8c8f-1688df3e3e0d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:30.128760 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-df424adb-84a2-4d4d-8c8f-1688df3e3e0d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:30.129530 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-df424adb-84a2-4d4d-8c8f-1688df3e3e0d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:30.129960 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-df424adb-84a2-4d4d-8c8f-1688df3e3e0d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:30.158192 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-df424adb-84a2-4d4d-8c8f-1688df3e3e0d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040643 Jan 11 15:17:30.158727 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 481/950] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:30 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:31.169238 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-54e737f4-9006-469b-a69c-b19bfd05a9b2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:31.170257 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-54e737f4-9006-469b-a69c-b19bfd05a9b2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:31.176469 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-54e737f4-9006-469b-a69c-b19bfd05a9b2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:31.176920 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-54e737f4-9006-469b-a69c-b19bfd05a9b2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:31.177701 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-54e737f4-9006-469b-a69c-b19bfd05a9b2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:31.178171 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-54e737f4-9006-469b-a69c-b19bfd05a9b2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:31.206380 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-54e737f4-9006-469b-a69c-b19bfd05a9b2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040897 Jan 11 15:17:31.206930 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 470/951] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:31 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:32.217584 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7f556b59-9201-4758-924f-1d6ea203ab76 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:32.218492 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7f556b59-9201-4758-924f-1d6ea203ab76 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:32.224663 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7f556b59-9201-4758-924f-1d6ea203ab76 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:32.225115 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7f556b59-9201-4758-924f-1d6ea203ab76 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:32.225923 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7f556b59-9201-4758-924f-1d6ea203ab76 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:32.226362 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7f556b59-9201-4758-924f-1d6ea203ab76 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:32.255147 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7f556b59-9201-4758-924f-1d6ea203ab76 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041171 Jan 11 15:17:32.260938 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 482/952] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:32 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:33.269722 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-aa41f5d6-213b-484e-9a7d-610343529f92 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:33.270623 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-aa41f5d6-213b-484e-9a7d-610343529f92 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:33.276948 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aa41f5d6-213b-484e-9a7d-610343529f92 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:33.277402 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aa41f5d6-213b-484e-9a7d-610343529f92 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:33.278174 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aa41f5d6-213b-484e-9a7d-610343529f92 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:33.278610 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aa41f5d6-213b-484e-9a7d-610343529f92 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:33.307635 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-aa41f5d6-213b-484e-9a7d-610343529f92 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041621 Jan 11 15:17:33.308199 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 471/953] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:33 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:34.318743 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-66ec9b57-cdff-47a7-b866-d268df4b463c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:34.320303 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-66ec9b57-cdff-47a7-b866-d268df4b463c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:34.326428 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-66ec9b57-cdff-47a7-b866-d268df4b463c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:34.326874 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-66ec9b57-cdff-47a7-b866-d268df4b463c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:34.327677 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-66ec9b57-cdff-47a7-b866-d268df4b463c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:34.328109 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-66ec9b57-cdff-47a7-b866-d268df4b463c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:34.356344 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-66ec9b57-cdff-47a7-b866-d268df4b463c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041321 Jan 11 15:17:34.356880 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 483/954] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:34 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:35.367402 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-80112d03-3966-4ee3-9cf8-0a1854f6ce9a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:35.368311 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-80112d03-3966-4ee3-9cf8-0a1854f6ce9a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:35.374448 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-80112d03-3966-4ee3-9cf8-0a1854f6ce9a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:35.374897 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-80112d03-3966-4ee3-9cf8-0a1854f6ce9a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:35.375694 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-80112d03-3966-4ee3-9cf8-0a1854f6ce9a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:35.376131 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-80112d03-3966-4ee3-9cf8-0a1854f6ce9a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:35.404362 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-80112d03-3966-4ee3-9cf8-0a1854f6ce9a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041244 Jan 11 15:17:35.404900 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 472/955] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:35 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:36.415909 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2a0dc159-d651-4282-aa65-e0b28f549261 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:36.416822 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2a0dc159-d651-4282-aa65-e0b28f549261 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:36.422966 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2a0dc159-d651-4282-aa65-e0b28f549261 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:36.423446 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2a0dc159-d651-4282-aa65-e0b28f549261 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:36.424214 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2a0dc159-d651-4282-aa65-e0b28f549261 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:36.424648 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2a0dc159-d651-4282-aa65-e0b28f549261 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:36.452742 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2a0dc159-d651-4282-aa65-e0b28f549261 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041102 Jan 11 15:17:36.453271 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 484/956] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:36 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:37.464198 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-aaebe3b0-24d8-4abd-a965-6dd15a461707 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:37.465144 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-aaebe3b0-24d8-4abd-a965-6dd15a461707 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:37.471524 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aaebe3b0-24d8-4abd-a965-6dd15a461707 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:37.471983 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aaebe3b0-24d8-4abd-a965-6dd15a461707 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:37.472773 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aaebe3b0-24d8-4abd-a965-6dd15a461707 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:37.473216 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aaebe3b0-24d8-4abd-a965-6dd15a461707 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:37.501733 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-aaebe3b0-24d8-4abd-a965-6dd15a461707 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041766 Jan 11 15:17:37.502278 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 473/957] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:37 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:38.513635 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c1465460-d865-4a6e-8db7-5cd4197b1e8b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:38.514461 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c1465460-d865-4a6e-8db7-5cd4197b1e8b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:38.520666 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c1465460-d865-4a6e-8db7-5cd4197b1e8b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:38.521115 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c1465460-d865-4a6e-8db7-5cd4197b1e8b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:38.521905 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c1465460-d865-4a6e-8db7-5cd4197b1e8b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:38.522339 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c1465460-d865-4a6e-8db7-5cd4197b1e8b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:38.551495 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c1465460-d865-4a6e-8db7-5cd4197b1e8b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041462 Jan 11 15:17:38.552083 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 485/958] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:38 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:39.563246 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3cf59765-39ad-4830-a141-096920af7ab4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:39.564220 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3cf59765-39ad-4830-a141-096920af7ab4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:39.570874 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3cf59765-39ad-4830-a141-096920af7ab4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:39.571352 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3cf59765-39ad-4830-a141-096920af7ab4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:39.572147 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3cf59765-39ad-4830-a141-096920af7ab4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:39.572587 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3cf59765-39ad-4830-a141-096920af7ab4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:39.601318 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3cf59765-39ad-4830-a141-096920af7ab4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041814 Jan 11 15:17:39.601870 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 474/959] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:39 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:40.612388 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-498144f3-6215-47b7-9ce3-2fb906f016e0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:40.613296 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-498144f3-6215-47b7-9ce3-2fb906f016e0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:40.620004 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-498144f3-6215-47b7-9ce3-2fb906f016e0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:40.620456 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-498144f3-6215-47b7-9ce3-2fb906f016e0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:40.621556 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-498144f3-6215-47b7-9ce3-2fb906f016e0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:40.622211 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-498144f3-6215-47b7-9ce3-2fb906f016e0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:40.652919 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-498144f3-6215-47b7-9ce3-2fb906f016e0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044187 Jan 11 15:17:40.653458 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 486/960] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:40 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:41.664270 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1fcff43d-e629-42d8-bd9c-a82edc6d3ef3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:41.665186 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1fcff43d-e629-42d8-bd9c-a82edc6d3ef3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:41.671348 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1fcff43d-e629-42d8-bd9c-a82edc6d3ef3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:41.671805 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1fcff43d-e629-42d8-bd9c-a82edc6d3ef3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:41.672586 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1fcff43d-e629-42d8-bd9c-a82edc6d3ef3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:41.673023 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1fcff43d-e629-42d8-bd9c-a82edc6d3ef3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:41.701184 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1fcff43d-e629-42d8-bd9c-a82edc6d3ef3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040788 Jan 11 15:17:41.701749 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 475/961] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:41 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:42.713071 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-216e3abb-4dd3-46de-a3e3-0e0316cb43da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:42.714091 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-216e3abb-4dd3-46de-a3e3-0e0316cb43da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:42.720242 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-216e3abb-4dd3-46de-a3e3-0e0316cb43da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:42.720687 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-216e3abb-4dd3-46de-a3e3-0e0316cb43da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:42.721453 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-216e3abb-4dd3-46de-a3e3-0e0316cb43da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:42.721890 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-216e3abb-4dd3-46de-a3e3-0e0316cb43da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:42.750783 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-216e3abb-4dd3-46de-a3e3-0e0316cb43da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041909 Jan 11 15:17:42.751450 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 487/962] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:42 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:43.762368 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f30b30cc-db01-4668-8a81-0bc9744d2b3b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:43.763283 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f30b30cc-db01-4668-8a81-0bc9744d2b3b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:43.769669 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f30b30cc-db01-4668-8a81-0bc9744d2b3b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:43.770119 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f30b30cc-db01-4668-8a81-0bc9744d2b3b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:43.770893 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f30b30cc-db01-4668-8a81-0bc9744d2b3b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:43.771360 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f30b30cc-db01-4668-8a81-0bc9744d2b3b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:43.799123 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f30b30cc-db01-4668-8a81-0bc9744d2b3b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040484 Jan 11 15:17:43.799693 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 476/963] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:43 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:44.810571 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4e8cba8f-2e9b-4bc5-8cb3-d8aec33a0825 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:44.811617 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4e8cba8f-2e9b-4bc5-8cb3-d8aec33a0825 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:44.817926 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4e8cba8f-2e9b-4bc5-8cb3-d8aec33a0825 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:44.818386 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4e8cba8f-2e9b-4bc5-8cb3-d8aec33a0825 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:44.819170 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4e8cba8f-2e9b-4bc5-8cb3-d8aec33a0825 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:44.819670 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4e8cba8f-2e9b-4bc5-8cb3-d8aec33a0825 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:44.847582 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4e8cba8f-2e9b-4bc5-8cb3-d8aec33a0825 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040756 Jan 11 15:17:44.848130 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 488/964] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:44 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:45.173835 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:17:45.174449 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: Tue Jan 11 15:17:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:17:45.276045 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:17:45.276222 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: Tue Jan 11 15:17:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:17:45.857887 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-36e3168e-4ca4-495e-9e33-84470a39abb3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:45.858793 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-36e3168e-4ca4-495e-9e33-84470a39abb3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:45.865084 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-36e3168e-4ca4-495e-9e33-84470a39abb3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:45.865537 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-36e3168e-4ca4-495e-9e33-84470a39abb3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:45.866311 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-36e3168e-4ca4-495e-9e33-84470a39abb3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:45.866750 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-36e3168e-4ca4-495e-9e33-84470a39abb3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:45.896316 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-36e3168e-4ca4-495e-9e33-84470a39abb3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042185 Jan 11 15:17:45.896867 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 477/965] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:45 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:46.906780 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-78add3a2-1ec7-43ed-9e5d-cfe9a060d3bf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:46.907725 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-78add3a2-1ec7-43ed-9e5d-cfe9a060d3bf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:46.914668 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-78add3a2-1ec7-43ed-9e5d-cfe9a060d3bf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:46.915128 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-78add3a2-1ec7-43ed-9e5d-cfe9a060d3bf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:46.916442 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-78add3a2-1ec7-43ed-9e5d-cfe9a060d3bf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:46.916886 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-78add3a2-1ec7-43ed-9e5d-cfe9a060d3bf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:46.944985 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-78add3a2-1ec7-43ed-9e5d-cfe9a060d3bf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041942 Jan 11 15:17:46.945528 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 489/966] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:46 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:47.956279 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a22db37b-0e76-4f10-b582-fc3e307a4583 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:47.957431 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a22db37b-0e76-4f10-b582-fc3e307a4583 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:47.963641 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a22db37b-0e76-4f10-b582-fc3e307a4583 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:47.964086 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a22db37b-0e76-4f10-b582-fc3e307a4583 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:47.965045 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a22db37b-0e76-4f10-b582-fc3e307a4583 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:47.965589 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a22db37b-0e76-4f10-b582-fc3e307a4583 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:47.994952 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a22db37b-0e76-4f10-b582-fc3e307a4583 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042439 Jan 11 15:17:47.995519 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 478/967] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:47 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:49.005984 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-60fb58e4-09ed-4397-a144-bb8696883611 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:49.006890 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-60fb58e4-09ed-4397-a144-bb8696883611 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:49.013705 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-60fb58e4-09ed-4397-a144-bb8696883611 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:49.014154 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-60fb58e4-09ed-4397-a144-bb8696883611 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:49.014920 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-60fb58e4-09ed-4397-a144-bb8696883611 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:49.015388 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-60fb58e4-09ed-4397-a144-bb8696883611 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:49.043907 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-60fb58e4-09ed-4397-a144-bb8696883611 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041700 Jan 11 15:17:49.044436 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 490/968] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:49 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:50.054945 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b87fc8f7-7fb7-4974-8d2a-822e5a41cbed tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:50.056497 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b87fc8f7-7fb7-4974-8d2a-822e5a41cbed tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:50.062629 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b87fc8f7-7fb7-4974-8d2a-822e5a41cbed tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:50.063077 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b87fc8f7-7fb7-4974-8d2a-822e5a41cbed tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:50.063881 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b87fc8f7-7fb7-4974-8d2a-822e5a41cbed tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:50.064317 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b87fc8f7-7fb7-4974-8d2a-822e5a41cbed tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:50.092906 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b87fc8f7-7fb7-4974-8d2a-822e5a41cbed tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041774 Jan 11 15:17:50.093445 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 479/969] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:50 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:51.104673 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-47f8554b-a9db-4a71-8298-225442ebffec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:51.105585 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-47f8554b-a9db-4a71-8298-225442ebffec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:51.111981 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-47f8554b-a9db-4a71-8298-225442ebffec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:51.112476 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-47f8554b-a9db-4a71-8298-225442ebffec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:51.113278 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-47f8554b-a9db-4a71-8298-225442ebffec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:51.113725 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-47f8554b-a9db-4a71-8298-225442ebffec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:51.141795 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-47f8554b-a9db-4a71-8298-225442ebffec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041448 Jan 11 15:17:51.142338 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 491/970] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:51 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:52.153477 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-eff47371-4f67-4b5f-b2d0-ec179798a053 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:52.154387 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-eff47371-4f67-4b5f-b2d0-ec179798a053 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:52.160375 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-eff47371-4f67-4b5f-b2d0-ec179798a053 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:52.160833 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-eff47371-4f67-4b5f-b2d0-ec179798a053 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:52.161616 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-eff47371-4f67-4b5f-b2d0-ec179798a053 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:52.162064 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-eff47371-4f67-4b5f-b2d0-ec179798a053 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:52.189910 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-eff47371-4f67-4b5f-b2d0-ec179798a053 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040717 Jan 11 15:17:52.190463 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 480/971] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:52 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:53.201711 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-800e309c-7bde-49d7-b6c6-65b5f303a09f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:53.202628 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-800e309c-7bde-49d7-b6c6-65b5f303a09f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:53.209228 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-800e309c-7bde-49d7-b6c6-65b5f303a09f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:53.209685 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-800e309c-7bde-49d7-b6c6-65b5f303a09f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:53.210496 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-800e309c-7bde-49d7-b6c6-65b5f303a09f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:53.210938 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-800e309c-7bde-49d7-b6c6-65b5f303a09f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:53.239479 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-800e309c-7bde-49d7-b6c6-65b5f303a09f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041474 Jan 11 15:17:53.240038 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 492/972] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:53 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:54.250512 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3455a491-bc9d-44a7-8a5d-0562246154b3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:54.251469 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3455a491-bc9d-44a7-8a5d-0562246154b3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:54.258004 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3455a491-bc9d-44a7-8a5d-0562246154b3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:54.258456 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3455a491-bc9d-44a7-8a5d-0562246154b3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:54.259967 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3455a491-bc9d-44a7-8a5d-0562246154b3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:54.265053 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3455a491-bc9d-44a7-8a5d-0562246154b3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:54.288551 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3455a491-bc9d-44a7-8a5d-0562246154b3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041861 Jan 11 15:17:54.289101 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 481/973] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:54 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:55.300515 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b0c6b8a8-5ea7-40e2-bb20-13462df95bb6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:55.301510 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b0c6b8a8-5ea7-40e2-bb20-13462df95bb6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:55.307563 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b0c6b8a8-5ea7-40e2-bb20-13462df95bb6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:55.308018 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b0c6b8a8-5ea7-40e2-bb20-13462df95bb6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:55.308835 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b0c6b8a8-5ea7-40e2-bb20-13462df95bb6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:55.309274 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b0c6b8a8-5ea7-40e2-bb20-13462df95bb6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:55.338707 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b0c6b8a8-5ea7-40e2-bb20-13462df95bb6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042006 Jan 11 15:17:55.339250 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 493/974] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:55 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:56.350136 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-fb33e49a-737f-4960-b25d-3e6c96b5e3b6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:56.351046 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-fb33e49a-737f-4960-b25d-3e6c96b5e3b6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:56.358027 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fb33e49a-737f-4960-b25d-3e6c96b5e3b6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:56.358482 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fb33e49a-737f-4960-b25d-3e6c96b5e3b6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:56.359259 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fb33e49a-737f-4960-b25d-3e6c96b5e3b6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:56.359724 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fb33e49a-737f-4960-b25d-3e6c96b5e3b6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:56.387269 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-fb33e49a-737f-4960-b25d-3e6c96b5e3b6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040934 Jan 11 15:17:56.387830 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 482/975] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:56 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:57.397710 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c73a709d-2e52-4436-a64b-15eed0382c52 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:57.398620 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c73a709d-2e52-4436-a64b-15eed0382c52 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:57.404843 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c73a709d-2e52-4436-a64b-15eed0382c52 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:57.405296 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c73a709d-2e52-4436-a64b-15eed0382c52 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:57.406066 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c73a709d-2e52-4436-a64b-15eed0382c52 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:57.406502 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c73a709d-2e52-4436-a64b-15eed0382c52 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:57.435338 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c73a709d-2e52-4436-a64b-15eed0382c52 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041339 Jan 11 15:17:57.435885 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 494/976] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:57 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:58.446515 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-056f2196-89e7-4108-a3c3-debd572302f7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:58.447460 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-056f2196-89e7-4108-a3c3-debd572302f7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:58.453670 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-056f2196-89e7-4108-a3c3-debd572302f7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:58.454114 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-056f2196-89e7-4108-a3c3-debd572302f7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:58.454887 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-056f2196-89e7-4108-a3c3-debd572302f7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:58.455339 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-056f2196-89e7-4108-a3c3-debd572302f7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:58.484102 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-056f2196-89e7-4108-a3c3-debd572302f7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041344 Jan 11 15:17:58.484642 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 483/977] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:58 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:17:59.495248 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d0c93467-4bd4-48e8-a6de-2096793f07ec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:17:59.496184 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d0c93467-4bd4-48e8-a6de-2096793f07ec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:17:59.502401 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d0c93467-4bd4-48e8-a6de-2096793f07ec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:59.502851 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d0c93467-4bd4-48e8-a6de-2096793f07ec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:59.503655 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d0c93467-4bd4-48e8-a6de-2096793f07ec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:17:59.504098 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d0c93467-4bd4-48e8-a6de-2096793f07ec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:17:59.533158 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d0c93467-4bd4-48e8-a6de-2096793f07ec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041770 Jan 11 15:17:59.533694 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 495/978] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:17:59 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:00.544324 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-55fb7405-080d-48c0-ab91-ebbfd2ae781c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:00.545144 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-55fb7405-080d-48c0-ab91-ebbfd2ae781c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:00.551302 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-55fb7405-080d-48c0-ab91-ebbfd2ae781c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:00.552006 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-55fb7405-080d-48c0-ab91-ebbfd2ae781c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:00.552950 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-55fb7405-080d-48c0-ab91-ebbfd2ae781c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:00.553485 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-55fb7405-080d-48c0-ab91-ebbfd2ae781c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:00.582541 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-55fb7405-080d-48c0-ab91-ebbfd2ae781c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042011 Jan 11 15:18:00.583086 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 484/979] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:00 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:01.594799 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b368ee7d-e82e-40b5-b7cf-0c8213f176c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:01.596325 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b368ee7d-e82e-40b5-b7cf-0c8213f176c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:01.603920 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b368ee7d-e82e-40b5-b7cf-0c8213f176c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:01.604383 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b368ee7d-e82e-40b5-b7cf-0c8213f176c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:01.605765 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b368ee7d-e82e-40b5-b7cf-0c8213f176c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:01.606207 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b368ee7d-e82e-40b5-b7cf-0c8213f176c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:01.634082 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b368ee7d-e82e-40b5-b7cf-0c8213f176c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043396 Jan 11 15:18:01.634631 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 496/980] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:01 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:02.645670 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-32b59815-de2c-495a-9a3e-97ddb98ec079 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:02.646606 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-32b59815-de2c-495a-9a3e-97ddb98ec079 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:02.652833 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-32b59815-de2c-495a-9a3e-97ddb98ec079 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:02.653284 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-32b59815-de2c-495a-9a3e-97ddb98ec079 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:02.654064 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-32b59815-de2c-495a-9a3e-97ddb98ec079 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:02.654504 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-32b59815-de2c-495a-9a3e-97ddb98ec079 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:02.682643 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-32b59815-de2c-495a-9a3e-97ddb98ec079 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040813 Jan 11 15:18:02.683796 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 485/981] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:02 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:03.693653 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-9d8768c1-e4b3-46bc-9d00-c08ccdfdbf8c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:03.694558 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-9d8768c1-e4b3-46bc-9d00-c08ccdfdbf8c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:03.701292 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9d8768c1-e4b3-46bc-9d00-c08ccdfdbf8c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:03.701740 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9d8768c1-e4b3-46bc-9d00-c08ccdfdbf8c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:03.702510 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9d8768c1-e4b3-46bc-9d00-c08ccdfdbf8c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:03.702944 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9d8768c1-e4b3-46bc-9d00-c08ccdfdbf8c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:03.731864 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-9d8768c1-e4b3-46bc-9d00-c08ccdfdbf8c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041841 Jan 11 15:18:03.732440 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 497/982] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:03 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:04.743161 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a6c3fcf1-9e1a-4e52-a06f-d68fcd2059f6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:04.744134 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a6c3fcf1-9e1a-4e52-a06f-d68fcd2059f6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:04.750974 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a6c3fcf1-9e1a-4e52-a06f-d68fcd2059f6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:04.751459 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a6c3fcf1-9e1a-4e52-a06f-d68fcd2059f6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:04.752235 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a6c3fcf1-9e1a-4e52-a06f-d68fcd2059f6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:04.752673 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a6c3fcf1-9e1a-4e52-a06f-d68fcd2059f6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:04.780423 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a6c3fcf1-9e1a-4e52-a06f-d68fcd2059f6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041067 Jan 11 15:18:04.781012 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 486/983] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:04 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:05.791757 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-0c05f1dc-a1bf-46dd-a59f-c360877b478d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:05.792677 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-0c05f1dc-a1bf-46dd-a59f-c360877b478d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:05.798813 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0c05f1dc-a1bf-46dd-a59f-c360877b478d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:05.799266 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0c05f1dc-a1bf-46dd-a59f-c360877b478d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:05.800070 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0c05f1dc-a1bf-46dd-a59f-c360877b478d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:05.800510 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0c05f1dc-a1bf-46dd-a59f-c360877b478d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:05.828771 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-0c05f1dc-a1bf-46dd-a59f-c360877b478d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040780 Jan 11 15:18:05.829316 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 498/984] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:05 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:06.839679 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-793721c7-c943-4994-8a98-68854d8828fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:06.840580 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-793721c7-c943-4994-8a98-68854d8828fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:06.846936 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-793721c7-c943-4994-8a98-68854d8828fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:06.847413 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-793721c7-c943-4994-8a98-68854d8828fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:06.848188 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-793721c7-c943-4994-8a98-68854d8828fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:06.848623 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-793721c7-c943-4994-8a98-68854d8828fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:06.877151 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-793721c7-c943-4994-8a98-68854d8828fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041203 Jan 11 15:18:06.877698 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 487/985] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:06 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:07.888726 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4ccede5e-ff01-4188-b72c-cf197e9bc238 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:07.889634 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4ccede5e-ff01-4188-b72c-cf197e9bc238 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:07.895787 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4ccede5e-ff01-4188-b72c-cf197e9bc238 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:07.896240 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4ccede5e-ff01-4188-b72c-cf197e9bc238 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:07.897007 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4ccede5e-ff01-4188-b72c-cf197e9bc238 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:07.897440 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4ccede5e-ff01-4188-b72c-cf197e9bc238 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:07.925702 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4ccede5e-ff01-4188-b72c-cf197e9bc238 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041241 Jan 11 15:18:07.926236 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 499/986] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:07 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:08.936642 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0399ffe9-2b1d-47ec-9bda-5252d29a9bc2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:08.937541 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0399ffe9-2b1d-47ec-9bda-5252d29a9bc2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:08.944014 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0399ffe9-2b1d-47ec-9bda-5252d29a9bc2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:08.944466 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0399ffe9-2b1d-47ec-9bda-5252d29a9bc2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:08.945241 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0399ffe9-2b1d-47ec-9bda-5252d29a9bc2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:08.945679 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0399ffe9-2b1d-47ec-9bda-5252d29a9bc2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:08.974770 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0399ffe9-2b1d-47ec-9bda-5252d29a9bc2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041838 Jan 11 15:18:08.975350 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 488/987] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:08 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:09.986115 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-fa62b71d-04cc-4130-ae83-4fa91b0dc1f1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:09.987060 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-fa62b71d-04cc-4130-ae83-4fa91b0dc1f1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:09.993238 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fa62b71d-04cc-4130-ae83-4fa91b0dc1f1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:09.993695 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fa62b71d-04cc-4130-ae83-4fa91b0dc1f1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:09.994460 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fa62b71d-04cc-4130-ae83-4fa91b0dc1f1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:09.994896 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fa62b71d-04cc-4130-ae83-4fa91b0dc1f1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:10.022899 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-fa62b71d-04cc-4130-ae83-4fa91b0dc1f1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040502 Jan 11 15:18:10.023459 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 500/988] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:09 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:11.034299 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-72e7edba-ffe5-48ac-8f50-52d4398a3159 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:11.035218 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-72e7edba-ffe5-48ac-8f50-52d4398a3159 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:11.041530 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-72e7edba-ffe5-48ac-8f50-52d4398a3159 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:11.042491 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-72e7edba-ffe5-48ac-8f50-52d4398a3159 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:11.043269 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-72e7edba-ffe5-48ac-8f50-52d4398a3159 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:11.043738 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-72e7edba-ffe5-48ac-8f50-52d4398a3159 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:11.071850 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-72e7edba-ffe5-48ac-8f50-52d4398a3159 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041317 Jan 11 15:18:11.072395 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 489/989] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:11 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:12.083253 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-de4de1e1-2f67-44d2-a931-2a45c71832fc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:12.084191 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-de4de1e1-2f67-44d2-a931-2a45c71832fc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:12.090879 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-de4de1e1-2f67-44d2-a931-2a45c71832fc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:12.091358 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-de4de1e1-2f67-44d2-a931-2a45c71832fc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:12.092139 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-de4de1e1-2f67-44d2-a931-2a45c71832fc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:12.092579 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-de4de1e1-2f67-44d2-a931-2a45c71832fc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:12.121125 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-de4de1e1-2f67-44d2-a931-2a45c71832fc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041816 Jan 11 15:18:12.125639 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 501/990] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:12 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:13.134825 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e38fa237-ec35-4895-ad4a-32b695bde90c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:13.136968 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e38fa237-ec35-4895-ad4a-32b695bde90c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:13.143234 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e38fa237-ec35-4895-ad4a-32b695bde90c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:13.143719 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e38fa237-ec35-4895-ad4a-32b695bde90c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:13.144498 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e38fa237-ec35-4895-ad4a-32b695bde90c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:13.144939 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e38fa237-ec35-4895-ad4a-32b695bde90c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:13.173330 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e38fa237-ec35-4895-ad4a-32b695bde90c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042115 Jan 11 15:18:13.173874 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 490/991] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:13 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:14.184715 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-1aacb505-38b0-4fa1-bfe9-cea652deee3c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:14.185659 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-1aacb505-38b0-4fa1-bfe9-cea652deee3c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:14.191924 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1aacb505-38b0-4fa1-bfe9-cea652deee3c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:14.192373 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1aacb505-38b0-4fa1-bfe9-cea652deee3c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:14.193148 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1aacb505-38b0-4fa1-bfe9-cea652deee3c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:14.193585 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1aacb505-38b0-4fa1-bfe9-cea652deee3c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:14.223788 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-1aacb505-38b0-4fa1-bfe9-cea652deee3c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042738 Jan 11 15:18:14.224385 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 502/992] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:14 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:14.631121 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:18:14.631310 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: Tue Jan 11 15:18:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:18:15.234763 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ce221845-c23a-48a9-ba2c-b702b51993c3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:15.235694 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ce221845-c23a-48a9-ba2c-b702b51993c3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:15.241930 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ce221845-c23a-48a9-ba2c-b702b51993c3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:15.242386 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ce221845-c23a-48a9-ba2c-b702b51993c3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:15.243163 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ce221845-c23a-48a9-ba2c-b702b51993c3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:15.243643 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ce221845-c23a-48a9-ba2c-b702b51993c3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:15.273754 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ce221845-c23a-48a9-ba2c-b702b51993c3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042700 Jan 11 15:18:15.274325 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 491/993] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:15 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:16.285507 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-595ceaec-a18d-4524-aef5-b54094e5775e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:16.286451 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-595ceaec-a18d-4524-aef5-b54094e5775e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:16.293353 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-595ceaec-a18d-4524-aef5-b54094e5775e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:16.293798 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-595ceaec-a18d-4524-aef5-b54094e5775e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:16.294561 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-595ceaec-a18d-4524-aef5-b54094e5775e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:16.294998 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-595ceaec-a18d-4524-aef5-b54094e5775e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:16.323282 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-595ceaec-a18d-4524-aef5-b54094e5775e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041554 Jan 11 15:18:16.323778 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 503/994] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:16 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:17.334152 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f65bbd7a-8a29-4ab3-b3d4-70b8f910e8fe tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:17.335064 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f65bbd7a-8a29-4ab3-b3d4-70b8f910e8fe tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:17.341930 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f65bbd7a-8a29-4ab3-b3d4-70b8f910e8fe tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:17.342381 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f65bbd7a-8a29-4ab3-b3d4-70b8f910e8fe tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:17.343157 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f65bbd7a-8a29-4ab3-b3d4-70b8f910e8fe tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:17.343626 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f65bbd7a-8a29-4ab3-b3d4-70b8f910e8fe tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:17.371888 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f65bbd7a-8a29-4ab3-b3d4-70b8f910e8fe tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041696 Jan 11 15:18:17.372369 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 492/995] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:17 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:18.383150 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7313b950-32ff-471b-b0d5-fc27d9dbf1f2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:18.384110 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7313b950-32ff-471b-b0d5-fc27d9dbf1f2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:18.390817 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7313b950-32ff-471b-b0d5-fc27d9dbf1f2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:18.391275 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7313b950-32ff-471b-b0d5-fc27d9dbf1f2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:18.392092 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7313b950-32ff-471b-b0d5-fc27d9dbf1f2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:18.392535 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7313b950-32ff-471b-b0d5-fc27d9dbf1f2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:18.421111 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7313b950-32ff-471b-b0d5-fc27d9dbf1f2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041629 Jan 11 15:18:18.421584 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 504/996] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:18 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:19.432800 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-fbf931ae-9a69-4f3e-ace3-9c00cd90fbde tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:19.433736 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-fbf931ae-9a69-4f3e-ace3-9c00cd90fbde tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:19.440040 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fbf931ae-9a69-4f3e-ace3-9c00cd90fbde tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:19.440489 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fbf931ae-9a69-4f3e-ace3-9c00cd90fbde tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:19.441259 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fbf931ae-9a69-4f3e-ace3-9c00cd90fbde tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:19.441693 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fbf931ae-9a69-4f3e-ace3-9c00cd90fbde tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:19.470213 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-fbf931ae-9a69-4f3e-ace3-9c00cd90fbde tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041631 Jan 11 15:18:19.470679 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 493/997] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:19 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:20.481673 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-79875323-5164-4874-8d02-f24463e432cf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:20.482579 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-79875323-5164-4874-8d02-f24463e432cf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:20.488773 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-79875323-5164-4874-8d02-f24463e432cf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:20.489220 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-79875323-5164-4874-8d02-f24463e432cf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:20.489988 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-79875323-5164-4874-8d02-f24463e432cf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:20.490421 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-79875323-5164-4874-8d02-f24463e432cf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:20.518438 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-79875323-5164-4874-8d02-f24463e432cf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040970 Jan 11 15:18:20.518970 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 505/998] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:20 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:21.530150 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-594678ef-09ac-46e6-8d3a-b3fe5a32b956 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:21.530990 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-594678ef-09ac-46e6-8d3a-b3fe5a32b956 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:21.537268 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-594678ef-09ac-46e6-8d3a-b3fe5a32b956 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:21.537723 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-594678ef-09ac-46e6-8d3a-b3fe5a32b956 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:21.538505 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-594678ef-09ac-46e6-8d3a-b3fe5a32b956 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:21.538952 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-594678ef-09ac-46e6-8d3a-b3fe5a32b956 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:21.566819 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-594678ef-09ac-46e6-8d3a-b3fe5a32b956 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041028 Jan 11 15:18:21.567453 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 494/999] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:21 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:22.577969 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-49ccc955-5324-48d0-9317-4d7765e17592 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:22.578801 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-49ccc955-5324-48d0-9317-4d7765e17592 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:22.585271 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-49ccc955-5324-48d0-9317-4d7765e17592 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:22.585713 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-49ccc955-5324-48d0-9317-4d7765e17592 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:22.586479 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-49ccc955-5324-48d0-9317-4d7765e17592 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:22.586911 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-49ccc955-5324-48d0-9317-4d7765e17592 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:22.615530 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-49ccc955-5324-48d0-9317-4d7765e17592 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041285 Jan 11 15:18:22.616062 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 506/1000] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:22 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:23.626660 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3ef693b2-5da9-489a-937d-6e7d8ca4eef6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:23.627593 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3ef693b2-5da9-489a-937d-6e7d8ca4eef6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:23.633397 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3ef693b2-5da9-489a-937d-6e7d8ca4eef6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:23.633844 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3ef693b2-5da9-489a-937d-6e7d8ca4eef6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:23.634613 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3ef693b2-5da9-489a-937d-6e7d8ca4eef6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:23.635099 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3ef693b2-5da9-489a-937d-6e7d8ca4eef6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:23.662848 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3ef693b2-5da9-489a-937d-6e7d8ca4eef6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040026 Jan 11 15:18:23.663405 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 495/1001] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:23 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:24.674229 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a57e27e1-b9f3-4bb7-92f0-3df92e1cb9db tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:24.675276 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a57e27e1-b9f3-4bb7-92f0-3df92e1cb9db tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:24.681095 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a57e27e1-b9f3-4bb7-92f0-3df92e1cb9db tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:24.681542 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a57e27e1-b9f3-4bb7-92f0-3df92e1cb9db tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:24.682841 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a57e27e1-b9f3-4bb7-92f0-3df92e1cb9db tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:24.683274 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a57e27e1-b9f3-4bb7-92f0-3df92e1cb9db tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:24.711546 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a57e27e1-b9f3-4bb7-92f0-3df92e1cb9db tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041257 Jan 11 15:18:24.712090 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 507/1002] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:24 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:25.722591 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-728df794-30c0-407f-9fed-4b2b15b6a6d6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:25.723615 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-728df794-30c0-407f-9fed-4b2b15b6a6d6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:25.730300 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-728df794-30c0-407f-9fed-4b2b15b6a6d6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:25.730747 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-728df794-30c0-407f-9fed-4b2b15b6a6d6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:25.731540 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-728df794-30c0-407f-9fed-4b2b15b6a6d6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:25.731981 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-728df794-30c0-407f-9fed-4b2b15b6a6d6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:25.760096 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-728df794-30c0-407f-9fed-4b2b15b6a6d6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041149 Jan 11 15:18:25.760566 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 496/1003] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:25 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:26.770836 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-14883c44-5dba-45b4-a292-1622bb41d726 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:26.771789 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-14883c44-5dba-45b4-a292-1622bb41d726 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:26.778741 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-14883c44-5dba-45b4-a292-1622bb41d726 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:26.779191 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-14883c44-5dba-45b4-a292-1622bb41d726 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:26.779992 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-14883c44-5dba-45b4-a292-1622bb41d726 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:26.780434 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-14883c44-5dba-45b4-a292-1622bb41d726 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:26.809284 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-14883c44-5dba-45b4-a292-1622bb41d726 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041870 Jan 11 15:18:26.810170 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 508/1004] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:26 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:27.821787 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f0c86fb9-9288-4925-8151-b8e7ac798e72 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:27.823245 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f0c86fb9-9288-4925-8151-b8e7ac798e72 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:27.829757 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f0c86fb9-9288-4925-8151-b8e7ac798e72 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:27.830154 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f0c86fb9-9288-4925-8151-b8e7ac798e72 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:27.831198 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f0c86fb9-9288-4925-8151-b8e7ac798e72 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:27.831667 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f0c86fb9-9288-4925-8151-b8e7ac798e72 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:27.859910 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f0c86fb9-9288-4925-8151-b8e7ac798e72 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041879 Jan 11 15:18:27.860451 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 497/1005] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:27 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:28.282116 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-63df5dee-bcc9-445f-9224-657607c9334c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:18:28.282116 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-63df5dee-bcc9-445f-9224-657607c9334c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:28.285616 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-63df5dee-bcc9-445f-9224-657607c9334c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:28.286119 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-63df5dee-bcc9-445f-9224-657607c9334c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:28.286863 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-63df5dee-bcc9-445f-9224-657607c9334c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:28.288776 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-63df5dee-bcc9-445f-9224-657607c9334c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:28.311380 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.objects.instance [None req-63df5dee-bcc9-445f-9224-657607c9334c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lazy-loading 'flavor' on Instance uuid 347a0a52-47fa-4799-97ca-551bc356aca0 {{(pid=116903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 15:18:28.530616 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-63df5dee-bcc9-445f-9224-657607c9334c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "POST /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0/action" status: 202 len: 0 microversion: 2.1 time: 0.255914 Jan 11 15:18:28.531198 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 509/1006] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:18:28 2022] POST /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:18:28.539275 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6db08f7b-142f-439e-8d3b-b8d3146dc073 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:28.545260 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6db08f7b-142f-439e-8d3b-b8d3146dc073 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:28.545791 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6db08f7b-142f-439e-8d3b-b8d3146dc073 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:28.546241 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6db08f7b-142f-439e-8d3b-b8d3146dc073 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:28.547016 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6db08f7b-142f-439e-8d3b-b8d3146dc073 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:28.547475 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6db08f7b-142f-439e-8d3b-b8d3146dc073 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:28.731944 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6db08f7b-142f-439e-8d3b-b8d3146dc073 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:18:28.739327 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6db08f7b-142f-439e-8d3b-b8d3146dc073 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.203718 Jan 11 15:18:28.739894 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 498/1007] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:18:28 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:18:28.872410 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-edf034be-5d93-4921-89ba-dc4e5144e1ad tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:28.873342 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-edf034be-5d93-4921-89ba-dc4e5144e1ad tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:28.879422 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-edf034be-5d93-4921-89ba-dc4e5144e1ad tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:28.879874 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-edf034be-5d93-4921-89ba-dc4e5144e1ad tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:28.880639 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-edf034be-5d93-4921-89ba-dc4e5144e1ad tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:28.881076 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-edf034be-5d93-4921-89ba-dc4e5144e1ad tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:28.908557 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-edf034be-5d93-4921-89ba-dc4e5144e1ad tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041059 Jan 11 15:18:28.909092 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 510/1008] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:28 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:29.756484 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1ae06335-0172-46fb-9f27-54ffffdc1a43 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:29.757113 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1ae06335-0172-46fb-9f27-54ffffdc1a43 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:29.763847 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1ae06335-0172-46fb-9f27-54ffffdc1a43 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:29.764291 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1ae06335-0172-46fb-9f27-54ffffdc1a43 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:29.765057 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1ae06335-0172-46fb-9f27-54ffffdc1a43 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:29.765493 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1ae06335-0172-46fb-9f27-54ffffdc1a43 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:29.890879 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1ae06335-0172-46fb-9f27-54ffffdc1a43 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:18:29.898065 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1ae06335-0172-46fb-9f27-54ffffdc1a43 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.145174 Jan 11 15:18:29.898639 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 499/1009] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:18:29 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:18:29.920408 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-07e78a5b-2d86-4238-ada1-8b9489e1a871 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:29.921254 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-07e78a5b-2d86-4238-ada1-8b9489e1a871 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:29.927389 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-07e78a5b-2d86-4238-ada1-8b9489e1a871 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:29.927841 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-07e78a5b-2d86-4238-ada1-8b9489e1a871 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:29.928613 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-07e78a5b-2d86-4238-ada1-8b9489e1a871 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:29.929053 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-07e78a5b-2d86-4238-ada1-8b9489e1a871 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:29.957145 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-07e78a5b-2d86-4238-ada1-8b9489e1a871 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041186 Jan 11 15:18:29.957673 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 511/1010] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:29 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:30.915227 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-55a38d00-c140-4e20-8f02-c16260a3603a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:30.915878 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-55a38d00-c140-4e20-8f02-c16260a3603a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:30.922588 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-55a38d00-c140-4e20-8f02-c16260a3603a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:30.923040 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-55a38d00-c140-4e20-8f02-c16260a3603a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:30.923850 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-55a38d00-c140-4e20-8f02-c16260a3603a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:30.924293 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-55a38d00-c140-4e20-8f02-c16260a3603a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:30.968524 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-0e2a78ef-1adb-40f1-a431-6e98e3fea4d0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:30.969349 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-0e2a78ef-1adb-40f1-a431-6e98e3fea4d0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:30.975736 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0e2a78ef-1adb-40f1-a431-6e98e3fea4d0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:30.976182 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0e2a78ef-1adb-40f1-a431-6e98e3fea4d0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:30.976947 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0e2a78ef-1adb-40f1-a431-6e98e3fea4d0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:30.977384 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0e2a78ef-1adb-40f1-a431-6e98e3fea4d0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:31.009492 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-0e2a78ef-1adb-40f1-a431-6e98e3fea4d0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044782 Jan 11 15:18:31.009892 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 512/1011] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:30 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:18:31.058638 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-55a38d00-c140-4e20-8f02-c16260a3603a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:18:31.066659 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-55a38d00-c140-4e20-8f02-c16260a3603a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.155083 Jan 11 15:18:31.067228 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 500/1012] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:18:30 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:18:32.020806 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a0b7382c-e427-4dac-972a-da60c8e046f5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:32.021627 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a0b7382c-e427-4dac-972a-da60c8e046f5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:32.028601 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a0b7382c-e427-4dac-972a-da60c8e046f5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:32.029050 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a0b7382c-e427-4dac-972a-da60c8e046f5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:32.029816 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a0b7382c-e427-4dac-972a-da60c8e046f5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:32.030249 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a0b7382c-e427-4dac-972a-da60c8e046f5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:32.060930 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a0b7382c-e427-4dac-972a-da60c8e046f5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044176 Jan 11 15:18:32.061472 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 513/1013] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:32 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:32.083385 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-cfb9b0b7-36ac-4136-b281-d0289b18b55a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:32.083999 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-cfb9b0b7-36ac-4136-b281-d0289b18b55a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:32.090287 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cfb9b0b7-36ac-4136-b281-d0289b18b55a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:32.090743 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cfb9b0b7-36ac-4136-b281-d0289b18b55a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:32.091545 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cfb9b0b7-36ac-4136-b281-d0289b18b55a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:32.091985 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cfb9b0b7-36ac-4136-b281-d0289b18b55a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:32.218328 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-cfb9b0b7-36ac-4136-b281-d0289b18b55a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:18:32.225560 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-cfb9b0b7-36ac-4136-b281-d0289b18b55a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.146066 Jan 11 15:18:32.226115 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 501/1014] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:18:32 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:18:33.071477 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-947c5eb8-9932-48f6-8c57-0bf9d5643a81 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:33.072312 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-947c5eb8-9932-48f6-8c57-0bf9d5643a81 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:33.079051 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-947c5eb8-9932-48f6-8c57-0bf9d5643a81 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:33.079533 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-947c5eb8-9932-48f6-8c57-0bf9d5643a81 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:33.080302 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-947c5eb8-9932-48f6-8c57-0bf9d5643a81 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:33.080997 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-947c5eb8-9932-48f6-8c57-0bf9d5643a81 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:33.108543 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-947c5eb8-9932-48f6-8c57-0bf9d5643a81 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040886 Jan 11 15:18:33.109076 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 514/1015] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:33 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:33.241688 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f0ae7d9a-a52e-4534-8fea-5ad1d5c08b1c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:33.242298 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f0ae7d9a-a52e-4534-8fea-5ad1d5c08b1c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:33.249276 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f0ae7d9a-a52e-4534-8fea-5ad1d5c08b1c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:33.250198 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f0ae7d9a-a52e-4534-8fea-5ad1d5c08b1c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:33.250521 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f0ae7d9a-a52e-4534-8fea-5ad1d5c08b1c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:33.250932 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f0ae7d9a-a52e-4534-8fea-5ad1d5c08b1c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:33.410731 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f0ae7d9a-a52e-4534-8fea-5ad1d5c08b1c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:18:33.410731 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f0ae7d9a-a52e-4534-8fea-5ad1d5c08b1c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.153227 Jan 11 15:18:33.410731 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 502/1016] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:18:33 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:18:34.119838 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-017348ef-c0ec-42b4-91ef-4503f149d187 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:34.120666 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-017348ef-c0ec-42b4-91ef-4503f149d187 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:34.127493 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-017348ef-c0ec-42b4-91ef-4503f149d187 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:34.127945 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-017348ef-c0ec-42b4-91ef-4503f149d187 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:34.128709 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-017348ef-c0ec-42b4-91ef-4503f149d187 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:34.129142 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-017348ef-c0ec-42b4-91ef-4503f149d187 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:34.156958 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-017348ef-c0ec-42b4-91ef-4503f149d187 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040913 Jan 11 15:18:34.157493 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 515/1017] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:34 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:34.407895 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b708b252-007e-49c6-a778-7ece260e34ef tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:34.408504 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b708b252-007e-49c6-a778-7ece260e34ef tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:34.414738 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b708b252-007e-49c6-a778-7ece260e34ef tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:34.415221 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b708b252-007e-49c6-a778-7ece260e34ef tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:34.416060 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b708b252-007e-49c6-a778-7ece260e34ef tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:34.416502 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b708b252-007e-49c6-a778-7ece260e34ef tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:34.544588 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b708b252-007e-49c6-a778-7ece260e34ef tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:18:34.551837 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b708b252-007e-49c6-a778-7ece260e34ef tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.147630 Jan 11 15:18:34.552503 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 503/1018] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:18:34 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:18:35.168293 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-822b8338-6659-4fe3-a118-82bfcf5de24b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:35.169170 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-822b8338-6659-4fe3-a118-82bfcf5de24b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:35.175388 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-822b8338-6659-4fe3-a118-82bfcf5de24b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:35.175835 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-822b8338-6659-4fe3-a118-82bfcf5de24b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:35.176600 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-822b8338-6659-4fe3-a118-82bfcf5de24b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:35.177031 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-822b8338-6659-4fe3-a118-82bfcf5de24b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:35.205755 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-822b8338-6659-4fe3-a118-82bfcf5de24b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041169 Jan 11 15:18:35.206296 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 516/1019] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:35 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:35.568126 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c18ae4e2-a14a-44d9-9129-d5de1e98dec7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:35.568779 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c18ae4e2-a14a-44d9-9129-d5de1e98dec7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:35.575043 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c18ae4e2-a14a-44d9-9129-d5de1e98dec7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:35.575520 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c18ae4e2-a14a-44d9-9129-d5de1e98dec7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:35.576305 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c18ae4e2-a14a-44d9-9129-d5de1e98dec7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:35.576743 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c18ae4e2-a14a-44d9-9129-d5de1e98dec7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:35.704742 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c18ae4e2-a14a-44d9-9129-d5de1e98dec7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:18:35.712402 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c18ae4e2-a14a-44d9-9129-d5de1e98dec7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.147843 Jan 11 15:18:35.712961 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 504/1020] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:18:35 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:18:36.216148 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-0e550406-bb32-4d25-8bba-57d54f264036 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:36.216991 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-0e550406-bb32-4d25-8bba-57d54f264036 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:36.223236 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0e550406-bb32-4d25-8bba-57d54f264036 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:36.223713 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0e550406-bb32-4d25-8bba-57d54f264036 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:36.224486 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0e550406-bb32-4d25-8bba-57d54f264036 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:36.224925 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0e550406-bb32-4d25-8bba-57d54f264036 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:36.254304 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-0e550406-bb32-4d25-8bba-57d54f264036 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041923 Jan 11 15:18:36.254861 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 517/1021] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:36 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:36.728674 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5ed80874-5c61-47be-af52-9e39fab6cea5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:36.729280 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5ed80874-5c61-47be-af52-9e39fab6cea5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:36.735445 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5ed80874-5c61-47be-af52-9e39fab6cea5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:36.735912 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5ed80874-5c61-47be-af52-9e39fab6cea5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:36.736663 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5ed80874-5c61-47be-af52-9e39fab6cea5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:36.737104 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5ed80874-5c61-47be-af52-9e39fab6cea5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:36.866851 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-5ed80874-5c61-47be-af52-9e39fab6cea5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:18:36.874721 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5ed80874-5c61-47be-af52-9e39fab6cea5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.149625 Jan 11 15:18:36.875281 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 505/1022] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:18:36 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:18:37.265363 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-08947bcd-fc43-4bab-8f0a-3940dea2c2f5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:37.266215 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-08947bcd-fc43-4bab-8f0a-3940dea2c2f5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:37.272477 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-08947bcd-fc43-4bab-8f0a-3940dea2c2f5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:37.272928 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-08947bcd-fc43-4bab-8f0a-3940dea2c2f5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:37.273724 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-08947bcd-fc43-4bab-8f0a-3940dea2c2f5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:37.274160 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-08947bcd-fc43-4bab-8f0a-3940dea2c2f5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:37.303401 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-08947bcd-fc43-4bab-8f0a-3940dea2c2f5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041758 Jan 11 15:18:37.303953 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 518/1023] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:37 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:37.891680 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-130b7e9e-46ec-4ec0-bccd-fb8cd85c36f4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:37.892210 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-130b7e9e-46ec-4ec0-bccd-fb8cd85c36f4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:37.898419 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-130b7e9e-46ec-4ec0-bccd-fb8cd85c36f4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:37.898869 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-130b7e9e-46ec-4ec0-bccd-fb8cd85c36f4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:37.899672 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-130b7e9e-46ec-4ec0-bccd-fb8cd85c36f4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:37.900113 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-130b7e9e-46ec-4ec0-bccd-fb8cd85c36f4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:38.025623 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-130b7e9e-46ec-4ec0-bccd-fb8cd85c36f4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:18:38.033439 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-130b7e9e-46ec-4ec0-bccd-fb8cd85c36f4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.145462 Jan 11 15:18:38.039341 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 506/1024] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:18:37 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:18:38.314312 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-76424294-b7c8-404b-a414-0e4e80dfb50d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:38.315256 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-76424294-b7c8-404b-a414-0e4e80dfb50d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:38.321805 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-76424294-b7c8-404b-a414-0e4e80dfb50d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:38.322258 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-76424294-b7c8-404b-a414-0e4e80dfb50d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:38.323027 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-76424294-b7c8-404b-a414-0e4e80dfb50d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:38.323650 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-76424294-b7c8-404b-a414-0e4e80dfb50d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:38.352125 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-76424294-b7c8-404b-a414-0e4e80dfb50d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041549 Jan 11 15:18:38.352656 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 519/1025] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:38 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:39.049847 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-44461f50-31d6-416f-81dd-f8045b1954d3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:39.050433 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-44461f50-31d6-416f-81dd-f8045b1954d3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:39.056646 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-44461f50-31d6-416f-81dd-f8045b1954d3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:39.057094 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-44461f50-31d6-416f-81dd-f8045b1954d3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:39.057867 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-44461f50-31d6-416f-81dd-f8045b1954d3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:39.058302 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-44461f50-31d6-416f-81dd-f8045b1954d3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:39.190566 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-44461f50-31d6-416f-81dd-f8045b1954d3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:18:39.197872 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-44461f50-31d6-416f-81dd-f8045b1954d3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.151677 Jan 11 15:18:39.198443 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 507/1026] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:18:39 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:18:39.363002 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-9c74e555-11c6-47b3-ba9a-b8a514686502 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:39.363947 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-9c74e555-11c6-47b3-ba9a-b8a514686502 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:39.370113 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9c74e555-11c6-47b3-ba9a-b8a514686502 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:39.370559 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9c74e555-11c6-47b3-ba9a-b8a514686502 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:39.371931 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9c74e555-11c6-47b3-ba9a-b8a514686502 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:39.372385 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9c74e555-11c6-47b3-ba9a-b8a514686502 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:39.400108 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-9c74e555-11c6-47b3-ba9a-b8a514686502 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040821 Jan 11 15:18:39.400638 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 520/1027] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:39 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:40.216177 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-427cd75a-05ae-4a33-8786-791a38235c28 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:40.217003 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-427cd75a-05ae-4a33-8786-791a38235c28 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:40.223411 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-427cd75a-05ae-4a33-8786-791a38235c28 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:40.223901 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-427cd75a-05ae-4a33-8786-791a38235c28 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:40.224811 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-427cd75a-05ae-4a33-8786-791a38235c28 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:40.225275 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-427cd75a-05ae-4a33-8786-791a38235c28 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:40.353058 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-427cd75a-05ae-4a33-8786-791a38235c28 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:18:40.360271 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-427cd75a-05ae-4a33-8786-791a38235c28 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.148387 Jan 11 15:18:40.360841 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 508/1028] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:18:40 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:18:40.411218 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-cd27a9a1-d14d-4c5a-a1e3-22d6c20b2133 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:40.412063 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-cd27a9a1-d14d-4c5a-a1e3-22d6c20b2133 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:40.418222 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cd27a9a1-d14d-4c5a-a1e3-22d6c20b2133 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:40.418667 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cd27a9a1-d14d-4c5a-a1e3-22d6c20b2133 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:40.419478 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cd27a9a1-d14d-4c5a-a1e3-22d6c20b2133 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:40.419911 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cd27a9a1-d14d-4c5a-a1e3-22d6c20b2133 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:40.447809 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-cd27a9a1-d14d-4c5a-a1e3-22d6c20b2133 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040233 Jan 11 15:18:40.448346 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 521/1029] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:40 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:41.376712 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4269d3a4-6ba6-4c4d-a96a-cdd911cf6574 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:41.377350 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-4269d3a4-6ba6-4c4d-a96a-cdd911cf6574 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:41.383598 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4269d3a4-6ba6-4c4d-a96a-cdd911cf6574 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:41.384053 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4269d3a4-6ba6-4c4d-a96a-cdd911cf6574 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:41.384826 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4269d3a4-6ba6-4c4d-a96a-cdd911cf6574 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:41.385270 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4269d3a4-6ba6-4c4d-a96a-cdd911cf6574 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:41.460053 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e32733f6-053d-4b95-9443-73e698f29c15 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:41.460899 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e32733f6-053d-4b95-9443-73e698f29c15 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:41.467735 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e32733f6-053d-4b95-9443-73e698f29c15 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:41.468190 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e32733f6-053d-4b95-9443-73e698f29c15 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:41.468960 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e32733f6-053d-4b95-9443-73e698f29c15 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:41.469402 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e32733f6-053d-4b95-9443-73e698f29c15 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:41.498498 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e32733f6-053d-4b95-9443-73e698f29c15 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042303 Jan 11 15:18:41.499076 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 522/1030] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:41 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:18:41.515756 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-4269d3a4-6ba6-4c4d-a96a-cdd911cf6574 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:18:41.522987 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4269d3a4-6ba6-4c4d-a96a-cdd911cf6574 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.149934 Jan 11 15:18:41.523588 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 509/1031] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:18:41 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:18:42.509836 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-03a89c56-6828-4afe-b829-9f0609fc2472 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:42.510787 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-03a89c56-6828-4afe-b829-9f0609fc2472 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:42.517654 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-03a89c56-6828-4afe-b829-9f0609fc2472 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:42.518116 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-03a89c56-6828-4afe-b829-9f0609fc2472 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:42.518896 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-03a89c56-6828-4afe-b829-9f0609fc2472 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:42.519365 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-03a89c56-6828-4afe-b829-9f0609fc2472 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:42.540156 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-dd8f4f22-aa40-4cd7-9085-0215c8926d89 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:42.540761 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-dd8f4f22-aa40-4cd7-9085-0215c8926d89 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:42.546939 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dd8f4f22-aa40-4cd7-9085-0215c8926d89 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:42.547413 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dd8f4f22-aa40-4cd7-9085-0215c8926d89 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:42.548187 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dd8f4f22-aa40-4cd7-9085-0215c8926d89 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:42.548350 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-03a89c56-6828-4afe-b829-9f0609fc2472 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042325 Jan 11 15:18:42.548618 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dd8f4f22-aa40-4cd7-9085-0215c8926d89 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:42.548906 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 523/1032] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:42 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:42.678600 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-dd8f4f22-aa40-4cd7-9085-0215c8926d89 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:18:42.686346 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-dd8f4f22-aa40-4cd7-9085-0215c8926d89 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.150010 Jan 11 15:18:42.686911 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 510/1033] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:18:42 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:18:43.560173 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-5b4b847b-df57-48f2-9dc9-3b8668637fea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:43.561091 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-5b4b847b-df57-48f2-9dc9-3b8668637fea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:43.567415 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5b4b847b-df57-48f2-9dc9-3b8668637fea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:43.567878 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5b4b847b-df57-48f2-9dc9-3b8668637fea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:43.568662 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5b4b847b-df57-48f2-9dc9-3b8668637fea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:43.569106 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5b4b847b-df57-48f2-9dc9-3b8668637fea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:43.598046 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-5b4b847b-df57-48f2-9dc9-3b8668637fea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042172 Jan 11 15:18:43.598592 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 524/1034] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:43 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:43.702549 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a30b97e3-5d61-4ca2-8846-a0610fcc67d7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:43.703159 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a30b97e3-5d61-4ca2-8846-a0610fcc67d7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:43.709665 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a30b97e3-5d61-4ca2-8846-a0610fcc67d7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:43.710115 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a30b97e3-5d61-4ca2-8846-a0610fcc67d7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:43.710924 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a30b97e3-5d61-4ca2-8846-a0610fcc67d7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:43.711416 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a30b97e3-5d61-4ca2-8846-a0610fcc67d7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:43.872826 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a30b97e3-5d61-4ca2-8846-a0610fcc67d7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:18:43.880281 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a30b97e3-5d61-4ca2-8846-a0610fcc67d7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.181278 Jan 11 15:18:43.880854 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 511/1035] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:18:43 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:18:44.609255 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-0d77c46f-1f24-49c2-8ab6-824a45df836d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:44.610084 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-0d77c46f-1f24-49c2-8ab6-824a45df836d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:44.616228 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0d77c46f-1f24-49c2-8ab6-824a45df836d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:44.616676 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0d77c46f-1f24-49c2-8ab6-824a45df836d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:44.617440 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0d77c46f-1f24-49c2-8ab6-824a45df836d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:44.617875 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0d77c46f-1f24-49c2-8ab6-824a45df836d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:44.646390 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-0d77c46f-1f24-49c2-8ab6-824a45df836d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040972 Jan 11 15:18:44.646933 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 525/1036] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:44 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:44.896847 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d744daa1-f2f8-4ec5-bbf8-b55c1612e546 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:44.897460 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d744daa1-f2f8-4ec5-bbf8-b55c1612e546 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:44.903830 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d744daa1-f2f8-4ec5-bbf8-b55c1612e546 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:44.904284 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d744daa1-f2f8-4ec5-bbf8-b55c1612e546 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:44.905065 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d744daa1-f2f8-4ec5-bbf8-b55c1612e546 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:44.905506 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d744daa1-f2f8-4ec5-bbf8-b55c1612e546 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:45.040957 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d744daa1-f2f8-4ec5-bbf8-b55c1612e546 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:18:45.049437 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d744daa1-f2f8-4ec5-bbf8-b55c1612e546 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.156089 Jan 11 15:18:45.050177 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 512/1037] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:18:44 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:18:45.657351 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f7db3fef-57f6-48d5-bd40-efab791f122c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:45.658171 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f7db3fef-57f6-48d5-bd40-efab791f122c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:45.664448 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f7db3fef-57f6-48d5-bd40-efab791f122c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:45.664895 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f7db3fef-57f6-48d5-bd40-efab791f122c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:45.665666 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f7db3fef-57f6-48d5-bd40-efab791f122c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:45.666101 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f7db3fef-57f6-48d5-bd40-efab791f122c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:45.694014 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f7db3fef-57f6-48d5-bd40-efab791f122c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040482 Jan 11 15:18:45.694550 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 526/1038] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:45 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:46.067125 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6e374747-1602-484f-afeb-c2e4736f427f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:46.067767 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6e374747-1602-484f-afeb-c2e4736f427f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:46.073942 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6e374747-1602-484f-afeb-c2e4736f427f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:46.074399 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6e374747-1602-484f-afeb-c2e4736f427f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:46.075193 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6e374747-1602-484f-afeb-c2e4736f427f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:46.075663 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6e374747-1602-484f-afeb-c2e4736f427f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:46.206753 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6e374747-1602-484f-afeb-c2e4736f427f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:18:46.214136 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6e374747-1602-484f-afeb-c2e4736f427f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.150653 Jan 11 15:18:46.214707 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 513/1039] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:18:46 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:18:46.706492 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-abd88b3b-3472-4051-8216-59a72dbc99a7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:46.707425 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-abd88b3b-3472-4051-8216-59a72dbc99a7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:46.713479 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-abd88b3b-3472-4051-8216-59a72dbc99a7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:46.713925 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-abd88b3b-3472-4051-8216-59a72dbc99a7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:46.714692 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-abd88b3b-3472-4051-8216-59a72dbc99a7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:46.715759 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-abd88b3b-3472-4051-8216-59a72dbc99a7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:46.743957 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-abd88b3b-3472-4051-8216-59a72dbc99a7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041407 Jan 11 15:18:46.744511 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 527/1040] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:46 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:47.230422 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6cf4b225-d41c-40e8-b925-5863d3bb5c8a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:47.231064 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6cf4b225-d41c-40e8-b925-5863d3bb5c8a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:47.237355 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6cf4b225-d41c-40e8-b925-5863d3bb5c8a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:47.237802 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6cf4b225-d41c-40e8-b925-5863d3bb5c8a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:47.238596 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6cf4b225-d41c-40e8-b925-5863d3bb5c8a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:47.239017 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6cf4b225-d41c-40e8-b925-5863d3bb5c8a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:47.364160 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6cf4b225-d41c-40e8-b925-5863d3bb5c8a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:18:47.371913 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6cf4b225-d41c-40e8-b925-5863d3bb5c8a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.144637 Jan 11 15:18:47.372495 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 514/1041] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:18:47 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:18:47.755282 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-93e3d68e-6754-4e45-89a6-dcb54dce2413 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:47.756220 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-93e3d68e-6754-4e45-89a6-dcb54dce2413 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:47.762428 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-93e3d68e-6754-4e45-89a6-dcb54dce2413 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:47.762883 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-93e3d68e-6754-4e45-89a6-dcb54dce2413 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:47.767451 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-93e3d68e-6754-4e45-89a6-dcb54dce2413 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:47.767451 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-93e3d68e-6754-4e45-89a6-dcb54dce2413 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:47.793850 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-93e3d68e-6754-4e45-89a6-dcb54dce2413 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041782 Jan 11 15:18:47.797390 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 528/1042] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:47 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:48.389246 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d7511975-4198-416c-aec5-edd27dfad7ac tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:48.389856 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d7511975-4198-416c-aec5-edd27dfad7ac tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:48.396047 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d7511975-4198-416c-aec5-edd27dfad7ac tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:48.396492 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d7511975-4198-416c-aec5-edd27dfad7ac tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:48.397265 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d7511975-4198-416c-aec5-edd27dfad7ac tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:48.397699 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d7511975-4198-416c-aec5-edd27dfad7ac tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:48.529404 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d7511975-4198-416c-aec5-edd27dfad7ac tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:18:48.536613 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d7511975-4198-416c-aec5-edd27dfad7ac tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.151491 Jan 11 15:18:48.540093 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 515/1043] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:18:48 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:18:48.804702 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-819e6447-8c2e-4e15-8cf2-640ddd861577 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:48.805716 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-819e6447-8c2e-4e15-8cf2-640ddd861577 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:48.812149 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-819e6447-8c2e-4e15-8cf2-640ddd861577 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:48.812600 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-819e6447-8c2e-4e15-8cf2-640ddd861577 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:48.813372 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-819e6447-8c2e-4e15-8cf2-640ddd861577 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:48.813808 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-819e6447-8c2e-4e15-8cf2-640ddd861577 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:48.843285 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-819e6447-8c2e-4e15-8cf2-640ddd861577 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042288 Jan 11 15:18:48.843865 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 516/1044] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:48 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:18:48.861695 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [req-a1406cae-5eb6-4d4e-8854-eb77c26b6c1e req-9e1111d2-4ae6-415a-96f2-1901f6b7095e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "347a0a52-47fa-4799-97ca-551bc356aca0", "name": "network-vif-unplugged", "status": "completed", "tag": "8250fb01-566c-404c-940f-8347fdacb6b4"}]} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:18:48.863247 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:18:48.863247 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: warnings.warn(msg) Jan 11 15:18:48.869912 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-a1406cae-5eb6-4d4e-8854-eb77c26b6c1e req-9e1111d2-4ae6-415a-96f2-1901f6b7095e service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:48.870353 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-a1406cae-5eb6-4d4e-8854-eb77c26b6c1e req-9e1111d2-4ae6-415a-96f2-1901f6b7095e service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:48.881208 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.compute.server_external_events [req-a1406cae-5eb6-4d4e-8854-eb77c26b6c1e req-9e1111d2-4ae6-415a-96f2-1901f6b7095e service nova] Creating event network-vif-unplugged:8250fb01-566c-404c-940f-8347fdacb6b4 for instance 347a0a52-47fa-4799-97ca-551bc356aca0 on hv-cinder-82418 Jan 11 15:18:48.886406 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [req-a1406cae-5eb6-4d4e-8854-eb77c26b6c1e req-9e1111d2-4ae6-415a-96f2-1901f6b7095e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088627 Jan 11 15:18:48.887363 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 529/1045] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:49.553051 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d94df049-a6f4-447f-b02b-7c09e6c0ad90 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:49.553599 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d94df049-a6f4-447f-b02b-7c09e6c0ad90 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:49.559895 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d94df049-a6f4-447f-b02b-7c09e6c0ad90 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:49.560349 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d94df049-a6f4-447f-b02b-7c09e6c0ad90 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:49.561128 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d94df049-a6f4-447f-b02b-7c09e6c0ad90 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:49.561564 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d94df049-a6f4-447f-b02b-7c09e6c0ad90 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:49.686388 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d94df049-a6f4-447f-b02b-7c09e6c0ad90 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:18:49.693683 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d94df049-a6f4-447f-b02b-7c09e6c0ad90 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.144349 Jan 11 15:18:49.694255 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 517/1046] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:18:49 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:18:49.854987 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-46abdad2-9952-493e-9207-9f9f98f8d26d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:49.855996 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-46abdad2-9952-493e-9207-9f9f98f8d26d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:49.862228 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-46abdad2-9952-493e-9207-9f9f98f8d26d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:49.862798 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-46abdad2-9952-493e-9207-9f9f98f8d26d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:49.863483 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-46abdad2-9952-493e-9207-9f9f98f8d26d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:49.863926 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-46abdad2-9952-493e-9207-9f9f98f8d26d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:49.892742 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-46abdad2-9952-493e-9207-9f9f98f8d26d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042471 Jan 11 15:18:49.893277 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 530/1047] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:49 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:50.710242 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-372c3f35-44ac-432b-a3e2-6bfa0a19ba54 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:50.710846 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-372c3f35-44ac-432b-a3e2-6bfa0a19ba54 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:50.717310 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-372c3f35-44ac-432b-a3e2-6bfa0a19ba54 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:50.721151 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-372c3f35-44ac-432b-a3e2-6bfa0a19ba54 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:50.721151 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-372c3f35-44ac-432b-a3e2-6bfa0a19ba54 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:50.721151 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-372c3f35-44ac-432b-a3e2-6bfa0a19ba54 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:50.853737 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-372c3f35-44ac-432b-a3e2-6bfa0a19ba54 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:18:50.861050 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-372c3f35-44ac-432b-a3e2-6bfa0a19ba54 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.154316 Jan 11 15:18:50.861542 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 518/1048] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:18:50 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:18:50.904355 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-05d37ad4-333c-4a76-b3a3-fccfbcf88469 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:50.905256 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-05d37ad4-333c-4a76-b3a3-fccfbcf88469 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:50.911470 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-05d37ad4-333c-4a76-b3a3-fccfbcf88469 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:50.911919 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-05d37ad4-333c-4a76-b3a3-fccfbcf88469 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:50.912728 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-05d37ad4-333c-4a76-b3a3-fccfbcf88469 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:50.913163 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-05d37ad4-333c-4a76-b3a3-fccfbcf88469 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:50.941153 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-05d37ad4-333c-4a76-b3a3-fccfbcf88469 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041053 Jan 11 15:18:50.941693 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 531/1049] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:50 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:51.877848 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6313914b-a448-478d-b56a-c1df9e37948e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:51.878393 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6313914b-a448-478d-b56a-c1df9e37948e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:51.884165 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6313914b-a448-478d-b56a-c1df9e37948e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:51.884613 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6313914b-a448-478d-b56a-c1df9e37948e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:51.885379 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6313914b-a448-478d-b56a-c1df9e37948e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:51.885816 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6313914b-a448-478d-b56a-c1df9e37948e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:51.952411 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-58a7b5b2-d2e1-4656-8cfa-9a75a3c830fa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:51.953439 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-58a7b5b2-d2e1-4656-8cfa-9a75a3c830fa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:51.959952 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-58a7b5b2-d2e1-4656-8cfa-9a75a3c830fa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:51.960405 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-58a7b5b2-d2e1-4656-8cfa-9a75a3c830fa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:51.961185 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-58a7b5b2-d2e1-4656-8cfa-9a75a3c830fa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:51.961742 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-58a7b5b2-d2e1-4656-8cfa-9a75a3c830fa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:51.990798 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-58a7b5b2-d2e1-4656-8cfa-9a75a3c830fa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042107 Jan 11 15:18:51.991372 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 532/1050] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:51 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:18:52.013339 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6313914b-a448-478d-b56a-c1df9e37948e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:18:52.020584 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6313914b-a448-478d-b56a-c1df9e37948e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.146570 Jan 11 15:18:52.021145 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 519/1051] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:18:51 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:18:53.002132 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-885f78ee-0ab1-48ce-ad90-4cd3a609f46c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:53.003069 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-885f78ee-0ab1-48ce-ad90-4cd3a609f46c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:53.010121 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-885f78ee-0ab1-48ce-ad90-4cd3a609f46c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:53.010577 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-885f78ee-0ab1-48ce-ad90-4cd3a609f46c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:53.011404 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-885f78ee-0ab1-48ce-ad90-4cd3a609f46c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:53.011850 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-885f78ee-0ab1-48ce-ad90-4cd3a609f46c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:53.044828 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-885f78ee-0ab1-48ce-ad90-4cd3a609f46c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046448 Jan 11 15:18:53.048768 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 533/1052] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:52 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:53.144685 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-39819eb8-af0b-47d4-a6fb-e2c6e3a9bd91 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:53.145297 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-39819eb8-af0b-47d4-a6fb-e2c6e3a9bd91 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:53.151000 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-39819eb8-af0b-47d4-a6fb-e2c6e3a9bd91 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:53.151484 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-39819eb8-af0b-47d4-a6fb-e2c6e3a9bd91 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:53.152253 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-39819eb8-af0b-47d4-a6fb-e2c6e3a9bd91 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:53.152687 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-39819eb8-af0b-47d4-a6fb-e2c6e3a9bd91 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:53.286286 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-39819eb8-af0b-47d4-a6fb-e2c6e3a9bd91 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:18:53.302050 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-39819eb8-af0b-47d4-a6fb-e2c6e3a9bd91 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.259877 Jan 11 15:18:53.302050 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 520/1053] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:18:53 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:18:54.056084 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-0c7da5ed-ada7-46d3-878b-7e2055928d1d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:54.056997 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-0c7da5ed-ada7-46d3-878b-7e2055928d1d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:54.063337 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0c7da5ed-ada7-46d3-878b-7e2055928d1d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:54.063793 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0c7da5ed-ada7-46d3-878b-7e2055928d1d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:54.064570 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0c7da5ed-ada7-46d3-878b-7e2055928d1d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:54.065011 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0c7da5ed-ada7-46d3-878b-7e2055928d1d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:54.093767 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-0c7da5ed-ada7-46d3-878b-7e2055928d1d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041570 Jan 11 15:18:54.094307 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 534/1054] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:54 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:54.310917 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d7dc3f1c-06ca-4af0-b890-025891878bbd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:54.311476 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d7dc3f1c-06ca-4af0-b890-025891878bbd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:54.317694 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d7dc3f1c-06ca-4af0-b890-025891878bbd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:54.318138 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d7dc3f1c-06ca-4af0-b890-025891878bbd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:54.318954 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d7dc3f1c-06ca-4af0-b890-025891878bbd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:54.319422 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d7dc3f1c-06ca-4af0-b890-025891878bbd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:54.444258 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d7dc3f1c-06ca-4af0-b890-025891878bbd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:18:54.451550 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d7dc3f1c-06ca-4af0-b890-025891878bbd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.144866 Jan 11 15:18:54.452123 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 521/1055] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:18:54 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:18:55.105758 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b957a8ba-7f0e-4af4-b7ea-726a8956bafa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:55.106575 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b957a8ba-7f0e-4af4-b7ea-726a8956bafa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:55.112739 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b957a8ba-7f0e-4af4-b7ea-726a8956bafa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:55.113184 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b957a8ba-7f0e-4af4-b7ea-726a8956bafa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:55.114006 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b957a8ba-7f0e-4af4-b7ea-726a8956bafa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:55.114441 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b957a8ba-7f0e-4af4-b7ea-726a8956bafa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:55.142511 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b957a8ba-7f0e-4af4-b7ea-726a8956bafa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041128 Jan 11 15:18:55.143050 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 535/1056] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:55 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:55.467869 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4c229622-1ced-40e2-a898-9d8c50b0d2f7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:55.468425 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-4c229622-1ced-40e2-a898-9d8c50b0d2f7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:55.474593 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4c229622-1ced-40e2-a898-9d8c50b0d2f7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:55.475041 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4c229622-1ced-40e2-a898-9d8c50b0d2f7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:55.475846 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4c229622-1ced-40e2-a898-9d8c50b0d2f7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:55.476290 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4c229622-1ced-40e2-a898-9d8c50b0d2f7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:55.604870 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-4c229622-1ced-40e2-a898-9d8c50b0d2f7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:18:55.612306 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4c229622-1ced-40e2-a898-9d8c50b0d2f7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.148126 Jan 11 15:18:55.612878 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 522/1057] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:18:55 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:18:56.154356 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-1469efc8-fff1-4347-84fe-aa612f6b919c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:56.155335 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-1469efc8-fff1-4347-84fe-aa612f6b919c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:56.161508 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1469efc8-fff1-4347-84fe-aa612f6b919c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:56.161958 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1469efc8-fff1-4347-84fe-aa612f6b919c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:56.162731 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1469efc8-fff1-4347-84fe-aa612f6b919c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:56.163169 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1469efc8-fff1-4347-84fe-aa612f6b919c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:56.191704 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-1469efc8-fff1-4347-84fe-aa612f6b919c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041617 Jan 11 15:18:56.192376 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 536/1058] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:56 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:56.628778 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-30fa4e2a-6cc3-4ac4-97fb-11f592c95039 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:56.629386 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-30fa4e2a-6cc3-4ac4-97fb-11f592c95039 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:56.635670 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-30fa4e2a-6cc3-4ac4-97fb-11f592c95039 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:56.636120 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-30fa4e2a-6cc3-4ac4-97fb-11f592c95039 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:56.636891 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-30fa4e2a-6cc3-4ac4-97fb-11f592c95039 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:56.638005 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-30fa4e2a-6cc3-4ac4-97fb-11f592c95039 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:56.767040 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-30fa4e2a-6cc3-4ac4-97fb-11f592c95039 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:18:56.774434 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-30fa4e2a-6cc3-4ac4-97fb-11f592c95039 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.149305 Jan 11 15:18:56.774995 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 523/1059] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:18:56 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:18:57.203628 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3ccff55d-4527-4f8b-abbe-1e07b22358c6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:57.204555 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3ccff55d-4527-4f8b-abbe-1e07b22358c6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:57.211208 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3ccff55d-4527-4f8b-abbe-1e07b22358c6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:57.211693 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3ccff55d-4527-4f8b-abbe-1e07b22358c6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:57.212496 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3ccff55d-4527-4f8b-abbe-1e07b22358c6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:57.212942 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3ccff55d-4527-4f8b-abbe-1e07b22358c6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:57.247282 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3ccff55d-4527-4f8b-abbe-1e07b22358c6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047904 Jan 11 15:18:57.247937 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 537/1060] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:57 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:57.791875 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c30a1929-260f-4603-8415-68aeb30e3101 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:57.792495 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c30a1929-260f-4603-8415-68aeb30e3101 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:57.798646 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c30a1929-260f-4603-8415-68aeb30e3101 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:57.799100 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c30a1929-260f-4603-8415-68aeb30e3101 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:57.799911 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c30a1929-260f-4603-8415-68aeb30e3101 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:57.800359 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c30a1929-260f-4603-8415-68aeb30e3101 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:57.932065 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c30a1929-260f-4603-8415-68aeb30e3101 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:18:57.939935 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c30a1929-260f-4603-8415-68aeb30e3101 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.151899 Jan 11 15:18:57.940501 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 524/1061] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:18:57 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:18:58.258657 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-bd2f1794-2686-4c4d-bfac-574fd47fa0f3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:58.259510 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-bd2f1794-2686-4c4d-bfac-574fd47fa0f3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:58.265792 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bd2f1794-2686-4c4d-bfac-574fd47fa0f3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:58.268630 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bd2f1794-2686-4c4d-bfac-574fd47fa0f3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:58.268630 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bd2f1794-2686-4c4d-bfac-574fd47fa0f3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:58.268630 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bd2f1794-2686-4c4d-bfac-574fd47fa0f3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:58.296439 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-bd2f1794-2686-4c4d-bfac-574fd47fa0f3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041558 Jan 11 15:18:58.297317 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 538/1062] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:58 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:18:58.956720 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-004bd57c-3857-48dc-bfae-082c2f3df3e0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:58.957324 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-004bd57c-3857-48dc-bfae-082c2f3df3e0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:58.963539 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-004bd57c-3857-48dc-bfae-082c2f3df3e0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:58.963990 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-004bd57c-3857-48dc-bfae-082c2f3df3e0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:58.964770 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-004bd57c-3857-48dc-bfae-082c2f3df3e0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:58.965852 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-004bd57c-3857-48dc-bfae-082c2f3df3e0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:59.094146 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-004bd57c-3857-48dc-bfae-082c2f3df3e0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:18:59.102862 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-004bd57c-3857-48dc-bfae-082c2f3df3e0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.150030 Jan 11 15:18:59.103458 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 525/1063] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:18:58 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:18:59.307053 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d52d3d5a-32e4-4f26-be5c-937bcb85ad61 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:18:59.307919 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d52d3d5a-32e4-4f26-be5c-937bcb85ad61 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:18:59.314670 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d52d3d5a-32e4-4f26-be5c-937bcb85ad61 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:59.315125 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d52d3d5a-32e4-4f26-be5c-937bcb85ad61 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:59.315931 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d52d3d5a-32e4-4f26-be5c-937bcb85ad61 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:18:59.316372 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d52d3d5a-32e4-4f26-be5c-937bcb85ad61 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:18:59.345317 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d52d3d5a-32e4-4f26-be5c-937bcb85ad61 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042168 Jan 11 15:18:59.345858 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 539/1064] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:18:59 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:00.118629 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-12bccbd1-0b91-408d-aa2b-020176209699 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:00.119240 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-12bccbd1-0b91-408d-aa2b-020176209699 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:00.126027 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-12bccbd1-0b91-408d-aa2b-020176209699 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:00.126473 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-12bccbd1-0b91-408d-aa2b-020176209699 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:00.127242 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-12bccbd1-0b91-408d-aa2b-020176209699 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:00.127704 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-12bccbd1-0b91-408d-aa2b-020176209699 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:00.256007 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-12bccbd1-0b91-408d-aa2b-020176209699 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:00.263350 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-12bccbd1-0b91-408d-aa2b-020176209699 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.148290 Jan 11 15:19:00.263912 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 526/1065] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:00 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:00.356925 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3dd648bb-5cb1-4b2f-b54e-d86ac4063584 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:00.357844 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3dd648bb-5cb1-4b2f-b54e-d86ac4063584 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:00.364021 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3dd648bb-5cb1-4b2f-b54e-d86ac4063584 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:00.364469 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3dd648bb-5cb1-4b2f-b54e-d86ac4063584 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:00.365238 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3dd648bb-5cb1-4b2f-b54e-d86ac4063584 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:00.365679 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3dd648bb-5cb1-4b2f-b54e-d86ac4063584 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:00.393847 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3dd648bb-5cb1-4b2f-b54e-d86ac4063584 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041073 Jan 11 15:19:00.394345 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 540/1066] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:00 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:01.280383 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2abf54d3-8285-42eb-9bff-d1e4b289fe91 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:01.282773 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2abf54d3-8285-42eb-9bff-d1e4b289fe91 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:01.287172 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2abf54d3-8285-42eb-9bff-d1e4b289fe91 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:01.287648 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2abf54d3-8285-42eb-9bff-d1e4b289fe91 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:01.288418 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2abf54d3-8285-42eb-9bff-d1e4b289fe91 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:01.288857 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2abf54d3-8285-42eb-9bff-d1e4b289fe91 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:01.404974 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-653b3db2-2618-488d-9b5d-048dc97fb9dc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:01.405884 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-653b3db2-2618-488d-9b5d-048dc97fb9dc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:01.412117 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-653b3db2-2618-488d-9b5d-048dc97fb9dc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:01.412566 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-653b3db2-2618-488d-9b5d-048dc97fb9dc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:01.413341 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-653b3db2-2618-488d-9b5d-048dc97fb9dc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:01.413773 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-653b3db2-2618-488d-9b5d-048dc97fb9dc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:01.413942 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-2abf54d3-8285-42eb-9bff-d1e4b289fe91 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:01.422097 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2abf54d3-8285-42eb-9bff-d1e4b289fe91 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.145845 Jan 11 15:19:01.422664 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 527/1067] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:01 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:01.442503 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-653b3db2-2618-488d-9b5d-048dc97fb9dc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041780 Jan 11 15:19:01.443039 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 541/1068] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:01 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:19:02.439199 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-52643ec9-7747-4047-bc05-fa99e33a4ac6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:02.439839 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-52643ec9-7747-4047-bc05-fa99e33a4ac6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:02.446059 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-52643ec9-7747-4047-bc05-fa99e33a4ac6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:02.446506 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-52643ec9-7747-4047-bc05-fa99e33a4ac6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:02.447281 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-52643ec9-7747-4047-bc05-fa99e33a4ac6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:02.447744 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-52643ec9-7747-4047-bc05-fa99e33a4ac6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:02.453448 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-92504e07-72e3-4542-88aa-1fa30288f027 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:02.454432 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-92504e07-72e3-4542-88aa-1fa30288f027 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:02.460904 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-92504e07-72e3-4542-88aa-1fa30288f027 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:02.461350 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-92504e07-72e3-4542-88aa-1fa30288f027 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:02.462121 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-92504e07-72e3-4542-88aa-1fa30288f027 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:02.462556 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-92504e07-72e3-4542-88aa-1fa30288f027 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:02.491489 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-92504e07-72e3-4542-88aa-1fa30288f027 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041669 Jan 11 15:19:02.492055 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 542/1069] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:02 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:19:02.579141 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-52643ec9-7747-4047-bc05-fa99e33a4ac6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:02.586752 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-52643ec9-7747-4047-bc05-fa99e33a4ac6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.151210 Jan 11 15:19:02.587338 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 528/1070] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:02 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:03.501957 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-5dc94131-572e-4009-b5f7-3bfb2030aaee tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:03.502863 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-5dc94131-572e-4009-b5f7-3bfb2030aaee tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:03.509113 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5dc94131-572e-4009-b5f7-3bfb2030aaee tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:03.509496 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5dc94131-572e-4009-b5f7-3bfb2030aaee tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:03.510301 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5dc94131-572e-4009-b5f7-3bfb2030aaee tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:03.510735 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5dc94131-572e-4009-b5f7-3bfb2030aaee tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:03.539443 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-5dc94131-572e-4009-b5f7-3bfb2030aaee tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041228 Jan 11 15:19:03.539991 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 543/1071] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:03 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:03.603138 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6a907685-207c-4833-8954-1600d82ffc47 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:03.603772 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6a907685-207c-4833-8954-1600d82ffc47 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:03.610067 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6a907685-207c-4833-8954-1600d82ffc47 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:03.610521 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6a907685-207c-4833-8954-1600d82ffc47 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:03.611344 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6a907685-207c-4833-8954-1600d82ffc47 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:03.611808 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6a907685-207c-4833-8954-1600d82ffc47 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:03.736875 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6a907685-207c-4833-8954-1600d82ffc47 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:03.744242 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6a907685-207c-4833-8954-1600d82ffc47 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.144710 Jan 11 15:19:03.745006 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 529/1072] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:03 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:04.550156 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-afa075cf-13d0-4e0d-be8c-10b8c7f93e93 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:04.551097 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-afa075cf-13d0-4e0d-be8c-10b8c7f93e93 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:04.557321 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-afa075cf-13d0-4e0d-be8c-10b8c7f93e93 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:04.557768 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-afa075cf-13d0-4e0d-be8c-10b8c7f93e93 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:04.558535 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-afa075cf-13d0-4e0d-be8c-10b8c7f93e93 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:04.559012 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-afa075cf-13d0-4e0d-be8c-10b8c7f93e93 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:04.586791 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-afa075cf-13d0-4e0d-be8c-10b8c7f93e93 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040363 Jan 11 15:19:04.587347 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 544/1073] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:04 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:04.761547 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7f33bb8b-3190-4843-9d4b-68abafed898e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:04.762657 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-7f33bb8b-3190-4843-9d4b-68abafed898e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:04.769136 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7f33bb8b-3190-4843-9d4b-68abafed898e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:04.769588 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7f33bb8b-3190-4843-9d4b-68abafed898e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:04.770368 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7f33bb8b-3190-4843-9d4b-68abafed898e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:04.770815 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7f33bb8b-3190-4843-9d4b-68abafed898e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:04.899843 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-7f33bb8b-3190-4843-9d4b-68abafed898e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:04.907727 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7f33bb8b-3190-4843-9d4b-68abafed898e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.149737 Jan 11 15:19:04.908297 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 530/1074] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:04 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:05.598456 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3b7584e0-eb4f-4a83-bcd8-92f331224b35 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:05.599328 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3b7584e0-eb4f-4a83-bcd8-92f331224b35 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:05.605550 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3b7584e0-eb4f-4a83-bcd8-92f331224b35 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:05.606018 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3b7584e0-eb4f-4a83-bcd8-92f331224b35 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:05.606920 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3b7584e0-eb4f-4a83-bcd8-92f331224b35 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:05.607404 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3b7584e0-eb4f-4a83-bcd8-92f331224b35 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:05.635127 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3b7584e0-eb4f-4a83-bcd8-92f331224b35 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040509 Jan 11 15:19:05.635704 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 545/1075] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:05 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:05.924149 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6fa66f42-f73f-49e7-82a6-79954c5afc59 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:05.924671 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6fa66f42-f73f-49e7-82a6-79954c5afc59 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:05.930900 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6fa66f42-f73f-49e7-82a6-79954c5afc59 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:05.931382 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6fa66f42-f73f-49e7-82a6-79954c5afc59 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:05.932153 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6fa66f42-f73f-49e7-82a6-79954c5afc59 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:05.932589 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6fa66f42-f73f-49e7-82a6-79954c5afc59 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:06.061518 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6fa66f42-f73f-49e7-82a6-79954c5afc59 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:06.068772 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6fa66f42-f73f-49e7-82a6-79954c5afc59 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.148322 Jan 11 15:19:06.069337 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 531/1076] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:05 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:06.646921 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e5cb2c4c-a826-4c64-91a7-b96d73c76868 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:06.647777 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e5cb2c4c-a826-4c64-91a7-b96d73c76868 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:06.654504 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e5cb2c4c-a826-4c64-91a7-b96d73c76868 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:06.654955 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e5cb2c4c-a826-4c64-91a7-b96d73c76868 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:06.655762 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e5cb2c4c-a826-4c64-91a7-b96d73c76868 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:06.656204 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e5cb2c4c-a826-4c64-91a7-b96d73c76868 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:06.687364 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e5cb2c4c-a826-4c64-91a7-b96d73c76868 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044299 Jan 11 15:19:06.687908 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 546/1077] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:06 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:07.092890 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ad089725-d1e2-4965-8262-87ddfa72b118 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:07.093500 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ad089725-d1e2-4965-8262-87ddfa72b118 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:07.099708 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ad089725-d1e2-4965-8262-87ddfa72b118 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:07.100157 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ad089725-d1e2-4965-8262-87ddfa72b118 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:07.100930 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ad089725-d1e2-4965-8262-87ddfa72b118 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:07.101374 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ad089725-d1e2-4965-8262-87ddfa72b118 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:07.233028 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ad089725-d1e2-4965-8262-87ddfa72b118 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:07.240265 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ad089725-d1e2-4965-8262-87ddfa72b118 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.151746 Jan 11 15:19:07.240826 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 532/1078] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:07 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:07.698582 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-59d4b48d-eaf5-4577-b988-4633a3deef1f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:07.699579 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-59d4b48d-eaf5-4577-b988-4633a3deef1f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:07.706091 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-59d4b48d-eaf5-4577-b988-4633a3deef1f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:07.706549 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-59d4b48d-eaf5-4577-b988-4633a3deef1f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:07.707363 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-59d4b48d-eaf5-4577-b988-4633a3deef1f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:07.707810 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-59d4b48d-eaf5-4577-b988-4633a3deef1f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:07.736423 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-59d4b48d-eaf5-4577-b988-4633a3deef1f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041637 Jan 11 15:19:07.736970 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 547/1079] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:07 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:08.257049 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-eeba1a70-6eee-478a-bd84-358bf49b3d5a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:08.257651 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-eeba1a70-6eee-478a-bd84-358bf49b3d5a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:08.263959 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-eeba1a70-6eee-478a-bd84-358bf49b3d5a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:08.264407 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-eeba1a70-6eee-478a-bd84-358bf49b3d5a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:08.265183 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-eeba1a70-6eee-478a-bd84-358bf49b3d5a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:08.265616 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-eeba1a70-6eee-478a-bd84-358bf49b3d5a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:08.392329 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-eeba1a70-6eee-478a-bd84-358bf49b3d5a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:08.399606 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-eeba1a70-6eee-478a-bd84-358bf49b3d5a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.146348 Jan 11 15:19:08.400168 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 533/1080] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:08 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:08.748175 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-71ec3507-2194-4f5f-bdbc-341153d50109 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:08.749012 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-71ec3507-2194-4f5f-bdbc-341153d50109 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:08.755205 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-71ec3507-2194-4f5f-bdbc-341153d50109 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:08.755692 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-71ec3507-2194-4f5f-bdbc-341153d50109 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:08.756471 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-71ec3507-2194-4f5f-bdbc-341153d50109 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:08.756914 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-71ec3507-2194-4f5f-bdbc-341153d50109 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:08.786023 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-71ec3507-2194-4f5f-bdbc-341153d50109 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041761 Jan 11 15:19:08.786571 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 548/1081] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:08 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:09.416256 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a3296cef-ec7c-4e4a-b418-8b90ce0def27 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:09.416890 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a3296cef-ec7c-4e4a-b418-8b90ce0def27 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:09.423166 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a3296cef-ec7c-4e4a-b418-8b90ce0def27 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:09.423662 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a3296cef-ec7c-4e4a-b418-8b90ce0def27 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:09.424438 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a3296cef-ec7c-4e4a-b418-8b90ce0def27 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:09.424876 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a3296cef-ec7c-4e4a-b418-8b90ce0def27 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:09.549622 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a3296cef-ec7c-4e4a-b418-8b90ce0def27 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:09.556856 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a3296cef-ec7c-4e4a-b418-8b90ce0def27 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.144316 Jan 11 15:19:09.557418 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 534/1082] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:09 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:09.796421 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e3f6b273-17e2-42de-9327-c8a548da943e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:09.797389 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e3f6b273-17e2-42de-9327-c8a548da943e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:09.803587 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e3f6b273-17e2-42de-9327-c8a548da943e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:09.804045 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e3f6b273-17e2-42de-9327-c8a548da943e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:09.804831 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e3f6b273-17e2-42de-9327-c8a548da943e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:09.805279 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e3f6b273-17e2-42de-9327-c8a548da943e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:09.834995 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e3f6b273-17e2-42de-9327-c8a548da943e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042418 Jan 11 15:19:09.835588 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 549/1083] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:09 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:10.573623 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-660fa610-73fa-40dc-a48f-f3f9fc7a691a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:10.574778 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-660fa610-73fa-40dc-a48f-f3f9fc7a691a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:10.581406 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-660fa610-73fa-40dc-a48f-f3f9fc7a691a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:10.581854 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-660fa610-73fa-40dc-a48f-f3f9fc7a691a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:10.582636 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-660fa610-73fa-40dc-a48f-f3f9fc7a691a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:10.583082 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-660fa610-73fa-40dc-a48f-f3f9fc7a691a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:10.713455 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-660fa610-73fa-40dc-a48f-f3f9fc7a691a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:10.720980 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-660fa610-73fa-40dc-a48f-f3f9fc7a691a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.151118 Jan 11 15:19:10.721547 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 535/1084] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:10 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:10.846164 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c18047f4-3ca8-4b65-a1fc-73df0a5fc71f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:10.847041 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c18047f4-3ca8-4b65-a1fc-73df0a5fc71f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:10.853326 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c18047f4-3ca8-4b65-a1fc-73df0a5fc71f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:10.853776 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c18047f4-3ca8-4b65-a1fc-73df0a5fc71f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:10.854550 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c18047f4-3ca8-4b65-a1fc-73df0a5fc71f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:10.854989 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c18047f4-3ca8-4b65-a1fc-73df0a5fc71f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:10.883635 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c18047f4-3ca8-4b65-a1fc-73df0a5fc71f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041263 Jan 11 15:19:10.884179 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 550/1085] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:10 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:11.737692 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-885457bc-d474-44f6-82b0-2b7dfb30517f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:11.738298 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-885457bc-d474-44f6-82b0-2b7dfb30517f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:11.744474 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-885457bc-d474-44f6-82b0-2b7dfb30517f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:11.744927 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-885457bc-d474-44f6-82b0-2b7dfb30517f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:11.745703 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-885457bc-d474-44f6-82b0-2b7dfb30517f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:11.746143 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-885457bc-d474-44f6-82b0-2b7dfb30517f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:11.872007 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-885457bc-d474-44f6-82b0-2b7dfb30517f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:11.879251 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-885457bc-d474-44f6-82b0-2b7dfb30517f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.145300 Jan 11 15:19:11.879845 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 536/1086] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:11 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:11.893988 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-5212e8de-1627-4bb4-8fe8-c7ca5d01d13d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:11.894889 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-5212e8de-1627-4bb4-8fe8-c7ca5d01d13d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:11.901032 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5212e8de-1627-4bb4-8fe8-c7ca5d01d13d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:11.901480 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5212e8de-1627-4bb4-8fe8-c7ca5d01d13d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:11.902246 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5212e8de-1627-4bb4-8fe8-c7ca5d01d13d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:11.902676 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5212e8de-1627-4bb4-8fe8-c7ca5d01d13d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:11.930585 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-5212e8de-1627-4bb4-8fe8-c7ca5d01d13d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040302 Jan 11 15:19:11.931122 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 551/1087] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:11 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:12.896300 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c9de2c2a-3f70-4c1e-8c91-140fdc681da3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:12.896895 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c9de2c2a-3f70-4c1e-8c91-140fdc681da3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:12.903523 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c9de2c2a-3f70-4c1e-8c91-140fdc681da3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:12.904943 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c9de2c2a-3f70-4c1e-8c91-140fdc681da3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:12.904943 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c9de2c2a-3f70-4c1e-8c91-140fdc681da3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:12.905358 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c9de2c2a-3f70-4c1e-8c91-140fdc681da3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:12.941816 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ae97f1d9-456a-4432-b9ce-d21f720d6a86 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:12.942733 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-ae97f1d9-456a-4432-b9ce-d21f720d6a86 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:12.949255 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ae97f1d9-456a-4432-b9ce-d21f720d6a86 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:12.949709 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ae97f1d9-456a-4432-b9ce-d21f720d6a86 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:12.950502 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ae97f1d9-456a-4432-b9ce-d21f720d6a86 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:12.950942 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ae97f1d9-456a-4432-b9ce-d21f720d6a86 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:12.986340 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-ae97f1d9-456a-4432-b9ce-d21f720d6a86 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048083 Jan 11 15:19:12.987150 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 552/1088] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:12 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:19:13.043443 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c9de2c2a-3f70-4c1e-8c91-140fdc681da3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:13.050877 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c9de2c2a-3f70-4c1e-8c91-140fdc681da3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.158206 Jan 11 15:19:13.051507 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 537/1089] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:12 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:13.999974 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-29dcedbb-f72b-4771-a1bc-89bf798b5405 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:14.000884 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-29dcedbb-f72b-4771-a1bc-89bf798b5405 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:14.007138 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-29dcedbb-f72b-4771-a1bc-89bf798b5405 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:14.007557 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-29dcedbb-f72b-4771-a1bc-89bf798b5405 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:14.008328 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-29dcedbb-f72b-4771-a1bc-89bf798b5405 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:14.008763 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-29dcedbb-f72b-4771-a1bc-89bf798b5405 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:14.037365 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-29dcedbb-f72b-4771-a1bc-89bf798b5405 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041134 Jan 11 15:19:14.037902 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 553/1090] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:13 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:14.067998 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a08602fb-7f03-48ab-a3e2-4c818a86c4d9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:14.068607 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a08602fb-7f03-48ab-a3e2-4c818a86c4d9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:14.075306 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a08602fb-7f03-48ab-a3e2-4c818a86c4d9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:14.075758 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a08602fb-7f03-48ab-a3e2-4c818a86c4d9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:14.076529 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a08602fb-7f03-48ab-a3e2-4c818a86c4d9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:14.076962 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a08602fb-7f03-48ab-a3e2-4c818a86c4d9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:14.202371 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a08602fb-7f03-48ab-a3e2-4c818a86c4d9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:14.209897 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a08602fb-7f03-48ab-a3e2-4c818a86c4d9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.145544 Jan 11 15:19:14.210462 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 538/1091] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:14 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:15.048712 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-9bbeea67-eb59-4ba6-b4d5-4d2db530dba9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:15.049542 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-9bbeea67-eb59-4ba6-b4d5-4d2db530dba9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:15.055800 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9bbeea67-eb59-4ba6-b4d5-4d2db530dba9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:15.056247 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9bbeea67-eb59-4ba6-b4d5-4d2db530dba9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:15.057226 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9bbeea67-eb59-4ba6-b4d5-4d2db530dba9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:15.057960 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9bbeea67-eb59-4ba6-b4d5-4d2db530dba9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:15.090121 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-9bbeea67-eb59-4ba6-b4d5-4d2db530dba9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045245 Jan 11 15:19:15.090683 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 554/1092] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:15 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:15.228018 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1d911c84-152c-4d33-9dad-f7b0639a29ae tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:15.228634 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1d911c84-152c-4d33-9dad-f7b0639a29ae tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:15.235607 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1d911c84-152c-4d33-9dad-f7b0639a29ae tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:15.236064 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1d911c84-152c-4d33-9dad-f7b0639a29ae tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:15.236855 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1d911c84-152c-4d33-9dad-f7b0639a29ae tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:15.237296 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1d911c84-152c-4d33-9dad-f7b0639a29ae tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:15.376828 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1d911c84-152c-4d33-9dad-f7b0639a29ae tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:15.384173 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1d911c84-152c-4d33-9dad-f7b0639a29ae tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.161255 Jan 11 15:19:15.384741 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 539/1093] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:15 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:16.101552 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-8733bc2a-ea2f-4da9-9f12-9dcc3fc9057d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:16.102468 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-8733bc2a-ea2f-4da9-9f12-9dcc3fc9057d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:16.109201 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8733bc2a-ea2f-4da9-9f12-9dcc3fc9057d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:16.109654 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8733bc2a-ea2f-4da9-9f12-9dcc3fc9057d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:16.110424 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8733bc2a-ea2f-4da9-9f12-9dcc3fc9057d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:16.110863 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8733bc2a-ea2f-4da9-9f12-9dcc3fc9057d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:16.138970 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-8733bc2a-ea2f-4da9-9f12-9dcc3fc9057d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041144 Jan 11 15:19:16.139544 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 555/1094] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:16 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:16.403601 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-afc1282f-756f-495a-8856-73ec590fcc69 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:16.404138 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-afc1282f-756f-495a-8856-73ec590fcc69 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:16.410545 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-afc1282f-756f-495a-8856-73ec590fcc69 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:16.411022 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-afc1282f-756f-495a-8856-73ec590fcc69 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:16.411830 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-afc1282f-756f-495a-8856-73ec590fcc69 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:16.412265 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-afc1282f-756f-495a-8856-73ec590fcc69 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:16.539802 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-afc1282f-756f-495a-8856-73ec590fcc69 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:16.547556 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-afc1282f-756f-495a-8856-73ec590fcc69 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.148210 Jan 11 15:19:16.548127 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 540/1095] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:16 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:17.150392 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-aab057f0-4517-4015-b06b-16d313dd4f1f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:17.151244 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-aab057f0-4517-4015-b06b-16d313dd4f1f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:17.157593 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-aab057f0-4517-4015-b06b-16d313dd4f1f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:17.158052 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-aab057f0-4517-4015-b06b-16d313dd4f1f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:17.158827 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-aab057f0-4517-4015-b06b-16d313dd4f1f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:17.159268 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-aab057f0-4517-4015-b06b-16d313dd4f1f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:17.188179 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-aab057f0-4517-4015-b06b-16d313dd4f1f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041593 Jan 11 15:19:17.188740 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 556/1096] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:17 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:17.564769 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-af7a13d0-11b7-4f98-8820-8c78efcbc1b3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:17.565408 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-af7a13d0-11b7-4f98-8820-8c78efcbc1b3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:17.571814 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-af7a13d0-11b7-4f98-8820-8c78efcbc1b3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:17.572264 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-af7a13d0-11b7-4f98-8820-8c78efcbc1b3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:17.573040 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-af7a13d0-11b7-4f98-8820-8c78efcbc1b3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:17.573482 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-af7a13d0-11b7-4f98-8820-8c78efcbc1b3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:17.698450 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-af7a13d0-11b7-4f98-8820-8c78efcbc1b3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:17.705963 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-af7a13d0-11b7-4f98-8820-8c78efcbc1b3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.144883 Jan 11 15:19:17.706525 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 541/1097] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:17 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:18.199742 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c5b32ca6-2d02-46c2-9a23-360d9a886bb6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:18.200647 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c5b32ca6-2d02-46c2-9a23-360d9a886bb6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:18.207095 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c5b32ca6-2d02-46c2-9a23-360d9a886bb6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:18.212906 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c5b32ca6-2d02-46c2-9a23-360d9a886bb6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:18.212906 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c5b32ca6-2d02-46c2-9a23-360d9a886bb6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:18.212906 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c5b32ca6-2d02-46c2-9a23-360d9a886bb6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:18.237306 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c5b32ca6-2d02-46c2-9a23-360d9a886bb6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041775 Jan 11 15:19:18.237871 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 557/1098] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:18 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:18.721678 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d11d395c-7fc9-44b2-ae35-686edd0c5a11 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:18.722273 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d11d395c-7fc9-44b2-ae35-686edd0c5a11 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:18.728501 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d11d395c-7fc9-44b2-ae35-686edd0c5a11 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:18.728946 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d11d395c-7fc9-44b2-ae35-686edd0c5a11 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:18.729714 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d11d395c-7fc9-44b2-ae35-686edd0c5a11 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:18.730149 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d11d395c-7fc9-44b2-ae35-686edd0c5a11 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:18.858214 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d11d395c-7fc9-44b2-ae35-686edd0c5a11 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:18.865446 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d11d395c-7fc9-44b2-ae35-686edd0c5a11 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.147428 Jan 11 15:19:18.866005 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 542/1099] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:18 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:19.249024 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ac072f54-dcbc-43be-a95b-181016d43059 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:19.250040 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-ac072f54-dcbc-43be-a95b-181016d43059 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:19.256534 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ac072f54-dcbc-43be-a95b-181016d43059 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:19.256982 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ac072f54-dcbc-43be-a95b-181016d43059 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:19.258010 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ac072f54-dcbc-43be-a95b-181016d43059 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:19.258200 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ac072f54-dcbc-43be-a95b-181016d43059 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:19.287042 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-ac072f54-dcbc-43be-a95b-181016d43059 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042379 Jan 11 15:19:19.287634 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 558/1100] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:19 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:19.882337 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-084eeb85-2740-4d68-aabf-fcc3a08879ad tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:19.882942 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-084eeb85-2740-4d68-aabf-fcc3a08879ad tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:19.890340 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-084eeb85-2740-4d68-aabf-fcc3a08879ad tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:19.890789 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-084eeb85-2740-4d68-aabf-fcc3a08879ad tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:19.891584 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-084eeb85-2740-4d68-aabf-fcc3a08879ad tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:19.892022 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-084eeb85-2740-4d68-aabf-fcc3a08879ad tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:20.016331 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-084eeb85-2740-4d68-aabf-fcc3a08879ad tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:20.023486 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-084eeb85-2740-4d68-aabf-fcc3a08879ad tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.144797 Jan 11 15:19:20.024047 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 543/1101] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:19 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:20.298094 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-75fa45e8-efbc-446e-97b9-cb7e3fc5c138 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:20.299033 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-75fa45e8-efbc-446e-97b9-cb7e3fc5c138 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:20.305443 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-75fa45e8-efbc-446e-97b9-cb7e3fc5c138 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:20.305988 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-75fa45e8-efbc-446e-97b9-cb7e3fc5c138 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:20.306765 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-75fa45e8-efbc-446e-97b9-cb7e3fc5c138 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:20.307203 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-75fa45e8-efbc-446e-97b9-cb7e3fc5c138 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:20.336647 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-75fa45e8-efbc-446e-97b9-cb7e3fc5c138 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042372 Jan 11 15:19:20.337193 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 559/1102] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:20 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:21.039641 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-353fea5b-f021-4097-8225-d29738850d7f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:21.040257 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-353fea5b-f021-4097-8225-d29738850d7f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:21.047933 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-353fea5b-f021-4097-8225-d29738850d7f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:21.048465 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-353fea5b-f021-4097-8225-d29738850d7f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:21.049764 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-353fea5b-f021-4097-8225-d29738850d7f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:21.050447 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-353fea5b-f021-4097-8225-d29738850d7f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:21.179722 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-353fea5b-f021-4097-8225-d29738850d7f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:21.187561 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-353fea5b-f021-4097-8225-d29738850d7f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.151586 Jan 11 15:19:21.188128 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 544/1103] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:21 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:21.348052 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3a0ea569-cfa6-4b9c-8010-ae994f41eac7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:21.348888 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3a0ea569-cfa6-4b9c-8010-ae994f41eac7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:21.355625 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3a0ea569-cfa6-4b9c-8010-ae994f41eac7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:21.356076 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3a0ea569-cfa6-4b9c-8010-ae994f41eac7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:21.356839 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3a0ea569-cfa6-4b9c-8010-ae994f41eac7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:21.357274 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3a0ea569-cfa6-4b9c-8010-ae994f41eac7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:21.385283 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3a0ea569-cfa6-4b9c-8010-ae994f41eac7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041063 Jan 11 15:19:21.385834 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 560/1104] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:21 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:22.205535 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-13bbc239-a414-440d-a472-5270e8ab1305 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:22.206109 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-13bbc239-a414-440d-a472-5270e8ab1305 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:22.212144 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-13bbc239-a414-440d-a472-5270e8ab1305 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:22.212586 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-13bbc239-a414-440d-a472-5270e8ab1305 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:22.213350 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-13bbc239-a414-440d-a472-5270e8ab1305 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:22.213782 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-13bbc239-a414-440d-a472-5270e8ab1305 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:22.344064 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-13bbc239-a414-440d-a472-5270e8ab1305 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:22.351256 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-13bbc239-a414-440d-a472-5270e8ab1305 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.149864 Jan 11 15:19:22.351836 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 545/1105] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:22 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:22.396237 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a6faf529-b694-44c5-830d-47aea762d2eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:22.397171 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a6faf529-b694-44c5-830d-47aea762d2eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:22.403321 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a6faf529-b694-44c5-830d-47aea762d2eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:22.403771 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a6faf529-b694-44c5-830d-47aea762d2eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:22.404534 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a6faf529-b694-44c5-830d-47aea762d2eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:22.404962 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a6faf529-b694-44c5-830d-47aea762d2eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:22.433684 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a6faf529-b694-44c5-830d-47aea762d2eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040612 Jan 11 15:19:22.434226 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 561/1106] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:22 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:23.367591 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2a67b1ea-eeba-4001-932b-8a5130fedd4b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:23.368202 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2a67b1ea-eeba-4001-932b-8a5130fedd4b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:23.374414 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2a67b1ea-eeba-4001-932b-8a5130fedd4b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:23.374862 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2a67b1ea-eeba-4001-932b-8a5130fedd4b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:23.375655 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2a67b1ea-eeba-4001-932b-8a5130fedd4b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:23.376095 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2a67b1ea-eeba-4001-932b-8a5130fedd4b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:23.444342 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-975bf035-4ca0-4d41-9501-d3b85aee9c1c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:23.445165 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-975bf035-4ca0-4d41-9501-d3b85aee9c1c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:23.451630 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-975bf035-4ca0-4d41-9501-d3b85aee9c1c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:23.452086 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-975bf035-4ca0-4d41-9501-d3b85aee9c1c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:23.452869 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-975bf035-4ca0-4d41-9501-d3b85aee9c1c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:23.453308 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-975bf035-4ca0-4d41-9501-d3b85aee9c1c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:23.482718 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-975bf035-4ca0-4d41-9501-d3b85aee9c1c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042252 Jan 11 15:19:23.483484 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 562/1107] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:23 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:19:23.502416 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-2a67b1ea-eeba-4001-932b-8a5130fedd4b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:23.509549 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2a67b1ea-eeba-4001-932b-8a5130fedd4b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.145556 Jan 11 15:19:23.510107 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 546/1108] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:23 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:24.493983 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4a5f7d1e-cdd0-47cb-87a5-874b99bfe83e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:24.494949 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4a5f7d1e-cdd0-47cb-87a5-874b99bfe83e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:24.501803 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4a5f7d1e-cdd0-47cb-87a5-874b99bfe83e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:24.502258 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4a5f7d1e-cdd0-47cb-87a5-874b99bfe83e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:24.503036 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4a5f7d1e-cdd0-47cb-87a5-874b99bfe83e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:24.503544 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4a5f7d1e-cdd0-47cb-87a5-874b99bfe83e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:24.525737 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-791e81b0-d8f7-42a7-8430-40b62a8454be tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:24.526246 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-791e81b0-d8f7-42a7-8430-40b62a8454be tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:24.533768 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4a5f7d1e-cdd0-47cb-87a5-874b99bfe83e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042679 Jan 11 15:19:24.533768 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 563/1109] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:24 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:24.534640 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-791e81b0-d8f7-42a7-8430-40b62a8454be tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:24.535108 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-791e81b0-d8f7-42a7-8430-40b62a8454be tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:24.535906 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-791e81b0-d8f7-42a7-8430-40b62a8454be tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:24.536348 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-791e81b0-d8f7-42a7-8430-40b62a8454be tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:24.666434 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-791e81b0-d8f7-42a7-8430-40b62a8454be tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:24.674389 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-791e81b0-d8f7-42a7-8430-40b62a8454be tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.152469 Jan 11 15:19:24.674958 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 547/1110] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:24 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:25.544037 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-0260b0b3-5917-4212-a7b0-052ad3f0d928 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:25.544914 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-0260b0b3-5917-4212-a7b0-052ad3f0d928 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:25.551166 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0260b0b3-5917-4212-a7b0-052ad3f0d928 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:25.551653 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0260b0b3-5917-4212-a7b0-052ad3f0d928 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:25.552434 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0260b0b3-5917-4212-a7b0-052ad3f0d928 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:25.552881 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0260b0b3-5917-4212-a7b0-052ad3f0d928 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:25.582209 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-0260b0b3-5917-4212-a7b0-052ad3f0d928 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042025 Jan 11 15:19:25.582750 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 564/1111] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:25 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:25.690233 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c072fe2e-7340-481e-8275-839e4ff6927a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:25.690846 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c072fe2e-7340-481e-8275-839e4ff6927a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:25.697112 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c072fe2e-7340-481e-8275-839e4ff6927a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:25.697564 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c072fe2e-7340-481e-8275-839e4ff6927a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:25.698338 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c072fe2e-7340-481e-8275-839e4ff6927a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:25.698775 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c072fe2e-7340-481e-8275-839e4ff6927a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:25.823693 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c072fe2e-7340-481e-8275-839e4ff6927a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:25.831147 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c072fe2e-7340-481e-8275-839e4ff6927a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.144512 Jan 11 15:19:25.831745 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 548/1112] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:25 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:26.594106 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-83396ada-bde8-4bf7-a998-ab69fcec713b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:26.595039 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-83396ada-bde8-4bf7-a998-ab69fcec713b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:26.601207 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-83396ada-bde8-4bf7-a998-ab69fcec713b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:26.601659 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-83396ada-bde8-4bf7-a998-ab69fcec713b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:26.602428 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-83396ada-bde8-4bf7-a998-ab69fcec713b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:26.602865 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-83396ada-bde8-4bf7-a998-ab69fcec713b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:26.631094 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-83396ada-bde8-4bf7-a998-ab69fcec713b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040723 Jan 11 15:19:26.631679 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 565/1113] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:26 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:26.846741 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d46ed56a-a0a1-4ef5-85ac-05d3596f6bf7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:26.847315 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d46ed56a-a0a1-4ef5-85ac-05d3596f6bf7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:26.853650 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d46ed56a-a0a1-4ef5-85ac-05d3596f6bf7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:26.854097 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d46ed56a-a0a1-4ef5-85ac-05d3596f6bf7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:26.854901 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d46ed56a-a0a1-4ef5-85ac-05d3596f6bf7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:26.855363 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d46ed56a-a0a1-4ef5-85ac-05d3596f6bf7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:26.981232 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:19:26.981442 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: Tue Jan 11 15:19:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 (ip 10.222.0.52) !!! Jan 11 15:19:26.987497 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d46ed56a-a0a1-4ef5-85ac-05d3596f6bf7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:26.996017 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d46ed56a-a0a1-4ef5-85ac-05d3596f6bf7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.152428 Jan 11 15:19:26.996573 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 549/1114] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:26 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:27.642655 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b043d6a0-17fc-469a-a680-ee6724becb48 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:27.643522 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b043d6a0-17fc-469a-a680-ee6724becb48 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:27.649784 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b043d6a0-17fc-469a-a680-ee6724becb48 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:27.650236 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b043d6a0-17fc-469a-a680-ee6724becb48 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:27.651009 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b043d6a0-17fc-469a-a680-ee6724becb48 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:27.651487 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b043d6a0-17fc-469a-a680-ee6724becb48 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:27.679335 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b043d6a0-17fc-469a-a680-ee6724becb48 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040518 Jan 11 15:19:27.679921 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 566/1115] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:27 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:28.012391 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-39bee2c3-1e47-4991-b159-b16bd745da28 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:28.013007 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-39bee2c3-1e47-4991-b159-b16bd745da28 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:28.019273 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-39bee2c3-1e47-4991-b159-b16bd745da28 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:28.019751 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-39bee2c3-1e47-4991-b159-b16bd745da28 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:28.020529 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-39bee2c3-1e47-4991-b159-b16bd745da28 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:28.020970 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-39bee2c3-1e47-4991-b159-b16bd745da28 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:28.145668 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-39bee2c3-1e47-4991-b159-b16bd745da28 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:28.152878 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-39bee2c3-1e47-4991-b159-b16bd745da28 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.144096 Jan 11 15:19:28.153454 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 550/1116] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:28 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:28.691112 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ba898cb3-8f57-4fc9-9ce2-a0f04028adb9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:28.692056 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-ba898cb3-8f57-4fc9-9ce2-a0f04028adb9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:28.698294 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ba898cb3-8f57-4fc9-9ce2-a0f04028adb9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:28.699338 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ba898cb3-8f57-4fc9-9ce2-a0f04028adb9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:28.700119 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ba898cb3-8f57-4fc9-9ce2-a0f04028adb9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:28.700555 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ba898cb3-8f57-4fc9-9ce2-a0f04028adb9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:28.729007 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-ba898cb3-8f57-4fc9-9ce2-a0f04028adb9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041721 Jan 11 15:19:28.729547 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 567/1117] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:28 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:29.169906 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ee725756-31cd-4543-8a9c-45f7f2d0fcbd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:29.170509 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ee725756-31cd-4543-8a9c-45f7f2d0fcbd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:29.176695 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ee725756-31cd-4543-8a9c-45f7f2d0fcbd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:29.177141 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ee725756-31cd-4543-8a9c-45f7f2d0fcbd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:29.177908 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ee725756-31cd-4543-8a9c-45f7f2d0fcbd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:29.178342 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ee725756-31cd-4543-8a9c-45f7f2d0fcbd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:29.308007 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ee725756-31cd-4543-8a9c-45f7f2d0fcbd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:29.315314 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ee725756-31cd-4543-8a9c-45f7f2d0fcbd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.149596 Jan 11 15:19:29.315890 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 551/1118] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:29 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:29.740195 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c871f14b-f22f-48ae-b981-277a8783cb35 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:29.741105 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c871f14b-f22f-48ae-b981-277a8783cb35 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:29.747956 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c871f14b-f22f-48ae-b981-277a8783cb35 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:29.748402 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c871f14b-f22f-48ae-b981-277a8783cb35 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:29.749166 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c871f14b-f22f-48ae-b981-277a8783cb35 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:29.749601 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c871f14b-f22f-48ae-b981-277a8783cb35 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:29.777484 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c871f14b-f22f-48ae-b981-277a8783cb35 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041048 Jan 11 15:19:29.778022 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 568/1119] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:29 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:30.332233 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7ef79bec-5025-4e9f-9012-e313c679b98b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:30.332845 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-7ef79bec-5025-4e9f-9012-e313c679b98b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:30.339833 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7ef79bec-5025-4e9f-9012-e313c679b98b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:30.340286 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7ef79bec-5025-4e9f-9012-e313c679b98b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:30.341061 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7ef79bec-5025-4e9f-9012-e313c679b98b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:30.341503 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7ef79bec-5025-4e9f-9012-e313c679b98b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:30.468979 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-7ef79bec-5025-4e9f-9012-e313c679b98b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:30.476170 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7ef79bec-5025-4e9f-9012-e313c679b98b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.147802 Jan 11 15:19:30.476757 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 552/1120] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:30 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:30.789180 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d659aa79-b2ff-4aa3-9318-41b3cfc27047 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:30.790090 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d659aa79-b2ff-4aa3-9318-41b3cfc27047 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:30.796570 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d659aa79-b2ff-4aa3-9318-41b3cfc27047 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:30.797025 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d659aa79-b2ff-4aa3-9318-41b3cfc27047 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:30.797905 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d659aa79-b2ff-4aa3-9318-41b3cfc27047 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:30.798343 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d659aa79-b2ff-4aa3-9318-41b3cfc27047 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:30.827567 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d659aa79-b2ff-4aa3-9318-41b3cfc27047 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042169 Jan 11 15:19:30.828152 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 569/1121] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:30 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:19:31.492847 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8b962d82-53dc-47e3-b9a8-04d5408c91ca tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:31.493456 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8b962d82-53dc-47e3-b9a8-04d5408c91ca tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:31.499672 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8b962d82-53dc-47e3-b9a8-04d5408c91ca tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:31.500119 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8b962d82-53dc-47e3-b9a8-04d5408c91ca tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:31.500882 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8b962d82-53dc-47e3-b9a8-04d5408c91ca tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:31.501315 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8b962d82-53dc-47e3-b9a8-04d5408c91ca tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:31.628645 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-8b962d82-53dc-47e3-b9a8-04d5408c91ca tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:31.636313 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8b962d82-53dc-47e3-b9a8-04d5408c91ca tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.146573 Jan 11 15:19:31.636863 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 553/1122] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:31 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:31.839696 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-462d14c3-a444-4930-aa4a-b6745b80369b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:31.840531 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-462d14c3-a444-4930-aa4a-b6745b80369b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:31.846604 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-462d14c3-a444-4930-aa4a-b6745b80369b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:31.847054 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-462d14c3-a444-4930-aa4a-b6745b80369b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:31.847885 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-462d14c3-a444-4930-aa4a-b6745b80369b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:31.848319 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-462d14c3-a444-4930-aa4a-b6745b80369b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:31.875759 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-462d14c3-a444-4930-aa4a-b6745b80369b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040430 Jan 11 15:19:31.876316 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 570/1123] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:31 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:32.652826 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1b4ee7d1-6350-42ee-81c5-2201c08c38b1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:32.653441 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1b4ee7d1-6350-42ee-81c5-2201c08c38b1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:32.659696 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1b4ee7d1-6350-42ee-81c5-2201c08c38b1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:32.660151 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1b4ee7d1-6350-42ee-81c5-2201c08c38b1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:32.660927 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1b4ee7d1-6350-42ee-81c5-2201c08c38b1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:32.661367 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1b4ee7d1-6350-42ee-81c5-2201c08c38b1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:32.791165 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1b4ee7d1-6350-42ee-81c5-2201c08c38b1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:32.799209 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1b4ee7d1-6350-42ee-81c5-2201c08c38b1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.150083 Jan 11 15:19:32.800081 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 554/1124] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:32 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:32.885878 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-87728f3d-5a01-4df6-8692-f62e330d123e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:32.886789 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-87728f3d-5a01-4df6-8692-f62e330d123e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:32.892943 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-87728f3d-5a01-4df6-8692-f62e330d123e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:32.893395 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-87728f3d-5a01-4df6-8692-f62e330d123e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:32.894166 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-87728f3d-5a01-4df6-8692-f62e330d123e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:32.894606 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-87728f3d-5a01-4df6-8692-f62e330d123e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:32.923417 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-87728f3d-5a01-4df6-8692-f62e330d123e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041279 Jan 11 15:19:32.925959 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 571/1125] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:32 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:33.816064 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-62f28d2a-5c4f-44ca-8f03-a1934b322b7a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:33.816692 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-62f28d2a-5c4f-44ca-8f03-a1934b322b7a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:33.822858 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-62f28d2a-5c4f-44ca-8f03-a1934b322b7a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:33.823936 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-62f28d2a-5c4f-44ca-8f03-a1934b322b7a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:33.824708 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-62f28d2a-5c4f-44ca-8f03-a1934b322b7a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:33.825141 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-62f28d2a-5c4f-44ca-8f03-a1934b322b7a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:33.934269 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-652320f3-1799-41c0-9a6f-a050d9383ca6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:33.935181 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-652320f3-1799-41c0-9a6f-a050d9383ca6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:33.941303 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-652320f3-1799-41c0-9a6f-a050d9383ca6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:33.941754 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-652320f3-1799-41c0-9a6f-a050d9383ca6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:33.942532 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-652320f3-1799-41c0-9a6f-a050d9383ca6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:33.942970 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-652320f3-1799-41c0-9a6f-a050d9383ca6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:33.950656 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-62f28d2a-5c4f-44ca-8f03-a1934b322b7a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:33.958402 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-62f28d2a-5c4f-44ca-8f03-a1934b322b7a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.145857 Jan 11 15:19:33.958987 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 555/1126] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:33 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:33.972268 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-652320f3-1799-41c0-9a6f-a050d9383ca6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041616 Jan 11 15:19:33.972572 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 572/1127] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:33 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:19:34.974822 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-53500458-a7ee-4b81-b5b2-5f1924cee331 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:34.975758 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-53500458-a7ee-4b81-b5b2-5f1924cee331 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:34.982468 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-53500458-a7ee-4b81-b5b2-5f1924cee331 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:34.982917 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-53500458-a7ee-4b81-b5b2-5f1924cee331 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:34.983055 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ed7e2edc-14e3-48dc-b19e-a142b35be872 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:34.983743 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-53500458-a7ee-4b81-b5b2-5f1924cee331 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:34.983918 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-ed7e2edc-14e3-48dc-b19e-a142b35be872 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:34.984186 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-53500458-a7ee-4b81-b5b2-5f1924cee331 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:34.990074 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ed7e2edc-14e3-48dc-b19e-a142b35be872 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:34.990524 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ed7e2edc-14e3-48dc-b19e-a142b35be872 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:34.991315 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ed7e2edc-14e3-48dc-b19e-a142b35be872 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:34.991790 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ed7e2edc-14e3-48dc-b19e-a142b35be872 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:35.021451 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-ed7e2edc-14e3-48dc-b19e-a142b35be872 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042720 Jan 11 15:19:35.022212 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 573/1128] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:34 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:19:35.114975 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-53500458-a7ee-4b81-b5b2-5f1924cee331 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:35.122313 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-53500458-a7ee-4b81-b5b2-5f1924cee331 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.151105 Jan 11 15:19:35.122881 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 556/1129] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:34 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:36.032648 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-58154038-979d-4d9d-9ed4-b7760d53985b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:36.033687 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-58154038-979d-4d9d-9ed4-b7760d53985b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:36.039875 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-58154038-979d-4d9d-9ed4-b7760d53985b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:36.040320 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-58154038-979d-4d9d-9ed4-b7760d53985b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:36.041082 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-58154038-979d-4d9d-9ed4-b7760d53985b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:36.041516 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-58154038-979d-4d9d-9ed4-b7760d53985b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:36.069882 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-58154038-979d-4d9d-9ed4-b7760d53985b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041004 Jan 11 15:19:36.070414 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 574/1130] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:36 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:36.144376 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-eae3c4bc-f06e-4f17-a46b-2c7a0ce1df78 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:36.145015 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-eae3c4bc-f06e-4f17-a46b-2c7a0ce1df78 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:36.151194 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-eae3c4bc-f06e-4f17-a46b-2c7a0ce1df78 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:36.151676 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-eae3c4bc-f06e-4f17-a46b-2c7a0ce1df78 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:36.152449 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-eae3c4bc-f06e-4f17-a46b-2c7a0ce1df78 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:36.152887 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-eae3c4bc-f06e-4f17-a46b-2c7a0ce1df78 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:36.283148 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-eae3c4bc-f06e-4f17-a46b-2c7a0ce1df78 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:36.286247 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-eae3c4bc-f06e-4f17-a46b-2c7a0ce1df78 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.145483 Jan 11 15:19:36.286808 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 557/1131] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:36 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:37.082093 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-41657e79-7418-4398-9be4-6631cacaa1b7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:37.082922 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-41657e79-7418-4398-9be4-6631cacaa1b7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:37.089273 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-41657e79-7418-4398-9be4-6631cacaa1b7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:37.089732 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-41657e79-7418-4398-9be4-6631cacaa1b7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:37.090487 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-41657e79-7418-4398-9be4-6631cacaa1b7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:37.090922 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-41657e79-7418-4398-9be4-6631cacaa1b7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:37.118747 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-41657e79-7418-4398-9be4-6631cacaa1b7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040819 Jan 11 15:19:37.119275 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 575/1132] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:37 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:37.303276 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f96d750e-acff-4d35-a308-9549a7d5a013 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:37.303887 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f96d750e-acff-4d35-a308-9549a7d5a013 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:37.310662 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f96d750e-acff-4d35-a308-9549a7d5a013 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:37.312104 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f96d750e-acff-4d35-a308-9549a7d5a013 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:37.312104 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f96d750e-acff-4d35-a308-9549a7d5a013 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:37.312480 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f96d750e-acff-4d35-a308-9549a7d5a013 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:37.437500 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f96d750e-acff-4d35-a308-9549a7d5a013 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:37.444708 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f96d750e-acff-4d35-a308-9549a7d5a013 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.145083 Jan 11 15:19:37.445271 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 558/1133] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:37 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:38.130368 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f0c33434-504a-43e2-a876-ea87dcf739d8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:38.131305 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f0c33434-504a-43e2-a876-ea87dcf739d8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:38.137642 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f0c33434-504a-43e2-a876-ea87dcf739d8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:38.138095 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f0c33434-504a-43e2-a876-ea87dcf739d8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:38.138939 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f0c33434-504a-43e2-a876-ea87dcf739d8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:38.139409 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f0c33434-504a-43e2-a876-ea87dcf739d8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:38.168212 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f0c33434-504a-43e2-a876-ea87dcf739d8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041543 Jan 11 15:19:38.168758 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 576/1134] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:38 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:38.462007 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e329fc2c-0a83-47ae-ba5c-de3e67af246c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:38.462669 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e329fc2c-0a83-47ae-ba5c-de3e67af246c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:38.468833 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e329fc2c-0a83-47ae-ba5c-de3e67af246c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:38.469286 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e329fc2c-0a83-47ae-ba5c-de3e67af246c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:38.470058 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e329fc2c-0a83-47ae-ba5c-de3e67af246c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:38.470492 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e329fc2c-0a83-47ae-ba5c-de3e67af246c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:38.599840 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e329fc2c-0a83-47ae-ba5c-de3e67af246c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:38.607635 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e329fc2c-0a83-47ae-ba5c-de3e67af246c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.149317 Jan 11 15:19:38.608203 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 559/1135] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:38 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:39.179503 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d377ae43-562b-4903-9788-a8ce310d4c9c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:39.180337 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d377ae43-562b-4903-9788-a8ce310d4c9c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:39.187201 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d377ae43-562b-4903-9788-a8ce310d4c9c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:39.187686 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d377ae43-562b-4903-9788-a8ce310d4c9c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:39.188454 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d377ae43-562b-4903-9788-a8ce310d4c9c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:39.188894 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d377ae43-562b-4903-9788-a8ce310d4c9c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:39.216657 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d377ae43-562b-4903-9788-a8ce310d4c9c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041013 Jan 11 15:19:39.217201 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 577/1136] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:39 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:39.625067 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3a8a8046-11c4-43ee-867c-063549b3e7c0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:39.625677 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3a8a8046-11c4-43ee-867c-063549b3e7c0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:39.631898 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3a8a8046-11c4-43ee-867c-063549b3e7c0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:39.632349 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3a8a8046-11c4-43ee-867c-063549b3e7c0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:39.633123 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3a8a8046-11c4-43ee-867c-063549b3e7c0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:39.633559 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3a8a8046-11c4-43ee-867c-063549b3e7c0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:39.766639 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3a8a8046-11c4-43ee-867c-063549b3e7c0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:39.774106 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3a8a8046-11c4-43ee-867c-063549b3e7c0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.152599 Jan 11 15:19:39.774626 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 560/1137] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:39 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:40.227831 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-69286b67-6adb-4f63-9118-e6649d857078 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:40.228671 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-69286b67-6adb-4f63-9118-e6649d857078 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:40.235396 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-69286b67-6adb-4f63-9118-e6649d857078 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:40.235851 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-69286b67-6adb-4f63-9118-e6649d857078 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:40.236629 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-69286b67-6adb-4f63-9118-e6649d857078 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:40.237067 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-69286b67-6adb-4f63-9118-e6649d857078 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:40.266196 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-69286b67-6adb-4f63-9118-e6649d857078 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042124 Jan 11 15:19:40.266749 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 578/1138] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:40 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:40.790341 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-225130eb-8b6c-4c53-9d58-90a9308947e6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:40.790978 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-225130eb-8b6c-4c53-9d58-90a9308947e6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:40.797068 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-225130eb-8b6c-4c53-9d58-90a9308947e6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:40.801045 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-225130eb-8b6c-4c53-9d58-90a9308947e6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:40.801045 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-225130eb-8b6c-4c53-9d58-90a9308947e6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:40.801045 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-225130eb-8b6c-4c53-9d58-90a9308947e6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:41.136605 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-225130eb-8b6c-4c53-9d58-90a9308947e6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:41.143915 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-225130eb-8b6c-4c53-9d58-90a9308947e6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.357456 Jan 11 15:19:41.144495 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 561/1139] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:40 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:41.277737 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-72f4dd68-ca2f-44b3-840e-0a7708a5e8f9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:41.278682 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-72f4dd68-ca2f-44b3-840e-0a7708a5e8f9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:41.285215 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-72f4dd68-ca2f-44b3-840e-0a7708a5e8f9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:41.285658 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-72f4dd68-ca2f-44b3-840e-0a7708a5e8f9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:41.286435 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-72f4dd68-ca2f-44b3-840e-0a7708a5e8f9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:41.286875 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-72f4dd68-ca2f-44b3-840e-0a7708a5e8f9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:41.316427 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-72f4dd68-ca2f-44b3-840e-0a7708a5e8f9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042593 Jan 11 15:19:41.316969 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 579/1140] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:41 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:42.162050 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-60b30b0b-f2b8-4172-b2df-ccafe3c72faf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:42.162739 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-60b30b0b-f2b8-4172-b2df-ccafe3c72faf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:42.168872 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-60b30b0b-f2b8-4172-b2df-ccafe3c72faf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:42.169321 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-60b30b0b-f2b8-4172-b2df-ccafe3c72faf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:42.170087 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-60b30b0b-f2b8-4172-b2df-ccafe3c72faf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:42.170522 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-60b30b0b-f2b8-4172-b2df-ccafe3c72faf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:42.295057 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-60b30b0b-f2b8-4172-b2df-ccafe3c72faf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:42.302365 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-60b30b0b-f2b8-4172-b2df-ccafe3c72faf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.144015 Jan 11 15:19:42.302928 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 562/1141] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:42 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:42.328085 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2db59887-6e79-4ce5-a994-c834d27e9c46 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:42.334776 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2db59887-6e79-4ce5-a994-c834d27e9c46 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:42.335516 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2db59887-6e79-4ce5-a994-c834d27e9c46 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:42.335973 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2db59887-6e79-4ce5-a994-c834d27e9c46 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:42.336752 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2db59887-6e79-4ce5-a994-c834d27e9c46 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:42.337201 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2db59887-6e79-4ce5-a994-c834d27e9c46 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:42.365837 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2db59887-6e79-4ce5-a994-c834d27e9c46 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041537 Jan 11 15:19:42.366381 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 580/1142] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:42 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:43.319104 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d4fbd3ba-f2f1-4655-a169-e2edae92880b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:43.319722 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d4fbd3ba-f2f1-4655-a169-e2edae92880b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:43.326005 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d4fbd3ba-f2f1-4655-a169-e2edae92880b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:43.326448 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d4fbd3ba-f2f1-4655-a169-e2edae92880b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:43.327220 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d4fbd3ba-f2f1-4655-a169-e2edae92880b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:43.327703 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d4fbd3ba-f2f1-4655-a169-e2edae92880b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:43.376726 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f9de19b8-86ef-4b00-9ec4-d0ea53b1c3d2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:43.377633 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f9de19b8-86ef-4b00-9ec4-d0ea53b1c3d2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:43.383769 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f9de19b8-86ef-4b00-9ec4-d0ea53b1c3d2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:43.384214 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f9de19b8-86ef-4b00-9ec4-d0ea53b1c3d2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:43.384988 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f9de19b8-86ef-4b00-9ec4-d0ea53b1c3d2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:43.385427 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f9de19b8-86ef-4b00-9ec4-d0ea53b1c3d2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:43.415523 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f9de19b8-86ef-4b00-9ec4-d0ea53b1c3d2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042457 Jan 11 15:19:43.416091 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 581/1143] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:43 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:19:43.454816 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d4fbd3ba-f2f1-4655-a169-e2edae92880b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:43.462012 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d4fbd3ba-f2f1-4655-a169-e2edae92880b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.146639 Jan 11 15:19:43.462566 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 563/1144] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:43 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:44.426481 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a00ddc85-5ce3-4a70-96ca-a1a65bfb140a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:44.427423 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a00ddc85-5ce3-4a70-96ca-a1a65bfb140a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:44.433651 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a00ddc85-5ce3-4a70-96ca-a1a65bfb140a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:44.434086 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a00ddc85-5ce3-4a70-96ca-a1a65bfb140a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:44.434852 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a00ddc85-5ce3-4a70-96ca-a1a65bfb140a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:44.435284 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a00ddc85-5ce3-4a70-96ca-a1a65bfb140a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:44.463499 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a00ddc85-5ce3-4a70-96ca-a1a65bfb140a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040874 Jan 11 15:19:44.464698 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 582/1145] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:44 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:44.479019 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e872998d-fcd9-435e-b6b8-1434f8c73795 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:44.479726 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e872998d-fcd9-435e-b6b8-1434f8c73795 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:44.485983 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e872998d-fcd9-435e-b6b8-1434f8c73795 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:44.486427 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e872998d-fcd9-435e-b6b8-1434f8c73795 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:44.487195 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e872998d-fcd9-435e-b6b8-1434f8c73795 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:44.487653 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e872998d-fcd9-435e-b6b8-1434f8c73795 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:44.757030 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e872998d-fcd9-435e-b6b8-1434f8c73795 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:44.764637 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e872998d-fcd9-435e-b6b8-1434f8c73795 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.289280 Jan 11 15:19:44.765195 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 564/1146] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:44 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:45.474734 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f3d4d730-1437-469f-99fe-b6e1f3bb65ab tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:45.475666 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f3d4d730-1437-469f-99fe-b6e1f3bb65ab tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:45.482413 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f3d4d730-1437-469f-99fe-b6e1f3bb65ab tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:45.482859 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f3d4d730-1437-469f-99fe-b6e1f3bb65ab tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:45.483654 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f3d4d730-1437-469f-99fe-b6e1f3bb65ab tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:45.484086 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f3d4d730-1437-469f-99fe-b6e1f3bb65ab tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:45.512369 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f3d4d730-1437-469f-99fe-b6e1f3bb65ab tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041397 Jan 11 15:19:45.512834 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 583/1147] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:45 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:45.781825 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-70b1e638-e05e-40eb-97ce-fbcee80dfd90 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:45.782369 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-70b1e638-e05e-40eb-97ce-fbcee80dfd90 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:45.788480 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-70b1e638-e05e-40eb-97ce-fbcee80dfd90 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:45.788929 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-70b1e638-e05e-40eb-97ce-fbcee80dfd90 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:45.789694 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-70b1e638-e05e-40eb-97ce-fbcee80dfd90 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:45.790163 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-70b1e638-e05e-40eb-97ce-fbcee80dfd90 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:45.914878 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-70b1e638-e05e-40eb-97ce-fbcee80dfd90 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:45.922086 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-70b1e638-e05e-40eb-97ce-fbcee80dfd90 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.143978 Jan 11 15:19:45.922639 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 565/1148] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:45 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:46.523573 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7770e990-db80-4d20-bcd7-50810fb8e77d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:46.524413 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7770e990-db80-4d20-bcd7-50810fb8e77d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:46.530656 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7770e990-db80-4d20-bcd7-50810fb8e77d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:46.531110 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7770e990-db80-4d20-bcd7-50810fb8e77d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:46.531913 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7770e990-db80-4d20-bcd7-50810fb8e77d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:46.532355 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7770e990-db80-4d20-bcd7-50810fb8e77d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:46.560656 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7770e990-db80-4d20-bcd7-50810fb8e77d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040972 Jan 11 15:19:46.561194 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 584/1149] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:46 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:46.938167 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f0366ca4-3f10-4e13-a3b3-9ac372f533cc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:46.938775 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f0366ca4-3f10-4e13-a3b3-9ac372f533cc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:46.945094 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f0366ca4-3f10-4e13-a3b3-9ac372f533cc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:46.945546 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f0366ca4-3f10-4e13-a3b3-9ac372f533cc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:46.946324 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f0366ca4-3f10-4e13-a3b3-9ac372f533cc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:46.946764 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f0366ca4-3f10-4e13-a3b3-9ac372f533cc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:47.077340 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f0366ca4-3f10-4e13-a3b3-9ac372f533cc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:47.084844 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f0366ca4-3f10-4e13-a3b3-9ac372f533cc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.150296 Jan 11 15:19:47.085400 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 566/1150] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:46 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:47.571882 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7fa5b750-d3ed-41ca-8961-bf4a0a03bf1a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:47.573388 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7fa5b750-d3ed-41ca-8961-bf4a0a03bf1a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:47.579935 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7fa5b750-d3ed-41ca-8961-bf4a0a03bf1a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:47.580393 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7fa5b750-d3ed-41ca-8961-bf4a0a03bf1a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:47.581163 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7fa5b750-d3ed-41ca-8961-bf4a0a03bf1a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:47.581603 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7fa5b750-d3ed-41ca-8961-bf4a0a03bf1a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:47.610495 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7fa5b750-d3ed-41ca-8961-bf4a0a03bf1a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042403 Jan 11 15:19:47.611048 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 585/1151] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:47 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:19:48.101815 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-87b39ba3-0a34-4e28-b541-d51a4c7b62dc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:48.102428 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-87b39ba3-0a34-4e28-b541-d51a4c7b62dc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:48.109227 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-87b39ba3-0a34-4e28-b541-d51a4c7b62dc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:48.109680 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-87b39ba3-0a34-4e28-b541-d51a4c7b62dc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:48.110456 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-87b39ba3-0a34-4e28-b541-d51a4c7b62dc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:48.110897 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-87b39ba3-0a34-4e28-b541-d51a4c7b62dc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:48.238009 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-87b39ba3-0a34-4e28-b541-d51a4c7b62dc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:48.245416 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-87b39ba3-0a34-4e28-b541-d51a4c7b62dc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.147226 Jan 11 15:19:48.245993 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 567/1152] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:48 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:48.621696 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-74ecf7af-f550-4492-9231-9e0a941878a7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:48.622596 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-74ecf7af-f550-4492-9231-9e0a941878a7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:48.628809 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-74ecf7af-f550-4492-9231-9e0a941878a7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:48.629257 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-74ecf7af-f550-4492-9231-9e0a941878a7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:48.630027 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-74ecf7af-f550-4492-9231-9e0a941878a7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:48.630458 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-74ecf7af-f550-4492-9231-9e0a941878a7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:48.658452 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-74ecf7af-f550-4492-9231-9e0a941878a7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040523 Jan 11 15:19:48.658987 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 586/1153] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:48 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:49.262364 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b78d52b3-1ff2-4423-9daf-764b5337d079 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:49.262970 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b78d52b3-1ff2-4423-9daf-764b5337d079 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:49.269141 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b78d52b3-1ff2-4423-9daf-764b5337d079 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:49.269610 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b78d52b3-1ff2-4423-9daf-764b5337d079 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:49.270375 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b78d52b3-1ff2-4423-9daf-764b5337d079 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:49.270809 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b78d52b3-1ff2-4423-9daf-764b5337d079 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:49.408383 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b78d52b3-1ff2-4423-9daf-764b5337d079 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:49.415647 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b78d52b3-1ff2-4423-9daf-764b5337d079 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.157555 Jan 11 15:19:49.416202 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 568/1154] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:49 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:49.670758 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d0ff70c7-78ee-4bff-bc2a-ea95e884aff6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:49.671601 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d0ff70c7-78ee-4bff-bc2a-ea95e884aff6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:49.677923 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d0ff70c7-78ee-4bff-bc2a-ea95e884aff6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:49.678369 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d0ff70c7-78ee-4bff-bc2a-ea95e884aff6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:49.679141 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d0ff70c7-78ee-4bff-bc2a-ea95e884aff6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:49.679600 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d0ff70c7-78ee-4bff-bc2a-ea95e884aff6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:49.708073 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d0ff70c7-78ee-4bff-bc2a-ea95e884aff6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041232 Jan 11 15:19:49.708606 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 587/1155] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:49 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:50.432176 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1876cc35-eaab-4e94-b1fb-737efedd3f98 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:50.432785 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1876cc35-eaab-4e94-b1fb-737efedd3f98 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:50.439066 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1876cc35-eaab-4e94-b1fb-737efedd3f98 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:50.439556 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1876cc35-eaab-4e94-b1fb-737efedd3f98 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:50.440334 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1876cc35-eaab-4e94-b1fb-737efedd3f98 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:50.440771 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1876cc35-eaab-4e94-b1fb-737efedd3f98 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:50.565862 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1876cc35-eaab-4e94-b1fb-737efedd3f98 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:50.573119 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1876cc35-eaab-4e94-b1fb-737efedd3f98 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.144618 Jan 11 15:19:50.575449 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 569/1156] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:50 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:50.720071 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4271bd34-705a-4df1-961f-1d5e9fa72239 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:50.720981 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4271bd34-705a-4df1-961f-1d5e9fa72239 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:50.727183 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4271bd34-705a-4df1-961f-1d5e9fa72239 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:50.727656 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4271bd34-705a-4df1-961f-1d5e9fa72239 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:50.728484 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4271bd34-705a-4df1-961f-1d5e9fa72239 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:50.728929 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4271bd34-705a-4df1-961f-1d5e9fa72239 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:50.757544 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4271bd34-705a-4df1-961f-1d5e9fa72239 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041273 Jan 11 15:19:50.758083 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 588/1157] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:50 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:51.589726 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5cde29ba-34c6-482a-9c4d-6d8fbd2e4313 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:51.590269 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5cde29ba-34c6-482a-9c4d-6d8fbd2e4313 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:51.596723 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5cde29ba-34c6-482a-9c4d-6d8fbd2e4313 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:51.597176 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5cde29ba-34c6-482a-9c4d-6d8fbd2e4313 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:51.597954 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5cde29ba-34c6-482a-9c4d-6d8fbd2e4313 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:51.598394 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5cde29ba-34c6-482a-9c4d-6d8fbd2e4313 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:51.724512 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-5cde29ba-34c6-482a-9c4d-6d8fbd2e4313 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:51.731807 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5cde29ba-34c6-482a-9c4d-6d8fbd2e4313 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.145840 Jan 11 15:19:51.732361 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 570/1158] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:51 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:51.768651 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c53be563-33b4-41ff-a21c-982c882dbae8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:51.773496 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c53be563-33b4-41ff-a21c-982c882dbae8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:51.775866 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c53be563-33b4-41ff-a21c-982c882dbae8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:51.776318 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c53be563-33b4-41ff-a21c-982c882dbae8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:51.777106 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c53be563-33b4-41ff-a21c-982c882dbae8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:51.777551 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c53be563-33b4-41ff-a21c-982c882dbae8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:51.805514 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c53be563-33b4-41ff-a21c-982c882dbae8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040629 Jan 11 15:19:51.806056 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 589/1159] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:51 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:52.748408 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-92db7861-57c3-4ff0-9d1d-ab249b0e0a64 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:52.748959 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-92db7861-57c3-4ff0-9d1d-ab249b0e0a64 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:52.755314 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-92db7861-57c3-4ff0-9d1d-ab249b0e0a64 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:52.755767 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-92db7861-57c3-4ff0-9d1d-ab249b0e0a64 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:52.756538 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-92db7861-57c3-4ff0-9d1d-ab249b0e0a64 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:52.756978 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-92db7861-57c3-4ff0-9d1d-ab249b0e0a64 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:52.817327 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-46d3b747-f209-4d67-83b5-622b95722985 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:52.818263 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-46d3b747-f209-4d67-83b5-622b95722985 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:52.824820 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-46d3b747-f209-4d67-83b5-622b95722985 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:52.825149 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-46d3b747-f209-4d67-83b5-622b95722985 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:52.826456 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-46d3b747-f209-4d67-83b5-622b95722985 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:52.826905 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-46d3b747-f209-4d67-83b5-622b95722985 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:52.857235 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-46d3b747-f209-4d67-83b5-622b95722985 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043784 Jan 11 15:19:52.857807 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 590/1160] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:52 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:19:52.890580 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-92db7861-57c3-4ff0-9d1d-ab249b0e0a64 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:52.897979 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-92db7861-57c3-4ff0-9d1d-ab249b0e0a64 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.153260 Jan 11 15:19:52.898543 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 571/1161] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:52 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:53.868837 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f0fe365c-b168-4afb-a742-bae1bbb4dba7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:53.869780 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f0fe365c-b168-4afb-a742-bae1bbb4dba7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:53.876130 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f0fe365c-b168-4afb-a742-bae1bbb4dba7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:53.876585 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f0fe365c-b168-4afb-a742-bae1bbb4dba7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:53.877357 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f0fe365c-b168-4afb-a742-bae1bbb4dba7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:53.877805 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f0fe365c-b168-4afb-a742-bae1bbb4dba7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:53.906022 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f0fe365c-b168-4afb-a742-bae1bbb4dba7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041110 Jan 11 15:19:53.906560 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 591/1162] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:53 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:53.915223 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b211fa55-78ee-4d88-b04f-d932cb196ab0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:53.915971 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b211fa55-78ee-4d88-b04f-d932cb196ab0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:53.922087 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b211fa55-78ee-4d88-b04f-d932cb196ab0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:53.922533 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b211fa55-78ee-4d88-b04f-d932cb196ab0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:53.923317 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b211fa55-78ee-4d88-b04f-d932cb196ab0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:53.923763 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b211fa55-78ee-4d88-b04f-d932cb196ab0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:54.048643 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b211fa55-78ee-4d88-b04f-d932cb196ab0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:54.055920 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b211fa55-78ee-4d88-b04f-d932cb196ab0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.144276 Jan 11 15:19:54.056472 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 572/1163] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:53 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:54.917414 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2c874c05-3f0d-484b-8a07-ed285e68c69c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:54.918264 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2c874c05-3f0d-484b-8a07-ed285e68c69c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:54.924508 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2c874c05-3f0d-484b-8a07-ed285e68c69c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:54.924964 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2c874c05-3f0d-484b-8a07-ed285e68c69c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:54.925740 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2c874c05-3f0d-484b-8a07-ed285e68c69c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:54.926188 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2c874c05-3f0d-484b-8a07-ed285e68c69c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:54.954876 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2c874c05-3f0d-484b-8a07-ed285e68c69c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041268 Jan 11 15:19:54.955459 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 592/1164] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:54 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:55.073025 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-46b40a03-3a71-4888-bfb8-6f8ecbf9fa1c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:55.073634 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-46b40a03-3a71-4888-bfb8-6f8ecbf9fa1c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:55.080610 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-46b40a03-3a71-4888-bfb8-6f8ecbf9fa1c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:55.081060 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-46b40a03-3a71-4888-bfb8-6f8ecbf9fa1c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:55.081827 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-46b40a03-3a71-4888-bfb8-6f8ecbf9fa1c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:55.082261 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-46b40a03-3a71-4888-bfb8-6f8ecbf9fa1c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:55.213794 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-46b40a03-3a71-4888-bfb8-6f8ecbf9fa1c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:55.221593 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-46b40a03-3a71-4888-bfb8-6f8ecbf9fa1c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.152321 Jan 11 15:19:55.222144 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 573/1165] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:55 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:55.965261 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-6b7ea064-a728-4a44-8bbd-607803a5374f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:55.966666 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-6b7ea064-a728-4a44-8bbd-607803a5374f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:55.972840 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6b7ea064-a728-4a44-8bbd-607803a5374f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:55.973286 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6b7ea064-a728-4a44-8bbd-607803a5374f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:55.974050 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6b7ea064-a728-4a44-8bbd-607803a5374f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:55.974482 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6b7ea064-a728-4a44-8bbd-607803a5374f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:56.002509 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-6b7ea064-a728-4a44-8bbd-607803a5374f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040973 Jan 11 15:19:56.003049 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 593/1166] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:55 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:56.238322 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0cf018c1-d883-49c4-a7a5-d788fad2ee5a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:56.238841 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0cf018c1-d883-49c4-a7a5-d788fad2ee5a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:56.245119 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0cf018c1-d883-49c4-a7a5-d788fad2ee5a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:56.245573 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0cf018c1-d883-49c4-a7a5-d788fad2ee5a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:56.246350 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0cf018c1-d883-49c4-a7a5-d788fad2ee5a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:56.246793 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0cf018c1-d883-49c4-a7a5-d788fad2ee5a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:56.371996 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0cf018c1-d883-49c4-a7a5-d788fad2ee5a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:56.379180 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0cf018c1-d883-49c4-a7a5-d788fad2ee5a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.144539 Jan 11 15:19:56.379772 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 574/1167] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:56 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:57.014789 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-30f52127-08a6-4c04-a720-389e31a4d246 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:57.015856 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-30f52127-08a6-4c04-a720-389e31a4d246 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:57.022577 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-30f52127-08a6-4c04-a720-389e31a4d246 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:57.023052 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-30f52127-08a6-4c04-a720-389e31a4d246 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:57.023928 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-30f52127-08a6-4c04-a720-389e31a4d246 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:57.024372 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-30f52127-08a6-4c04-a720-389e31a4d246 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:57.052800 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-30f52127-08a6-4c04-a720-389e31a4d246 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042667 Jan 11 15:19:57.053255 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 594/1168] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:57 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:57.398644 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-dd242b9a-524b-4f19-827c-6de85d80e29c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:57.399726 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-dd242b9a-524b-4f19-827c-6de85d80e29c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:57.409050 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dd242b9a-524b-4f19-827c-6de85d80e29c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:57.409506 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dd242b9a-524b-4f19-827c-6de85d80e29c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:57.410292 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dd242b9a-524b-4f19-827c-6de85d80e29c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:57.410732 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dd242b9a-524b-4f19-827c-6de85d80e29c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:57.537154 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-dd242b9a-524b-4f19-827c-6de85d80e29c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:57.544422 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-dd242b9a-524b-4f19-827c-6de85d80e29c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.151186 Jan 11 15:19:57.544973 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 575/1169] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:57 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:58.063942 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3ad261bb-9fec-4acf-82ac-43bb37b7ac50 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:58.064867 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3ad261bb-9fec-4acf-82ac-43bb37b7ac50 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:58.071047 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3ad261bb-9fec-4acf-82ac-43bb37b7ac50 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:58.071525 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3ad261bb-9fec-4acf-82ac-43bb37b7ac50 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:58.072291 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3ad261bb-9fec-4acf-82ac-43bb37b7ac50 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:58.072727 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3ad261bb-9fec-4acf-82ac-43bb37b7ac50 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:58.101568 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3ad261bb-9fec-4acf-82ac-43bb37b7ac50 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041430 Jan 11 15:19:58.102107 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 595/1170] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:58 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:58.560735 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a448074d-07e1-4573-856d-16ab0328b886 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:58.561347 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a448074d-07e1-4573-856d-16ab0328b886 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:58.567577 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a448074d-07e1-4573-856d-16ab0328b886 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:58.568028 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a448074d-07e1-4573-856d-16ab0328b886 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:58.568805 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a448074d-07e1-4573-856d-16ab0328b886 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:58.569251 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a448074d-07e1-4573-856d-16ab0328b886 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:58.702607 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a448074d-07e1-4573-856d-16ab0328b886 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:58.712922 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a448074d-07e1-4573-856d-16ab0328b886 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.156400 Jan 11 15:19:58.713486 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 576/1171] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:58 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:19:59.113308 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-26ad52fe-a86b-4e38-9e64-c616769d6dce tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:59.114253 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-26ad52fe-a86b-4e38-9e64-c616769d6dce tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:59.120485 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-26ad52fe-a86b-4e38-9e64-c616769d6dce tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:59.120940 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-26ad52fe-a86b-4e38-9e64-c616769d6dce tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:59.121769 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-26ad52fe-a86b-4e38-9e64-c616769d6dce tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:59.122214 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-26ad52fe-a86b-4e38-9e64-c616769d6dce tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:59.150154 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-26ad52fe-a86b-4e38-9e64-c616769d6dce tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040634 Jan 11 15:19:59.150702 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 596/1172] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:19:59 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:19:59.728667 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6f3eccff-5d01-48b3-bf48-7bfa7e8c9b25 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:19:59.729278 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6f3eccff-5d01-48b3-bf48-7bfa7e8c9b25 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:19:59.735520 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6f3eccff-5d01-48b3-bf48-7bfa7e8c9b25 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:59.735969 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6f3eccff-5d01-48b3-bf48-7bfa7e8c9b25 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:59.736737 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6f3eccff-5d01-48b3-bf48-7bfa7e8c9b25 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:19:59.737176 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6f3eccff-5d01-48b3-bf48-7bfa7e8c9b25 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:19:59.862677 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6f3eccff-5d01-48b3-bf48-7bfa7e8c9b25 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:19:59.870090 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6f3eccff-5d01-48b3-bf48-7bfa7e8c9b25 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.145053 Jan 11 15:19:59.870659 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 577/1173] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:19:59 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:00.161980 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7a27db82-f187-4d78-b88e-8ab3599d1986 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:00.162897 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7a27db82-f187-4d78-b88e-8ab3599d1986 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:00.169666 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7a27db82-f187-4d78-b88e-8ab3599d1986 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:00.170115 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7a27db82-f187-4d78-b88e-8ab3599d1986 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:00.170890 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7a27db82-f187-4d78-b88e-8ab3599d1986 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:00.171349 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7a27db82-f187-4d78-b88e-8ab3599d1986 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:00.200216 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7a27db82-f187-4d78-b88e-8ab3599d1986 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042046 Jan 11 15:20:00.200761 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 597/1174] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:00 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:00.886993 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-93696702-ceb4-4b7d-a635-053272edf128 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:00.887638 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-93696702-ceb4-4b7d-a635-053272edf128 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:00.893915 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-93696702-ceb4-4b7d-a635-053272edf128 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:00.894371 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-93696702-ceb4-4b7d-a635-053272edf128 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:00.895153 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-93696702-ceb4-4b7d-a635-053272edf128 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:00.895624 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-93696702-ceb4-4b7d-a635-053272edf128 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:01.025605 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-93696702-ceb4-4b7d-a635-053272edf128 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:01.032873 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-93696702-ceb4-4b7d-a635-053272edf128 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.149525 Jan 11 15:20:01.033429 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 578/1175] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:00 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:01.211811 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-9d166e2e-5b42-4b72-b6c1-eb412f7e042f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:01.212636 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-9d166e2e-5b42-4b72-b6c1-eb412f7e042f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:01.220180 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9d166e2e-5b42-4b72-b6c1-eb412f7e042f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:01.220931 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9d166e2e-5b42-4b72-b6c1-eb412f7e042f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:01.222251 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9d166e2e-5b42-4b72-b6c1-eb412f7e042f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:01.222881 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9d166e2e-5b42-4b72-b6c1-eb412f7e042f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:01.252636 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-9d166e2e-5b42-4b72-b6c1-eb412f7e042f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044564 Jan 11 15:20:01.253196 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 598/1176] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:01 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:02.049217 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-45518685-eecc-4cd2-9e8e-f441181fe2ce tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:02.049822 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-45518685-eecc-4cd2-9e8e-f441181fe2ce tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:02.056098 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-45518685-eecc-4cd2-9e8e-f441181fe2ce tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:02.056546 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-45518685-eecc-4cd2-9e8e-f441181fe2ce tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:02.057314 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-45518685-eecc-4cd2-9e8e-f441181fe2ce tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:02.057751 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-45518685-eecc-4cd2-9e8e-f441181fe2ce tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:02.183939 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-45518685-eecc-4cd2-9e8e-f441181fe2ce tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:02.191578 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-45518685-eecc-4cd2-9e8e-f441181fe2ce tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.145939 Jan 11 15:20:02.192138 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 579/1177] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:02 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:02.264422 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-9896cf18-ea11-49ab-a12e-abcdfa58fdd9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:02.265336 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-9896cf18-ea11-49ab-a12e-abcdfa58fdd9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:02.271808 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9896cf18-ea11-49ab-a12e-abcdfa58fdd9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:02.272256 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9896cf18-ea11-49ab-a12e-abcdfa58fdd9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:02.273023 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9896cf18-ea11-49ab-a12e-abcdfa58fdd9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:02.273457 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9896cf18-ea11-49ab-a12e-abcdfa58fdd9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:02.301640 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-9896cf18-ea11-49ab-a12e-abcdfa58fdd9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041889 Jan 11 15:20:02.302144 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 599/1178] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:02 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:03.209415 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a0cca81b-ca84-4c2c-82c3-00c8e57fa075 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:03.210057 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a0cca81b-ca84-4c2c-82c3-00c8e57fa075 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:03.216671 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a0cca81b-ca84-4c2c-82c3-00c8e57fa075 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:03.217123 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a0cca81b-ca84-4c2c-82c3-00c8e57fa075 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:03.217901 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a0cca81b-ca84-4c2c-82c3-00c8e57fa075 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:03.218334 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a0cca81b-ca84-4c2c-82c3-00c8e57fa075 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:03.312745 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-6eb936d2-f347-4b1a-8251-6dfb371dff04 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:03.315093 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-6eb936d2-f347-4b1a-8251-6dfb371dff04 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:03.319567 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6eb936d2-f347-4b1a-8251-6dfb371dff04 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:03.320015 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6eb936d2-f347-4b1a-8251-6dfb371dff04 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:03.320784 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6eb936d2-f347-4b1a-8251-6dfb371dff04 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:03.321218 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6eb936d2-f347-4b1a-8251-6dfb371dff04 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:03.350804 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-6eb936d2-f347-4b1a-8251-6dfb371dff04 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041755 Jan 11 15:20:03.351117 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a0cca81b-ca84-4c2c-82c3-00c8e57fa075 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:03.351715 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 600/1179] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:03 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:20:03.358445 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a0cca81b-ca84-4c2c-82c3-00c8e57fa075 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.153256 Jan 11 15:20:03.358993 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 580/1180] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:03 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:04.362694 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-fa711fe8-6562-486a-974c-8759ff8bc925 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:04.363582 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-fa711fe8-6562-486a-974c-8759ff8bc925 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:04.369723 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fa711fe8-6562-486a-974c-8759ff8bc925 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:04.370182 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fa711fe8-6562-486a-974c-8759ff8bc925 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:04.370960 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fa711fe8-6562-486a-974c-8759ff8bc925 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:04.371427 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fa711fe8-6562-486a-974c-8759ff8bc925 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:04.374705 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-71cc00ac-7783-49dc-b798-6713e1a28144 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:04.375373 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-71cc00ac-7783-49dc-b798-6713e1a28144 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:04.381482 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-71cc00ac-7783-49dc-b798-6713e1a28144 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:04.381926 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-71cc00ac-7783-49dc-b798-6713e1a28144 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:04.382695 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-71cc00ac-7783-49dc-b798-6713e1a28144 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:04.383128 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-71cc00ac-7783-49dc-b798-6713e1a28144 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:04.399633 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-fa711fe8-6562-486a-974c-8759ff8bc925 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040705 Jan 11 15:20:04.400194 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 601/1181] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:04 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:04.509177 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-71cc00ac-7783-49dc-b798-6713e1a28144 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:04.516366 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-71cc00ac-7783-49dc-b798-6713e1a28144 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.145215 Jan 11 15:20:04.516924 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 581/1182] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:04 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:05.411589 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3992e50d-e23a-49a1-83ec-126a2a60b42e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:05.412552 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3992e50d-e23a-49a1-83ec-126a2a60b42e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:05.418797 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3992e50d-e23a-49a1-83ec-126a2a60b42e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:05.419246 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3992e50d-e23a-49a1-83ec-126a2a60b42e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:05.420047 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3992e50d-e23a-49a1-83ec-126a2a60b42e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:05.420479 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3992e50d-e23a-49a1-83ec-126a2a60b42e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:05.448431 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3992e50d-e23a-49a1-83ec-126a2a60b42e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040700 Jan 11 15:20:05.448979 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 602/1183] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:05 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:05.533552 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1cfd7628-ce61-4a08-ba86-da578d9a059d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:05.534067 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1cfd7628-ce61-4a08-ba86-da578d9a059d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:05.540358 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1cfd7628-ce61-4a08-ba86-da578d9a059d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:05.540812 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1cfd7628-ce61-4a08-ba86-da578d9a059d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:05.541612 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1cfd7628-ce61-4a08-ba86-da578d9a059d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:05.542053 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1cfd7628-ce61-4a08-ba86-da578d9a059d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:05.670659 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1cfd7628-ce61-4a08-ba86-da578d9a059d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:05.677855 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1cfd7628-ce61-4a08-ba86-da578d9a059d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.148045 Jan 11 15:20:05.678409 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 582/1184] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:05 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:06.460129 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2ba05148-256e-418e-9910-c9099d164aab tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:06.461039 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2ba05148-256e-418e-9910-c9099d164aab tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:06.467931 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2ba05148-256e-418e-9910-c9099d164aab tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:06.468385 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2ba05148-256e-418e-9910-c9099d164aab tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:06.469155 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2ba05148-256e-418e-9910-c9099d164aab tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:06.469595 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2ba05148-256e-418e-9910-c9099d164aab tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:06.497964 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2ba05148-256e-418e-9910-c9099d164aab tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041538 Jan 11 15:20:06.498513 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 603/1185] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:06 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:06.693685 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e34e0a1b-4379-413c-bc30-8a7199aa6f47 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:06.694246 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e34e0a1b-4379-413c-bc30-8a7199aa6f47 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:06.701048 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e34e0a1b-4379-413c-bc30-8a7199aa6f47 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:06.701497 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e34e0a1b-4379-413c-bc30-8a7199aa6f47 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:06.702261 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e34e0a1b-4379-413c-bc30-8a7199aa6f47 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:06.702696 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e34e0a1b-4379-413c-bc30-8a7199aa6f47 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:06.831118 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e34e0a1b-4379-413c-bc30-8a7199aa6f47 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:06.838236 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e34e0a1b-4379-413c-bc30-8a7199aa6f47 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.148249 Jan 11 15:20:06.838794 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 583/1186] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:06 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:07.509062 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-99c4b908-23c3-4151-aebd-89f138c81b19 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:07.509887 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-99c4b908-23c3-4151-aebd-89f138c81b19 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:07.516712 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-99c4b908-23c3-4151-aebd-89f138c81b19 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:07.517157 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-99c4b908-23c3-4151-aebd-89f138c81b19 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:07.517925 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-99c4b908-23c3-4151-aebd-89f138c81b19 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:07.518358 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-99c4b908-23c3-4151-aebd-89f138c81b19 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:07.545871 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-99c4b908-23c3-4151-aebd-89f138c81b19 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040659 Jan 11 15:20:07.546405 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 604/1187] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:07 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:07.854926 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7d8f2a01-0040-4b2f-b090-3d299c5c5ac5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:07.855530 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-7d8f2a01-0040-4b2f-b090-3d299c5c5ac5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:07.862134 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7d8f2a01-0040-4b2f-b090-3d299c5c5ac5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:07.862579 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7d8f2a01-0040-4b2f-b090-3d299c5c5ac5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:07.863363 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7d8f2a01-0040-4b2f-b090-3d299c5c5ac5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:07.863799 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7d8f2a01-0040-4b2f-b090-3d299c5c5ac5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:07.989756 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-7d8f2a01-0040-4b2f-b090-3d299c5c5ac5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:07.996954 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7d8f2a01-0040-4b2f-b090-3d299c5c5ac5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.145741 Jan 11 15:20:07.997513 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 584/1188] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:07 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:08.556986 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-44169620-773d-49b6-9964-42b6ffda3be3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:08.557844 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-44169620-773d-49b6-9964-42b6ffda3be3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:08.563978 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-44169620-773d-49b6-9964-42b6ffda3be3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:08.564429 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-44169620-773d-49b6-9964-42b6ffda3be3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:08.565200 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-44169620-773d-49b6-9964-42b6ffda3be3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:08.565636 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-44169620-773d-49b6-9964-42b6ffda3be3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:08.594782 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-44169620-773d-49b6-9964-42b6ffda3be3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041808 Jan 11 15:20:08.595398 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 605/1189] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:08 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:09.014025 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-bfaa912c-6ae6-45d3-b947-87f16e10d251 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:09.014633 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-bfaa912c-6ae6-45d3-b947-87f16e10d251 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:09.020879 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bfaa912c-6ae6-45d3-b947-87f16e10d251 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:09.021331 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bfaa912c-6ae6-45d3-b947-87f16e10d251 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:09.022104 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bfaa912c-6ae6-45d3-b947-87f16e10d251 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:09.022546 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bfaa912c-6ae6-45d3-b947-87f16e10d251 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:09.152157 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-bfaa912c-6ae6-45d3-b947-87f16e10d251 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:09.159266 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-bfaa912c-6ae6-45d3-b947-87f16e10d251 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.149477 Jan 11 15:20:09.159844 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 585/1190] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:09 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:09.606755 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b34fb5c4-c606-4889-8252-97a25faa070e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:09.607647 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b34fb5c4-c606-4889-8252-97a25faa070e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:09.613879 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b34fb5c4-c606-4889-8252-97a25faa070e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:09.614333 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b34fb5c4-c606-4889-8252-97a25faa070e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:09.615113 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b34fb5c4-c606-4889-8252-97a25faa070e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:09.615583 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b34fb5c4-c606-4889-8252-97a25faa070e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:09.643364 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b34fb5c4-c606-4889-8252-97a25faa070e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040953 Jan 11 15:20:09.643914 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 606/1191] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:09 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:10.180926 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3304aa65-257b-4461-b8f4-4f04f6ff0075 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:10.181522 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3304aa65-257b-4461-b8f4-4f04f6ff0075 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:10.187817 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3304aa65-257b-4461-b8f4-4f04f6ff0075 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:10.188271 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3304aa65-257b-4461-b8f4-4f04f6ff0075 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:10.189047 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3304aa65-257b-4461-b8f4-4f04f6ff0075 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:10.189488 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3304aa65-257b-4461-b8f4-4f04f6ff0075 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:10.317726 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3304aa65-257b-4461-b8f4-4f04f6ff0075 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:10.325926 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3304aa65-257b-4461-b8f4-4f04f6ff0075 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.148661 Jan 11 15:20:10.326485 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 586/1192] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:10 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:10.654468 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-0528dcd7-adb7-4584-85a5-f32ca5523831 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:10.655454 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-0528dcd7-adb7-4584-85a5-f32ca5523831 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:10.661674 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0528dcd7-adb7-4584-85a5-f32ca5523831 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:10.662135 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0528dcd7-adb7-4584-85a5-f32ca5523831 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:10.662915 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0528dcd7-adb7-4584-85a5-f32ca5523831 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:10.663394 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0528dcd7-adb7-4584-85a5-f32ca5523831 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:10.692110 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-0528dcd7-adb7-4584-85a5-f32ca5523831 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041360 Jan 11 15:20:10.692650 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 607/1193] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:10 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:20:11.342794 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-85832a06-3bb2-4ccc-8936-44738a32b60d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:11.343423 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-85832a06-3bb2-4ccc-8936-44738a32b60d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:11.349639 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-85832a06-3bb2-4ccc-8936-44738a32b60d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:11.350094 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-85832a06-3bb2-4ccc-8936-44738a32b60d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:11.350870 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-85832a06-3bb2-4ccc-8936-44738a32b60d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:11.351334 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-85832a06-3bb2-4ccc-8936-44738a32b60d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:11.482373 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-85832a06-3bb2-4ccc-8936-44738a32b60d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:11.489619 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-85832a06-3bb2-4ccc-8936-44738a32b60d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.150552 Jan 11 15:20:11.490180 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 587/1194] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:11 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:11.703510 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-917df475-bd81-45e1-81cf-82187c99f6a7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:11.704438 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-917df475-bd81-45e1-81cf-82187c99f6a7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:11.710612 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-917df475-bd81-45e1-81cf-82187c99f6a7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:11.711057 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-917df475-bd81-45e1-81cf-82187c99f6a7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:11.711869 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-917df475-bd81-45e1-81cf-82187c99f6a7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:11.712304 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-917df475-bd81-45e1-81cf-82187c99f6a7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:11.740911 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-917df475-bd81-45e1-81cf-82187c99f6a7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041491 Jan 11 15:20:11.741447 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 608/1195] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:11 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:12.508792 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a6a0c33f-5bf9-4d4f-987f-45d0e13757ca tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:12.509691 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a6a0c33f-5bf9-4d4f-987f-45d0e13757ca tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:12.516568 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a6a0c33f-5bf9-4d4f-987f-45d0e13757ca tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:12.517016 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a6a0c33f-5bf9-4d4f-987f-45d0e13757ca tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:12.517798 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a6a0c33f-5bf9-4d4f-987f-45d0e13757ca tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:12.518239 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a6a0c33f-5bf9-4d4f-987f-45d0e13757ca tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:12.643499 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a6a0c33f-5bf9-4d4f-987f-45d0e13757ca tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:12.650663 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a6a0c33f-5bf9-4d4f-987f-45d0e13757ca tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.146935 Jan 11 15:20:12.651225 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 588/1196] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:12 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:12.751961 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-cd1a36a5-0053-4404-bd94-388c09a072b1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:12.752909 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-cd1a36a5-0053-4404-bd94-388c09a072b1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:12.759189 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cd1a36a5-0053-4404-bd94-388c09a072b1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:12.759619 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cd1a36a5-0053-4404-bd94-388c09a072b1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:12.760398 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cd1a36a5-0053-4404-bd94-388c09a072b1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:12.760835 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cd1a36a5-0053-4404-bd94-388c09a072b1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:12.791154 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-cd1a36a5-0053-4404-bd94-388c09a072b1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042843 Jan 11 15:20:12.791757 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 609/1197] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:12 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:13.667197 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-47f57590-c328-46b3-bc24-143790d19244 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:13.667804 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-47f57590-c328-46b3-bc24-143790d19244 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:13.673965 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-47f57590-c328-46b3-bc24-143790d19244 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:13.674416 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-47f57590-c328-46b3-bc24-143790d19244 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:13.675183 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-47f57590-c328-46b3-bc24-143790d19244 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:13.675641 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-47f57590-c328-46b3-bc24-143790d19244 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:13.803058 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-69ba1b03-db81-41bb-af08-1185031f20e7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:13.803987 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-69ba1b03-db81-41bb-af08-1185031f20e7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:13.805878 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-47f57590-c328-46b3-bc24-143790d19244 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:13.813031 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-69ba1b03-db81-41bb-af08-1185031f20e7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:13.813406 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-47f57590-c328-46b3-bc24-143790d19244 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.149996 Jan 11 15:20:13.813530 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-69ba1b03-db81-41bb-af08-1185031f20e7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:13.814161 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 589/1198] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:13 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:13.814289 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-69ba1b03-db81-41bb-af08-1185031f20e7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:13.814686 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-69ba1b03-db81-41bb-af08-1185031f20e7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:13.987744 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-69ba1b03-db81-41bb-af08-1185031f20e7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.188944 Jan 11 15:20:13.988196 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 610/1199] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:13 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:20:14.830505 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-be5f923c-613f-40ea-bac6-adcfee865569 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:14.831115 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-be5f923c-613f-40ea-bac6-adcfee865569 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:14.837442 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-be5f923c-613f-40ea-bac6-adcfee865569 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:14.837891 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-be5f923c-613f-40ea-bac6-adcfee865569 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:14.838664 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-be5f923c-613f-40ea-bac6-adcfee865569 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:14.839104 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-be5f923c-613f-40ea-bac6-adcfee865569 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:14.963850 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-be5f923c-613f-40ea-bac6-adcfee865569 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:14.971646 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-be5f923c-613f-40ea-bac6-adcfee865569 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.145103 Jan 11 15:20:14.972209 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 590/1200] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:14 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:14.999204 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-5f37db2e-0a0a-41fa-8d09-2512ff13c3ad tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:15.000136 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-5f37db2e-0a0a-41fa-8d09-2512ff13c3ad tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:15.006291 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5f37db2e-0a0a-41fa-8d09-2512ff13c3ad tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:15.006739 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5f37db2e-0a0a-41fa-8d09-2512ff13c3ad tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:15.007570 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5f37db2e-0a0a-41fa-8d09-2512ff13c3ad tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:15.008026 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5f37db2e-0a0a-41fa-8d09-2512ff13c3ad tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:15.035901 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-5f37db2e-0a0a-41fa-8d09-2512ff13c3ad tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040511 Jan 11 15:20:15.036428 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 611/1201] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:14 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:15.988735 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b2424e4a-9cdb-46f3-be5c-937d5bf45575 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:15.989360 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b2424e4a-9cdb-46f3-be5c-937d5bf45575 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:15.995539 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b2424e4a-9cdb-46f3-be5c-937d5bf45575 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:15.995991 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b2424e4a-9cdb-46f3-be5c-937d5bf45575 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:15.996757 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b2424e4a-9cdb-46f3-be5c-937d5bf45575 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:15.997194 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b2424e4a-9cdb-46f3-be5c-937d5bf45575 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:16.047057 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f37cf8a7-8270-40b0-b3c1-29d0a84954e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:16.047994 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f37cf8a7-8270-40b0-b3c1-29d0a84954e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:16.054120 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f37cf8a7-8270-40b0-b3c1-29d0a84954e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:16.054565 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f37cf8a7-8270-40b0-b3c1-29d0a84954e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:16.055348 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f37cf8a7-8270-40b0-b3c1-29d0a84954e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:16.055786 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f37cf8a7-8270-40b0-b3c1-29d0a84954e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:16.084679 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f37cf8a7-8270-40b0-b3c1-29d0a84954e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041245 Jan 11 15:20:16.085229 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 612/1202] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:16 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:20:16.126042 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b2424e4a-9cdb-46f3-be5c-937d5bf45575 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:16.135314 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b2424e4a-9cdb-46f3-be5c-937d5bf45575 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.150171 Jan 11 15:20:16.135881 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 591/1203] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:15 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:17.097310 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4652fa57-6bc4-4891-a1c1-e244b5e735e3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:17.098156 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4652fa57-6bc4-4891-a1c1-e244b5e735e3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:17.104542 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4652fa57-6bc4-4891-a1c1-e244b5e735e3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:17.105007 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4652fa57-6bc4-4891-a1c1-e244b5e735e3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:17.106393 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4652fa57-6bc4-4891-a1c1-e244b5e735e3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:17.106837 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4652fa57-6bc4-4891-a1c1-e244b5e735e3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:17.136216 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4652fa57-6bc4-4891-a1c1-e244b5e735e3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043086 Jan 11 15:20:17.136759 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 613/1204] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:17 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:17.152355 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3b28b7ce-07bf-4c2b-b1b0-096622023722 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:17.153744 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3b28b7ce-07bf-4c2b-b1b0-096622023722 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:17.160506 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3b28b7ce-07bf-4c2b-b1b0-096622023722 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:17.160948 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3b28b7ce-07bf-4c2b-b1b0-096622023722 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:17.161733 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3b28b7ce-07bf-4c2b-b1b0-096622023722 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:17.162170 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3b28b7ce-07bf-4c2b-b1b0-096622023722 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:17.304205 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3b28b7ce-07bf-4c2b-b1b0-096622023722 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:17.313012 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3b28b7ce-07bf-4c2b-b1b0-096622023722 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.164392 Jan 11 15:20:17.313577 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 592/1205] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:17 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:18.147497 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b216da5e-3f58-4405-97ab-e3d7c8522380 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:18.148402 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b216da5e-3f58-4405-97ab-e3d7c8522380 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:18.154513 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b216da5e-3f58-4405-97ab-e3d7c8522380 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:18.154961 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b216da5e-3f58-4405-97ab-e3d7c8522380 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:18.155761 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b216da5e-3f58-4405-97ab-e3d7c8522380 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:18.156194 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b216da5e-3f58-4405-97ab-e3d7c8522380 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:18.185290 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b216da5e-3f58-4405-97ab-e3d7c8522380 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041531 Jan 11 15:20:18.185855 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 614/1206] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:18 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:18.329941 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c8e75173-cac9-48c2-94cb-8b9806551fd3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:18.330537 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c8e75173-cac9-48c2-94cb-8b9806551fd3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:18.336722 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c8e75173-cac9-48c2-94cb-8b9806551fd3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:18.337172 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c8e75173-cac9-48c2-94cb-8b9806551fd3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:18.337956 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c8e75173-cac9-48c2-94cb-8b9806551fd3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:18.338394 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c8e75173-cac9-48c2-94cb-8b9806551fd3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:18.464106 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c8e75173-cac9-48c2-94cb-8b9806551fd3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:18.471942 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c8e75173-cac9-48c2-94cb-8b9806551fd3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.145919 Jan 11 15:20:18.472681 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 593/1207] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:18 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:19.196753 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b6d455af-9454-48d2-93e1-3dc10bafd1b2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:19.197570 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b6d455af-9454-48d2-93e1-3dc10bafd1b2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:19.204539 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b6d455af-9454-48d2-93e1-3dc10bafd1b2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:19.204985 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b6d455af-9454-48d2-93e1-3dc10bafd1b2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:19.205747 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b6d455af-9454-48d2-93e1-3dc10bafd1b2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:19.206183 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b6d455af-9454-48d2-93e1-3dc10bafd1b2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:19.234024 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b6d455af-9454-48d2-93e1-3dc10bafd1b2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041139 Jan 11 15:20:19.234561 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 615/1208] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:19 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:19.489327 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7b254d5d-fdea-4976-81d8-a4a3b6150b0c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:19.489886 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-7b254d5d-fdea-4976-81d8-a4a3b6150b0c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:19.496790 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7b254d5d-fdea-4976-81d8-a4a3b6150b0c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:19.497237 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7b254d5d-fdea-4976-81d8-a4a3b6150b0c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:19.498006 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7b254d5d-fdea-4976-81d8-a4a3b6150b0c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:19.498435 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7b254d5d-fdea-4976-81d8-a4a3b6150b0c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:19.627340 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-7b254d5d-fdea-4976-81d8-a4a3b6150b0c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:19.634474 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7b254d5d-fdea-4976-81d8-a4a3b6150b0c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.149195 Jan 11 15:20:19.635033 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 594/1209] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:19 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:20.245161 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a0e6a392-0cca-4c15-ace0-5f638bf44a13 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:20.246069 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a0e6a392-0cca-4c15-ace0-5f638bf44a13 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:20.252256 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a0e6a392-0cca-4c15-ace0-5f638bf44a13 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:20.252701 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a0e6a392-0cca-4c15-ace0-5f638bf44a13 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:20.253474 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a0e6a392-0cca-4c15-ace0-5f638bf44a13 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:20.253914 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a0e6a392-0cca-4c15-ace0-5f638bf44a13 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:20.283965 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a0e6a392-0cca-4c15-ace0-5f638bf44a13 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042485 Jan 11 15:20:20.284512 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 616/1210] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:20 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:20.650844 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c3cdee28-233c-4a0c-8251-91341fc5a71b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:20.651483 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c3cdee28-233c-4a0c-8251-91341fc5a71b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:20.658377 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c3cdee28-233c-4a0c-8251-91341fc5a71b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:20.658827 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c3cdee28-233c-4a0c-8251-91341fc5a71b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:20.659646 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c3cdee28-233c-4a0c-8251-91341fc5a71b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:20.660091 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c3cdee28-233c-4a0c-8251-91341fc5a71b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:20.789276 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c3cdee28-233c-4a0c-8251-91341fc5a71b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:20.796845 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c3cdee28-233c-4a0c-8251-91341fc5a71b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.149612 Jan 11 15:20:20.797408 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 595/1211] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:20 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:21.295187 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2824b06d-faae-4352-a6a6-e21443eddda2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:21.296120 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2824b06d-faae-4352-a6a6-e21443eddda2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:21.302798 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2824b06d-faae-4352-a6a6-e21443eddda2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:21.303244 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2824b06d-faae-4352-a6a6-e21443eddda2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:21.304044 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2824b06d-faae-4352-a6a6-e21443eddda2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:21.304474 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2824b06d-faae-4352-a6a6-e21443eddda2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:21.333156 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2824b06d-faae-4352-a6a6-e21443eddda2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041682 Jan 11 15:20:21.333698 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 617/1212] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:21 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:21.814227 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b68ce099-585c-4bd1-a691-4291d57c109f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:21.814832 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b68ce099-585c-4bd1-a691-4291d57c109f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:21.821145 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b68ce099-585c-4bd1-a691-4291d57c109f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:21.821600 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b68ce099-585c-4bd1-a691-4291d57c109f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:21.822378 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b68ce099-585c-4bd1-a691-4291d57c109f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:21.822824 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b68ce099-585c-4bd1-a691-4291d57c109f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:21.948847 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b68ce099-585c-4bd1-a691-4291d57c109f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:21.956420 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b68ce099-585c-4bd1-a691-4291d57c109f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.146493 Jan 11 15:20:21.956985 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 596/1213] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:21 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:22.345074 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-110f0fe8-d573-4b88-a266-6e69fd99d428 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:22.346024 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-110f0fe8-d573-4b88-a266-6e69fd99d428 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:22.352458 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-110f0fe8-d573-4b88-a266-6e69fd99d428 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:22.352912 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-110f0fe8-d573-4b88-a266-6e69fd99d428 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:22.353837 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-110f0fe8-d573-4b88-a266-6e69fd99d428 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:22.354277 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-110f0fe8-d573-4b88-a266-6e69fd99d428 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:22.382510 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-110f0fe8-d573-4b88-a266-6e69fd99d428 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041662 Jan 11 15:20:22.383045 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 618/1214] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:22 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:22.972296 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6a76b9c3-ef79-4dad-b95d-2ad5c989b51e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:22.972939 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6a76b9c3-ef79-4dad-b95d-2ad5c989b51e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:22.979350 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6a76b9c3-ef79-4dad-b95d-2ad5c989b51e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:22.979807 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6a76b9c3-ef79-4dad-b95d-2ad5c989b51e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:22.980582 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6a76b9c3-ef79-4dad-b95d-2ad5c989b51e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:22.981022 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6a76b9c3-ef79-4dad-b95d-2ad5c989b51e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:23.109725 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6a76b9c3-ef79-4dad-b95d-2ad5c989b51e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:23.116996 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6a76b9c3-ef79-4dad-b95d-2ad5c989b51e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.148471 Jan 11 15:20:23.117540 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 597/1215] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:22 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:23.393264 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e044bf53-3516-452d-950b-8f0c64eb6cbb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:23.394091 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e044bf53-3516-452d-950b-8f0c64eb6cbb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:23.400335 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e044bf53-3516-452d-950b-8f0c64eb6cbb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:23.400789 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e044bf53-3516-452d-950b-8f0c64eb6cbb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:23.401559 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e044bf53-3516-452d-950b-8f0c64eb6cbb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:23.402023 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e044bf53-3516-452d-950b-8f0c64eb6cbb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:23.430037 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e044bf53-3516-452d-950b-8f0c64eb6cbb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040699 Jan 11 15:20:23.430577 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 619/1216] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:23 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:24.133573 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d42cb7d3-dd24-4927-9fa6-48ba53a392c7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:24.134192 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d42cb7d3-dd24-4927-9fa6-48ba53a392c7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:24.140984 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d42cb7d3-dd24-4927-9fa6-48ba53a392c7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:24.141429 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d42cb7d3-dd24-4927-9fa6-48ba53a392c7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:24.142197 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d42cb7d3-dd24-4927-9fa6-48ba53a392c7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:24.142636 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d42cb7d3-dd24-4927-9fa6-48ba53a392c7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:24.268099 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d42cb7d3-dd24-4927-9fa6-48ba53a392c7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:24.275408 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d42cb7d3-dd24-4927-9fa6-48ba53a392c7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.145406 Jan 11 15:20:24.280593 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 598/1217] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:24 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:24.441576 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f2603eb2-b95c-42b3-af89-43ebd3038a61 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:24.442421 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f2603eb2-b95c-42b3-af89-43ebd3038a61 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:24.448675 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f2603eb2-b95c-42b3-af89-43ebd3038a61 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:24.449131 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f2603eb2-b95c-42b3-af89-43ebd3038a61 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:24.449912 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f2603eb2-b95c-42b3-af89-43ebd3038a61 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:24.450954 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f2603eb2-b95c-42b3-af89-43ebd3038a61 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:24.479342 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f2603eb2-b95c-42b3-af89-43ebd3038a61 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041521 Jan 11 15:20:24.479892 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 620/1218] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:24 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:25.296138 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-55f8aa6f-158c-47ee-ac87-e209d3d23817 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:25.296748 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-55f8aa6f-158c-47ee-ac87-e209d3d23817 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:25.303005 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-55f8aa6f-158c-47ee-ac87-e209d3d23817 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:25.303497 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-55f8aa6f-158c-47ee-ac87-e209d3d23817 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:25.304296 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-55f8aa6f-158c-47ee-ac87-e209d3d23817 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:25.304737 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-55f8aa6f-158c-47ee-ac87-e209d3d23817 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:25.434058 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-55f8aa6f-158c-47ee-ac87-e209d3d23817 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:25.441658 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-55f8aa6f-158c-47ee-ac87-e209d3d23817 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.150061 Jan 11 15:20:25.442242 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 599/1219] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:25 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:25.489708 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-fa17fe67-3768-4abe-80e5-5c1217538e85 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:25.490614 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-fa17fe67-3768-4abe-80e5-5c1217538e85 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:25.496686 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fa17fe67-3768-4abe-80e5-5c1217538e85 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:25.497177 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fa17fe67-3768-4abe-80e5-5c1217538e85 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:25.497943 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fa17fe67-3768-4abe-80e5-5c1217538e85 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:25.498375 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fa17fe67-3768-4abe-80e5-5c1217538e85 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:25.526120 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-fa17fe67-3768-4abe-80e5-5c1217538e85 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040019 Jan 11 15:20:25.526580 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 621/1220] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:25 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:20:26.457909 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b9e8c533-b28f-44db-aacd-95ad6f2683a2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:26.458522 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b9e8c533-b28f-44db-aacd-95ad6f2683a2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:26.464775 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b9e8c533-b28f-44db-aacd-95ad6f2683a2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:26.465223 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b9e8c533-b28f-44db-aacd-95ad6f2683a2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:26.466000 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b9e8c533-b28f-44db-aacd-95ad6f2683a2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:26.466436 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b9e8c533-b28f-44db-aacd-95ad6f2683a2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:26.537828 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-6b0fc940-c0b6-4c0d-9d5e-1e49da861ab0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:26.538785 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-6b0fc940-c0b6-4c0d-9d5e-1e49da861ab0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:26.545814 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6b0fc940-c0b6-4c0d-9d5e-1e49da861ab0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:26.546265 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6b0fc940-c0b6-4c0d-9d5e-1e49da861ab0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:26.547036 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6b0fc940-c0b6-4c0d-9d5e-1e49da861ab0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:26.547502 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6b0fc940-c0b6-4c0d-9d5e-1e49da861ab0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:26.576100 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-6b0fc940-c0b6-4c0d-9d5e-1e49da861ab0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042041 Jan 11 15:20:26.576653 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 622/1221] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:26 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:20:26.594438 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b9e8c533-b28f-44db-aacd-95ad6f2683a2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:26.601566 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b9e8c533-b28f-44db-aacd-95ad6f2683a2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.147345 Jan 11 15:20:26.602115 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 600/1222] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:26 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:27.587741 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-73b43764-b94f-432f-8ac7-5e66b49065e1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:27.588559 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-73b43764-b94f-432f-8ac7-5e66b49065e1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:27.594716 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-73b43764-b94f-432f-8ac7-5e66b49065e1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:27.595138 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-73b43764-b94f-432f-8ac7-5e66b49065e1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:27.595942 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-73b43764-b94f-432f-8ac7-5e66b49065e1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:27.596376 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-73b43764-b94f-432f-8ac7-5e66b49065e1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:27.617711 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b60a2117-af00-467f-9693-6de96fb077c6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:27.621064 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b60a2117-af00-467f-9693-6de96fb077c6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:27.625148 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b60a2117-af00-467f-9693-6de96fb077c6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:27.625405 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-73b43764-b94f-432f-8ac7-5e66b49065e1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041442 Jan 11 15:20:27.625600 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b60a2117-af00-467f-9693-6de96fb077c6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:27.625961 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 623/1223] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:27 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:27.626376 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b60a2117-af00-467f-9693-6de96fb077c6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:27.626812 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b60a2117-af00-467f-9693-6de96fb077c6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:27.755347 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b60a2117-af00-467f-9693-6de96fb077c6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:27.763089 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b60a2117-af00-467f-9693-6de96fb077c6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.148380 Jan 11 15:20:27.763687 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 601/1224] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:27 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:20:28.636793 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d5b13a8d-ac7c-4e85-98ed-9e474836caa7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:28.638134 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d5b13a8d-ac7c-4e85-98ed-9e474836caa7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:28.644290 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d5b13a8d-ac7c-4e85-98ed-9e474836caa7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:28.644742 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d5b13a8d-ac7c-4e85-98ed-9e474836caa7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:28.645516 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d5b13a8d-ac7c-4e85-98ed-9e474836caa7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:28.645951 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d5b13a8d-ac7c-4e85-98ed-9e474836caa7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:28.674100 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d5b13a8d-ac7c-4e85-98ed-9e474836caa7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041195 Jan 11 15:20:28.675336 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 624/1225] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:28 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:28.780218 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ceb02a14-c719-4e9b-bf94-86990be66d7b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:28.780861 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ceb02a14-c719-4e9b-bf94-86990be66d7b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:28.787149 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ceb02a14-c719-4e9b-bf94-86990be66d7b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:28.787641 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ceb02a14-c719-4e9b-bf94-86990be66d7b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:28.788560 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ceb02a14-c719-4e9b-bf94-86990be66d7b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:28.789010 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ceb02a14-c719-4e9b-bf94-86990be66d7b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:28.914788 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ceb02a14-c719-4e9b-bf94-86990be66d7b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:28.922137 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ceb02a14-c719-4e9b-bf94-86990be66d7b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.146134 Jan 11 15:20:28.922712 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 602/1226] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:28 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:29.686143 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b82baa1e-1900-4da0-99ba-2a71e1e8a5eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:29.687049 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b82baa1e-1900-4da0-99ba-2a71e1e8a5eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:29.693231 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b82baa1e-1900-4da0-99ba-2a71e1e8a5eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:29.693682 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b82baa1e-1900-4da0-99ba-2a71e1e8a5eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:29.694451 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b82baa1e-1900-4da0-99ba-2a71e1e8a5eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:29.694891 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b82baa1e-1900-4da0-99ba-2a71e1e8a5eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:29.722970 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b82baa1e-1900-4da0-99ba-2a71e1e8a5eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041214 Jan 11 15:20:29.723670 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 625/1227] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:29 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:29.939093 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f1c10381-41a3-4438-9bab-b98e98ba7171 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:29.939700 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f1c10381-41a3-4438-9bab-b98e98ba7171 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:29.945907 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f1c10381-41a3-4438-9bab-b98e98ba7171 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:29.946360 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f1c10381-41a3-4438-9bab-b98e98ba7171 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:29.947137 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f1c10381-41a3-4438-9bab-b98e98ba7171 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:29.947611 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f1c10381-41a3-4438-9bab-b98e98ba7171 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:30.071916 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f1c10381-41a3-4438-9bab-b98e98ba7171 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:30.080122 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f1c10381-41a3-4438-9bab-b98e98ba7171 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.144980 Jan 11 15:20:30.080688 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 603/1228] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:29 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:30.733662 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-9f134123-eaf0-48ef-84ff-20078c5f42c6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:30.734521 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-9f134123-eaf0-48ef-84ff-20078c5f42c6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:30.740749 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9f134123-eaf0-48ef-84ff-20078c5f42c6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:30.741205 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9f134123-eaf0-48ef-84ff-20078c5f42c6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:30.741977 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9f134123-eaf0-48ef-84ff-20078c5f42c6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:30.742419 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9f134123-eaf0-48ef-84ff-20078c5f42c6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:30.771062 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-9f134123-eaf0-48ef-84ff-20078c5f42c6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041277 Jan 11 15:20:30.772286 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 626/1229] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:30 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:31.096696 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f2c23aa8-34ab-4eb5-b53b-319b6d95cb3d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:31.097335 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f2c23aa8-34ab-4eb5-b53b-319b6d95cb3d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:31.103520 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f2c23aa8-34ab-4eb5-b53b-319b6d95cb3d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:31.103965 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f2c23aa8-34ab-4eb5-b53b-319b6d95cb3d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:31.104767 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f2c23aa8-34ab-4eb5-b53b-319b6d95cb3d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:31.105204 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f2c23aa8-34ab-4eb5-b53b-319b6d95cb3d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:31.236297 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f2c23aa8-34ab-4eb5-b53b-319b6d95cb3d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:31.243804 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f2c23aa8-34ab-4eb5-b53b-319b6d95cb3d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.150854 Jan 11 15:20:31.244362 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 604/1230] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:31 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:31.783441 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e4e4f7a5-8d98-4e17-b99b-d84a371c4e14 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:31.784354 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e4e4f7a5-8d98-4e17-b99b-d84a371c4e14 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:31.790581 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e4e4f7a5-8d98-4e17-b99b-d84a371c4e14 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:31.791040 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e4e4f7a5-8d98-4e17-b99b-d84a371c4e14 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:31.791856 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e4e4f7a5-8d98-4e17-b99b-d84a371c4e14 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:31.792296 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e4e4f7a5-8d98-4e17-b99b-d84a371c4e14 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:31.823268 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e4e4f7a5-8d98-4e17-b99b-d84a371c4e14 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043525 Jan 11 15:20:31.823847 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 627/1231] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:31 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:32.261797 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b6e399e7-3394-456a-a646-b821761b5510 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:32.263042 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b6e399e7-3394-456a-a646-b821761b5510 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:32.269507 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b6e399e7-3394-456a-a646-b821761b5510 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:32.269957 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b6e399e7-3394-456a-a646-b821761b5510 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:32.270728 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b6e399e7-3394-456a-a646-b821761b5510 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:32.271162 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b6e399e7-3394-456a-a646-b821761b5510 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:32.397170 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b6e399e7-3394-456a-a646-b821761b5510 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:32.404423 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b6e399e7-3394-456a-a646-b821761b5510 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.146363 Jan 11 15:20:32.404976 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 605/1232] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:32 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:32.834743 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-1ce761ee-fad9-4fae-a316-e37fe5431719 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:32.835687 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-1ce761ee-fad9-4fae-a316-e37fe5431719 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:32.841946 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1ce761ee-fad9-4fae-a316-e37fe5431719 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:32.842398 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1ce761ee-fad9-4fae-a316-e37fe5431719 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:32.843167 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1ce761ee-fad9-4fae-a316-e37fe5431719 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:32.843636 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1ce761ee-fad9-4fae-a316-e37fe5431719 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:32.872410 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-1ce761ee-fad9-4fae-a316-e37fe5431719 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040885 Jan 11 15:20:32.872973 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 628/1233] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:32 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:33.420873 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-473e7738-bc47-4522-8a0a-4e4152495932 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:33.421477 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-473e7738-bc47-4522-8a0a-4e4152495932 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:33.427668 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-473e7738-bc47-4522-8a0a-4e4152495932 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:33.428114 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-473e7738-bc47-4522-8a0a-4e4152495932 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:33.428879 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-473e7738-bc47-4522-8a0a-4e4152495932 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:33.429316 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-473e7738-bc47-4522-8a0a-4e4152495932 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:33.558779 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-473e7738-bc47-4522-8a0a-4e4152495932 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:33.566507 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-473e7738-bc47-4522-8a0a-4e4152495932 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.149335 Jan 11 15:20:33.567068 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 606/1234] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:33 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:33.885487 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-82013e80-c74b-4116-8782-9b5a94e3982d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:33.886313 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-82013e80-c74b-4116-8782-9b5a94e3982d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:33.892520 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-82013e80-c74b-4116-8782-9b5a94e3982d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:33.892964 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-82013e80-c74b-4116-8782-9b5a94e3982d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:33.893730 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-82013e80-c74b-4116-8782-9b5a94e3982d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:33.894161 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-82013e80-c74b-4116-8782-9b5a94e3982d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:33.922103 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-82013e80-c74b-4116-8782-9b5a94e3982d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040405 Jan 11 15:20:33.922633 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 629/1235] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:33 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:34.583013 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f05c5594-ac41-485d-b794-04b586bd76c3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:34.583586 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f05c5594-ac41-485d-b794-04b586bd76c3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:34.589768 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f05c5594-ac41-485d-b794-04b586bd76c3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:34.590217 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f05c5594-ac41-485d-b794-04b586bd76c3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:34.591585 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f05c5594-ac41-485d-b794-04b586bd76c3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:34.592022 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f05c5594-ac41-485d-b794-04b586bd76c3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:34.717360 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f05c5594-ac41-485d-b794-04b586bd76c3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:34.724599 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f05c5594-ac41-485d-b794-04b586bd76c3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.145318 Jan 11 15:20:34.725154 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 607/1236] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:34 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:34.932777 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-141f051e-1ef5-4154-9232-773b47430e84 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:34.933614 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-141f051e-1ef5-4154-9232-773b47430e84 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:34.940562 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-141f051e-1ef5-4154-9232-773b47430e84 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:34.941017 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-141f051e-1ef5-4154-9232-773b47430e84 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:34.941804 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-141f051e-1ef5-4154-9232-773b47430e84 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:34.942244 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-141f051e-1ef5-4154-9232-773b47430e84 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:34.971266 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-141f051e-1ef5-4154-9232-773b47430e84 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042341 Jan 11 15:20:34.971832 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 630/1237] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:34 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:35.741233 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-83b2fdbc-bb40-4576-ba89-9397be0fd8fa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:35.741788 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-83b2fdbc-bb40-4576-ba89-9397be0fd8fa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:35.748620 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-83b2fdbc-bb40-4576-ba89-9397be0fd8fa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:35.749069 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-83b2fdbc-bb40-4576-ba89-9397be0fd8fa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:35.749844 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-83b2fdbc-bb40-4576-ba89-9397be0fd8fa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:35.750282 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-83b2fdbc-bb40-4576-ba89-9397be0fd8fa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:35.873741 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-83b2fdbc-bb40-4576-ba89-9397be0fd8fa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:35.881042 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-83b2fdbc-bb40-4576-ba89-9397be0fd8fa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.143556 Jan 11 15:20:35.881610 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 608/1238] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:35 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:35.982705 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-de857df5-0e96-4afb-a562-01a3027db81c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:35.983644 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-de857df5-0e96-4afb-a562-01a3027db81c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:35.990020 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-de857df5-0e96-4afb-a562-01a3027db81c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:35.990478 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-de857df5-0e96-4afb-a562-01a3027db81c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:35.991342 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-de857df5-0e96-4afb-a562-01a3027db81c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:35.991733 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-de857df5-0e96-4afb-a562-01a3027db81c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:36.020738 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-de857df5-0e96-4afb-a562-01a3027db81c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041638 Jan 11 15:20:36.021281 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 631/1239] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:35 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:36.897777 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-bd9b270f-f22a-4112-93ca-6bbfb422c604 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:36.898387 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-bd9b270f-f22a-4112-93ca-6bbfb422c604 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:36.904616 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bd9b270f-f22a-4112-93ca-6bbfb422c604 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:36.905066 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bd9b270f-f22a-4112-93ca-6bbfb422c604 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:36.905844 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bd9b270f-f22a-4112-93ca-6bbfb422c604 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:36.906282 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bd9b270f-f22a-4112-93ca-6bbfb422c604 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:37.032347 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-62f91ac1-f50a-4674-82a3-39013e39998d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:37.033263 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-62f91ac1-f50a-4674-82a3-39013e39998d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:37.034323 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-bd9b270f-f22a-4112-93ca-6bbfb422c604 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:37.039454 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-62f91ac1-f50a-4674-82a3-39013e39998d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:37.039903 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-62f91ac1-f50a-4674-82a3-39013e39998d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:37.040677 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-62f91ac1-f50a-4674-82a3-39013e39998d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:37.041275 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-62f91ac1-f50a-4674-82a3-39013e39998d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:37.041664 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-bd9b270f-f22a-4112-93ca-6bbfb422c604 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.147622 Jan 11 15:20:37.042254 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 609/1240] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:36 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:37.070299 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-62f91ac1-f50a-4674-82a3-39013e39998d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041718 Jan 11 15:20:37.070799 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 632/1241] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:37 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:20:38.058579 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f5322143-6863-465c-9e5d-d2bed4519230 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:38.059179 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f5322143-6863-465c-9e5d-d2bed4519230 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:38.065382 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f5322143-6863-465c-9e5d-d2bed4519230 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:38.065840 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f5322143-6863-465c-9e5d-d2bed4519230 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:38.066652 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f5322143-6863-465c-9e5d-d2bed4519230 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:38.067114 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f5322143-6863-465c-9e5d-d2bed4519230 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:38.081537 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-26b33df8-a7dc-427e-9ffd-39ca8bc549ba tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:38.082500 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-26b33df8-a7dc-427e-9ffd-39ca8bc549ba tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:38.088670 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-26b33df8-a7dc-427e-9ffd-39ca8bc549ba tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:38.089125 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-26b33df8-a7dc-427e-9ffd-39ca8bc549ba tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:38.089902 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-26b33df8-a7dc-427e-9ffd-39ca8bc549ba tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:38.090912 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-26b33df8-a7dc-427e-9ffd-39ca8bc549ba tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:38.119612 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-26b33df8-a7dc-427e-9ffd-39ca8bc549ba tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041653 Jan 11 15:20:38.120164 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 633/1242] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:38 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:20:38.193646 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f5322143-6863-465c-9e5d-d2bed4519230 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:38.200876 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f5322143-6863-465c-9e5d-d2bed4519230 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.145919 Jan 11 15:20:38.201437 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 610/1243] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:38 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:39.130971 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-015bb677-0762-459a-8684-4b409d1ce80a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:39.131822 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-015bb677-0762-459a-8684-4b409d1ce80a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:39.138013 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-015bb677-0762-459a-8684-4b409d1ce80a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:39.138461 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-015bb677-0762-459a-8684-4b409d1ce80a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:39.139233 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-015bb677-0762-459a-8684-4b409d1ce80a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:39.139698 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-015bb677-0762-459a-8684-4b409d1ce80a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:39.167504 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-015bb677-0762-459a-8684-4b409d1ce80a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040375 Jan 11 15:20:39.168050 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 634/1244] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:39 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:39.217458 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-fb554393-68ef-4481-a97f-f73eeb101fd8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:39.218087 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-fb554393-68ef-4481-a97f-f73eeb101fd8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:39.224252 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fb554393-68ef-4481-a97f-f73eeb101fd8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:39.224698 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fb554393-68ef-4481-a97f-f73eeb101fd8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:39.225463 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fb554393-68ef-4481-a97f-f73eeb101fd8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:39.225896 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fb554393-68ef-4481-a97f-f73eeb101fd8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:39.357356 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-fb554393-68ef-4481-a97f-f73eeb101fd8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:39.364607 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-fb554393-68ef-4481-a97f-f73eeb101fd8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.150755 Jan 11 15:20:39.365192 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 611/1245] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:39 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:40.179219 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c583f2fe-34d7-467b-89b5-a6359f3bb2ba tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:40.180149 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c583f2fe-34d7-467b-89b5-a6359f3bb2ba tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:40.187028 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c583f2fe-34d7-467b-89b5-a6359f3bb2ba tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:40.187511 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c583f2fe-34d7-467b-89b5-a6359f3bb2ba tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:40.188281 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c583f2fe-34d7-467b-89b5-a6359f3bb2ba tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:40.188716 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c583f2fe-34d7-467b-89b5-a6359f3bb2ba tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:40.216653 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c583f2fe-34d7-467b-89b5-a6359f3bb2ba tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041213 Jan 11 15:20:40.217182 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 635/1246] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:40 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:40.381679 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4e314737-83a3-4cad-8bb4-c545148cb0db tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:40.382296 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-4e314737-83a3-4cad-8bb4-c545148cb0db tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:40.388547 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4e314737-83a3-4cad-8bb4-c545148cb0db tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:40.389000 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4e314737-83a3-4cad-8bb4-c545148cb0db tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:40.389777 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4e314737-83a3-4cad-8bb4-c545148cb0db tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:40.390214 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4e314737-83a3-4cad-8bb4-c545148cb0db tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:40.515482 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-4e314737-83a3-4cad-8bb4-c545148cb0db tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:40.522983 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4e314737-83a3-4cad-8bb4-c545148cb0db tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.144932 Jan 11 15:20:40.523583 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 612/1247] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:40 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:41.227752 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-36044bee-be25-4789-ad37-9dbc4f67b320 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:41.228611 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-36044bee-be25-4789-ad37-9dbc4f67b320 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:41.235561 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-36044bee-be25-4789-ad37-9dbc4f67b320 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:41.236012 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-36044bee-be25-4789-ad37-9dbc4f67b320 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:41.236787 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-36044bee-be25-4789-ad37-9dbc4f67b320 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:41.237223 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-36044bee-be25-4789-ad37-9dbc4f67b320 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:41.265461 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-36044bee-be25-4789-ad37-9dbc4f67b320 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041452 Jan 11 15:20:41.266010 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 636/1248] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:41 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:41.540195 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-09267cca-f67c-4abe-81de-58ea43910596 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:41.540803 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-09267cca-f67c-4abe-81de-58ea43910596 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:41.547008 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-09267cca-f67c-4abe-81de-58ea43910596 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:41.547488 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-09267cca-f67c-4abe-81de-58ea43910596 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:41.548250 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-09267cca-f67c-4abe-81de-58ea43910596 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:41.548698 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-09267cca-f67c-4abe-81de-58ea43910596 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:41.675803 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-09267cca-f67c-4abe-81de-58ea43910596 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:41.683041 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-09267cca-f67c-4abe-81de-58ea43910596 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.146480 Jan 11 15:20:41.683636 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 613/1249] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:41 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:42.276941 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-20d4c3e4-57d3-4f29-b2dc-dd9d7955fb02 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:42.277852 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-20d4c3e4-57d3-4f29-b2dc-dd9d7955fb02 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:42.284020 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-20d4c3e4-57d3-4f29-b2dc-dd9d7955fb02 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:42.286748 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-20d4c3e4-57d3-4f29-b2dc-dd9d7955fb02 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:42.286748 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-20d4c3e4-57d3-4f29-b2dc-dd9d7955fb02 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:42.286748 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-20d4c3e4-57d3-4f29-b2dc-dd9d7955fb02 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:42.314098 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-20d4c3e4-57d3-4f29-b2dc-dd9d7955fb02 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040984 Jan 11 15:20:42.314644 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 637/1250] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:42 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:42.700771 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-fef66d1e-a2f4-4711-b6f0-39321f82d942 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:42.701316 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-fef66d1e-a2f4-4711-b6f0-39321f82d942 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:42.707759 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fef66d1e-a2f4-4711-b6f0-39321f82d942 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:42.708211 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fef66d1e-a2f4-4711-b6f0-39321f82d942 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:42.708989 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fef66d1e-a2f4-4711-b6f0-39321f82d942 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:42.709425 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fef66d1e-a2f4-4711-b6f0-39321f82d942 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:42.833828 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-fef66d1e-a2f4-4711-b6f0-39321f82d942 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:42.841530 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-fef66d1e-a2f4-4711-b6f0-39321f82d942 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.145037 Jan 11 15:20:42.842086 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 614/1251] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:42 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:20:43.325306 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2a7d0d3e-8454-4c6e-aa11-ab94e80832da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:43.326210 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2a7d0d3e-8454-4c6e-aa11-ab94e80832da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:43.332618 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2a7d0d3e-8454-4c6e-aa11-ab94e80832da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:43.333063 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2a7d0d3e-8454-4c6e-aa11-ab94e80832da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:43.333827 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2a7d0d3e-8454-4c6e-aa11-ab94e80832da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:43.334259 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2a7d0d3e-8454-4c6e-aa11-ab94e80832da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:43.363934 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2a7d0d3e-8454-4c6e-aa11-ab94e80832da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042331 Jan 11 15:20:43.364479 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 638/1252] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:43 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:43.857770 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0895cc4a-f7e1-4f42-9c46-27ce94f5edda tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:43.858379 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0895cc4a-f7e1-4f42-9c46-27ce94f5edda tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:43.864665 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0895cc4a-f7e1-4f42-9c46-27ce94f5edda tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:43.865115 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0895cc4a-f7e1-4f42-9c46-27ce94f5edda tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:43.865889 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0895cc4a-f7e1-4f42-9c46-27ce94f5edda tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:43.866326 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0895cc4a-f7e1-4f42-9c46-27ce94f5edda tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:43.991428 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0895cc4a-f7e1-4f42-9c46-27ce94f5edda tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:43.999177 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0895cc4a-f7e1-4f42-9c46-27ce94f5edda tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.145136 Jan 11 15:20:43.999767 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 615/1253] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:43 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:44.375853 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-83bb09eb-49e5-4c0d-aced-bd1818819ce9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:44.376797 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-83bb09eb-49e5-4c0d-aced-bd1818819ce9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:44.383016 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-83bb09eb-49e5-4c0d-aced-bd1818819ce9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:44.383505 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-83bb09eb-49e5-4c0d-aced-bd1818819ce9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:44.384288 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-83bb09eb-49e5-4c0d-aced-bd1818819ce9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:44.384741 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-83bb09eb-49e5-4c0d-aced-bd1818819ce9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:44.412284 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-83bb09eb-49e5-4c0d-aced-bd1818819ce9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040836 Jan 11 15:20:44.412823 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 639/1254] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:44 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:45.016210 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-33f69fa2-97c9-40b3-829d-8966463f02f2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:45.016803 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-33f69fa2-97c9-40b3-829d-8966463f02f2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:45.023130 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-33f69fa2-97c9-40b3-829d-8966463f02f2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:45.023590 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-33f69fa2-97c9-40b3-829d-8966463f02f2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:45.024373 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-33f69fa2-97c9-40b3-829d-8966463f02f2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:45.024814 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-33f69fa2-97c9-40b3-829d-8966463f02f2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:45.155270 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-33f69fa2-97c9-40b3-829d-8966463f02f2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:45.162510 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-33f69fa2-97c9-40b3-829d-8966463f02f2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.150480 Jan 11 15:20:45.163074 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 616/1255] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:45 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:45.423711 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-accee1f1-cea2-4af0-b3d8-7f53bdc28727 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:45.424561 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-accee1f1-cea2-4af0-b3d8-7f53bdc28727 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:45.430659 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-accee1f1-cea2-4af0-b3d8-7f53bdc28727 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:45.431112 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-accee1f1-cea2-4af0-b3d8-7f53bdc28727 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:45.431929 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-accee1f1-cea2-4af0-b3d8-7f53bdc28727 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:45.432374 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-accee1f1-cea2-4af0-b3d8-7f53bdc28727 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:45.461890 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-accee1f1-cea2-4af0-b3d8-7f53bdc28727 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042163 Jan 11 15:20:45.462440 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 640/1256] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:45 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:46.178889 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7cafd9e5-2f87-4e0c-ba26-4985b60bde5c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:46.179512 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-7cafd9e5-2f87-4e0c-ba26-4985b60bde5c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:46.189170 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7cafd9e5-2f87-4e0c-ba26-4985b60bde5c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:46.189170 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7cafd9e5-2f87-4e0c-ba26-4985b60bde5c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:46.189170 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7cafd9e5-2f87-4e0c-ba26-4985b60bde5c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:46.189170 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7cafd9e5-2f87-4e0c-ba26-4985b60bde5c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:46.319532 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-7cafd9e5-2f87-4e0c-ba26-4985b60bde5c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:46.327345 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7cafd9e5-2f87-4e0c-ba26-4985b60bde5c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.151717 Jan 11 15:20:46.327912 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 617/1257] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:46 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:46.472932 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-86ddf842-21f5-461b-9c24-e8ca76cc3d34 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:46.473848 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-86ddf842-21f5-461b-9c24-e8ca76cc3d34 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:46.480154 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-86ddf842-21f5-461b-9c24-e8ca76cc3d34 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:46.481268 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-86ddf842-21f5-461b-9c24-e8ca76cc3d34 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:46.482061 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-86ddf842-21f5-461b-9c24-e8ca76cc3d34 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:46.482507 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-86ddf842-21f5-461b-9c24-e8ca76cc3d34 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:46.510644 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-86ddf842-21f5-461b-9c24-e8ca76cc3d34 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041338 Jan 11 15:20:46.511199 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 641/1258] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:20:46 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:20:47.343938 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-006fb5f0-b08f-4d49-910e-b37eb8bf994e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:47.344547 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-006fb5f0-b08f-4d49-910e-b37eb8bf994e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:47.350776 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-006fb5f0-b08f-4d49-910e-b37eb8bf994e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:47.351227 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-006fb5f0-b08f-4d49-910e-b37eb8bf994e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:47.352040 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-006fb5f0-b08f-4d49-910e-b37eb8bf994e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:47.352481 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-006fb5f0-b08f-4d49-910e-b37eb8bf994e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:47.482381 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-006fb5f0-b08f-4d49-910e-b37eb8bf994e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:47.489621 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-006fb5f0-b08f-4d49-910e-b37eb8bf994e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.149326 Jan 11 15:20:47.490187 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 618/1259] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:47 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:47.521693 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-605751d7-a744-4f07-9528-5cf70261ae03 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:20:47.522539 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-605751d7-a744-4f07-9528-5cf70261ae03 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:47.528821 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-605751d7-a744-4f07-9528-5cf70261ae03 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:47.529268 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-605751d7-a744-4f07-9528-5cf70261ae03 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:47.530030 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-605751d7-a744-4f07-9528-5cf70261ae03 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:47.530463 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-605751d7-a744-4f07-9528-5cf70261ae03 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:47.612845 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-605751d7-a744-4f07-9528-5cf70261ae03 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "POST /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/action" status: 200 len: 89072 microversion: 2.1 time: 0.094658 Jan 11 15:20:47.613515 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 642/1260] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:20:47 2022] POST /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c/action => generated 89072 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:20:48.506725 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1147d723-cb74-41ae-9e46-fc191c7575df tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:48.507372 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1147d723-cb74-41ae-9e46-fc191c7575df tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:48.514264 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1147d723-cb74-41ae-9e46-fc191c7575df tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:48.514716 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1147d723-cb74-41ae-9e46-fc191c7575df tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:48.515529 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1147d723-cb74-41ae-9e46-fc191c7575df tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:48.515974 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1147d723-cb74-41ae-9e46-fc191c7575df tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:48.641564 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1147d723-cb74-41ae-9e46-fc191c7575df tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:48.648792 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1147d723-cb74-41ae-9e46-fc191c7575df tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.145720 Jan 11 15:20:48.649358 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 619/1261] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:48 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:49.666546 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-0da07377-7f94-4f31-b9d4-2d3e6e011a07 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:49.667166 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-0da07377-7f94-4f31-b9d4-2d3e6e011a07 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:49.674129 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0da07377-7f94-4f31-b9d4-2d3e6e011a07 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:49.674583 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0da07377-7f94-4f31-b9d4-2d3e6e011a07 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:49.675387 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0da07377-7f94-4f31-b9d4-2d3e6e011a07 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:49.675835 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0da07377-7f94-4f31-b9d4-2d3e6e011a07 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:49.863924 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-0da07377-7f94-4f31-b9d4-2d3e6e011a07 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:49.871102 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-0da07377-7f94-4f31-b9d4-2d3e6e011a07 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.208663 Jan 11 15:20:49.871689 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 643/1262] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:49 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:50.887452 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-db07270d-0b02-40a7-acec-072ddbb75d72 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:50.888059 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-db07270d-0b02-40a7-acec-072ddbb75d72 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:50.894523 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-db07270d-0b02-40a7-acec-072ddbb75d72 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:50.894974 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-db07270d-0b02-40a7-acec-072ddbb75d72 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:50.895843 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-db07270d-0b02-40a7-acec-072ddbb75d72 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:50.896283 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-db07270d-0b02-40a7-acec-072ddbb75d72 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:51.025224 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-db07270d-0b02-40a7-acec-072ddbb75d72 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:51.032921 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-db07270d-0b02-40a7-acec-072ddbb75d72 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.149118 Jan 11 15:20:51.033476 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 620/1263] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:50 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:52.048754 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-900b8190-70fe-46ce-a015-5d162562aa78 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:52.049368 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-900b8190-70fe-46ce-a015-5d162562aa78 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:52.055633 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-900b8190-70fe-46ce-a015-5d162562aa78 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:52.056098 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-900b8190-70fe-46ce-a015-5d162562aa78 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:52.056874 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-900b8190-70fe-46ce-a015-5d162562aa78 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:52.057315 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-900b8190-70fe-46ce-a015-5d162562aa78 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:52.181983 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-900b8190-70fe-46ce-a015-5d162562aa78 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:52.189702 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-900b8190-70fe-46ce-a015-5d162562aa78 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.144650 Jan 11 15:20:52.190264 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 644/1264] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:52 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:53.206453 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6f9dc2df-5f33-434f-aa1e-54460b05cdee tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:53.213272 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6f9dc2df-5f33-434f-aa1e-54460b05cdee tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:53.213272 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6f9dc2df-5f33-434f-aa1e-54460b05cdee tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:53.213508 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6f9dc2df-5f33-434f-aa1e-54460b05cdee tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:53.214175 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6f9dc2df-5f33-434f-aa1e-54460b05cdee tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:53.214609 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6f9dc2df-5f33-434f-aa1e-54460b05cdee tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:53.346926 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6f9dc2df-5f33-434f-aa1e-54460b05cdee tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:53.354327 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6f9dc2df-5f33-434f-aa1e-54460b05cdee tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.151538 Jan 11 15:20:53.354888 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 621/1265] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:53 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:54.371602 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-6054600b-681f-431e-98b0-dfc5b58d9963 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:54.372224 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-6054600b-681f-431e-98b0-dfc5b58d9963 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:54.378466 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6054600b-681f-431e-98b0-dfc5b58d9963 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:54.378920 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6054600b-681f-431e-98b0-dfc5b58d9963 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:54.379749 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6054600b-681f-431e-98b0-dfc5b58d9963 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:54.380196 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6054600b-681f-431e-98b0-dfc5b58d9963 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:54.506461 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-6054600b-681f-431e-98b0-dfc5b58d9963 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:54.513967 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-6054600b-681f-431e-98b0-dfc5b58d9963 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.146646 Jan 11 15:20:54.514477 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 645/1266] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:54 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:55.530947 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-27dc9b9b-3274-46a4-a7c9-d5fc9b6b6c65 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:55.531533 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-27dc9b9b-3274-46a4-a7c9-d5fc9b6b6c65 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:55.537648 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-27dc9b9b-3274-46a4-a7c9-d5fc9b6b6c65 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:55.538092 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-27dc9b9b-3274-46a4-a7c9-d5fc9b6b6c65 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:55.538859 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-27dc9b9b-3274-46a4-a7c9-d5fc9b6b6c65 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:55.539313 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-27dc9b9b-3274-46a4-a7c9-d5fc9b6b6c65 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:55.666585 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-27dc9b9b-3274-46a4-a7c9-d5fc9b6b6c65 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:55.673946 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-27dc9b9b-3274-46a4-a7c9-d5fc9b6b6c65 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.147242 Jan 11 15:20:55.674504 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 622/1267] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:55 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:56.690322 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-9f993f6d-50cd-4624-a353-757a313c2a57 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:56.690867 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-9f993f6d-50cd-4624-a353-757a313c2a57 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:56.697296 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9f993f6d-50cd-4624-a353-757a313c2a57 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:56.697747 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9f993f6d-50cd-4624-a353-757a313c2a57 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:56.698524 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9f993f6d-50cd-4624-a353-757a313c2a57 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:56.698964 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9f993f6d-50cd-4624-a353-757a313c2a57 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:56.823374 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-9f993f6d-50cd-4624-a353-757a313c2a57 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:56.830940 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-9f993f6d-50cd-4624-a353-757a313c2a57 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.144354 Jan 11 15:20:56.831502 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 646/1268] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:56 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:57.847903 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e1ad5f50-8f71-4b03-917a-91d24e551243 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:57.848497 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e1ad5f50-8f71-4b03-917a-91d24e551243 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:57.854639 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e1ad5f50-8f71-4b03-917a-91d24e551243 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:57.855760 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e1ad5f50-8f71-4b03-917a-91d24e551243 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:57.857104 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e1ad5f50-8f71-4b03-917a-91d24e551243 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:57.857563 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e1ad5f50-8f71-4b03-917a-91d24e551243 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:57.982758 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e1ad5f50-8f71-4b03-917a-91d24e551243 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:57.989948 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e1ad5f50-8f71-4b03-917a-91d24e551243 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.145663 Jan 11 15:20:57.990504 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 623/1269] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:57 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:20:59.006888 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ff027f3e-02f4-41c2-990d-2470deee3d9d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:20:59.007521 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-ff027f3e-02f4-41c2-990d-2470deee3d9d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:20:59.014317 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ff027f3e-02f4-41c2-990d-2470deee3d9d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:59.014761 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ff027f3e-02f4-41c2-990d-2470deee3d9d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:59.015561 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ff027f3e-02f4-41c2-990d-2470deee3d9d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:20:59.016000 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ff027f3e-02f4-41c2-990d-2470deee3d9d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:20:59.146710 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-ff027f3e-02f4-41c2-990d-2470deee3d9d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:20:59.153913 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-ff027f3e-02f4-41c2-990d-2470deee3d9d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.150649 Jan 11 15:20:59.154464 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 647/1270] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:20:59 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:00.170267 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-67f97761-0801-4d65-898a-cf9e42406283 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:00.170861 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-67f97761-0801-4d65-898a-cf9e42406283 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:00.177036 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-67f97761-0801-4d65-898a-cf9e42406283 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:00.177507 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-67f97761-0801-4d65-898a-cf9e42406283 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:00.178276 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-67f97761-0801-4d65-898a-cf9e42406283 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:00.178708 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-67f97761-0801-4d65-898a-cf9e42406283 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:00.304351 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-67f97761-0801-4d65-898a-cf9e42406283 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:00.311519 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-67f97761-0801-4d65-898a-cf9e42406283 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.144855 Jan 11 15:21:00.312070 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 624/1271] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:00 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:01.328223 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3da745df-88fa-425c-8f87-4e4cf5abb74a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:01.328836 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3da745df-88fa-425c-8f87-4e4cf5abb74a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:01.335515 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3da745df-88fa-425c-8f87-4e4cf5abb74a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:01.335967 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3da745df-88fa-425c-8f87-4e4cf5abb74a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:01.336743 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3da745df-88fa-425c-8f87-4e4cf5abb74a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:01.337182 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3da745df-88fa-425c-8f87-4e4cf5abb74a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:01.472797 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-3da745df-88fa-425c-8f87-4e4cf5abb74a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:01.479940 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3da745df-88fa-425c-8f87-4e4cf5abb74a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.155697 Jan 11 15:21:01.481337 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 648/1272] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:01 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:02.499354 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4837ee28-91c5-4563-9823-a2a8c844ea05 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:02.499965 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-4837ee28-91c5-4563-9823-a2a8c844ea05 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:02.506236 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4837ee28-91c5-4563-9823-a2a8c844ea05 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:02.506683 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4837ee28-91c5-4563-9823-a2a8c844ea05 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:02.507493 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4837ee28-91c5-4563-9823-a2a8c844ea05 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:02.507982 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4837ee28-91c5-4563-9823-a2a8c844ea05 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:02.632813 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-4837ee28-91c5-4563-9823-a2a8c844ea05 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:02.640614 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4837ee28-91c5-4563-9823-a2a8c844ea05 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.145518 Jan 11 15:21:02.641174 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 625/1273] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:02 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:03.657142 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-07389a42-407c-47b5-8de9-44eaef60c0a5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:03.657808 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-07389a42-407c-47b5-8de9-44eaef60c0a5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:03.663922 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-07389a42-407c-47b5-8de9-44eaef60c0a5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:03.664372 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-07389a42-407c-47b5-8de9-44eaef60c0a5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:03.665142 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-07389a42-407c-47b5-8de9-44eaef60c0a5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:03.665576 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-07389a42-407c-47b5-8de9-44eaef60c0a5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:03.845892 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-07389a42-407c-47b5-8de9-44eaef60c0a5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:03.853263 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-07389a42-407c-47b5-8de9-44eaef60c0a5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.199881 Jan 11 15:21:03.853825 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 649/1274] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:03 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:04.870437 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-446a9035-7b20-4f0e-af31-a2d8aed66930 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:04.871051 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-446a9035-7b20-4f0e-af31-a2d8aed66930 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:04.877294 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-446a9035-7b20-4f0e-af31-a2d8aed66930 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:04.877754 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-446a9035-7b20-4f0e-af31-a2d8aed66930 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:04.878530 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-446a9035-7b20-4f0e-af31-a2d8aed66930 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:04.878969 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-446a9035-7b20-4f0e-af31-a2d8aed66930 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:05.006913 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-446a9035-7b20-4f0e-af31-a2d8aed66930 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:05.013129 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-446a9035-7b20-4f0e-af31-a2d8aed66930 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.146340 Jan 11 15:21:05.013695 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 626/1275] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:04 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:05.182279 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:21:05.182494 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: Tue Jan 11 15:21:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:21:05.284787 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:21:05.287200 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: Tue Jan 11 15:21:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:21:06.030128 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3a7e0f49-3a8f-466e-95c7-7866725b48c7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:06.030733 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3a7e0f49-3a8f-466e-95c7-7866725b48c7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:06.037179 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3a7e0f49-3a8f-466e-95c7-7866725b48c7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:06.037625 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3a7e0f49-3a8f-466e-95c7-7866725b48c7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:06.038400 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3a7e0f49-3a8f-466e-95c7-7866725b48c7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:06.038835 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3a7e0f49-3a8f-466e-95c7-7866725b48c7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:06.167609 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-3a7e0f49-3a8f-466e-95c7-7866725b48c7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:06.174774 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3a7e0f49-3a8f-466e-95c7-7866725b48c7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.148839 Jan 11 15:21:06.175447 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 650/1276] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:06 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:07.190872 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9cbdeecd-0d5b-4bbb-babd-357e42dd5b87 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:07.191504 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9cbdeecd-0d5b-4bbb-babd-357e42dd5b87 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:07.197747 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9cbdeecd-0d5b-4bbb-babd-357e42dd5b87 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:07.198194 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9cbdeecd-0d5b-4bbb-babd-357e42dd5b87 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:07.198958 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9cbdeecd-0d5b-4bbb-babd-357e42dd5b87 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:07.199425 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9cbdeecd-0d5b-4bbb-babd-357e42dd5b87 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:07.325615 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-9cbdeecd-0d5b-4bbb-babd-357e42dd5b87 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:07.333156 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9cbdeecd-0d5b-4bbb-babd-357e42dd5b87 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.145869 Jan 11 15:21:07.333715 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 627/1277] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:07 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:08.349672 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-bf55a552-2ccc-4ed5-ae30-2aed9c1e22c1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:08.350277 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-bf55a552-2ccc-4ed5-ae30-2aed9c1e22c1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:08.356942 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bf55a552-2ccc-4ed5-ae30-2aed9c1e22c1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:08.357391 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bf55a552-2ccc-4ed5-ae30-2aed9c1e22c1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:08.358163 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bf55a552-2ccc-4ed5-ae30-2aed9c1e22c1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:08.358597 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bf55a552-2ccc-4ed5-ae30-2aed9c1e22c1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:08.486719 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-bf55a552-2ccc-4ed5-ae30-2aed9c1e22c1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:08.494174 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-bf55a552-2ccc-4ed5-ae30-2aed9c1e22c1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.148133 Jan 11 15:21:08.494733 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 651/1278] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:08 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:09.512018 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2f31d2cd-fd67-429b-b59b-105a3a26c19a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:09.512556 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2f31d2cd-fd67-429b-b59b-105a3a26c19a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:09.518751 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2f31d2cd-fd67-429b-b59b-105a3a26c19a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:09.521919 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2f31d2cd-fd67-429b-b59b-105a3a26c19a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:09.521919 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2f31d2cd-fd67-429b-b59b-105a3a26c19a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:09.521919 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2f31d2cd-fd67-429b-b59b-105a3a26c19a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:09.649882 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-2f31d2cd-fd67-429b-b59b-105a3a26c19a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:09.657079 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2f31d2cd-fd67-429b-b59b-105a3a26c19a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.149385 Jan 11 15:21:09.657634 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 628/1279] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:09 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:10.673548 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-62b44852-825a-4d8e-90b1-8dcd90235321 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:10.674116 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-62b44852-825a-4d8e-90b1-8dcd90235321 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:10.680449 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-62b44852-825a-4d8e-90b1-8dcd90235321 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:10.680893 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-62b44852-825a-4d8e-90b1-8dcd90235321 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:10.681694 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-62b44852-825a-4d8e-90b1-8dcd90235321 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:10.682128 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-62b44852-825a-4d8e-90b1-8dcd90235321 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:10.808466 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-62b44852-825a-4d8e-90b1-8dcd90235321 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:10.815725 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-62b44852-825a-4d8e-90b1-8dcd90235321 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.145857 Jan 11 15:21:10.816271 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 652/1280] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:10 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:11.832443 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b5fad042-8fc3-48d9-b45f-09c3bf858bad tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:11.833054 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b5fad042-8fc3-48d9-b45f-09c3bf858bad tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:11.839772 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b5fad042-8fc3-48d9-b45f-09c3bf858bad tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:11.840227 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b5fad042-8fc3-48d9-b45f-09c3bf858bad tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:11.841001 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b5fad042-8fc3-48d9-b45f-09c3bf858bad tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:11.841441 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b5fad042-8fc3-48d9-b45f-09c3bf858bad tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:12.174763 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b5fad042-8fc3-48d9-b45f-09c3bf858bad tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:12.182167 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b5fad042-8fc3-48d9-b45f-09c3bf858bad tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.353315 Jan 11 15:21:12.182787 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 629/1281] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:11 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:13.200076 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e3b3fe72-001a-45e9-8281-b56ddb52a9e9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:13.200625 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e3b3fe72-001a-45e9-8281-b56ddb52a9e9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:13.207018 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e3b3fe72-001a-45e9-8281-b56ddb52a9e9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:13.207511 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e3b3fe72-001a-45e9-8281-b56ddb52a9e9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:13.208281 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e3b3fe72-001a-45e9-8281-b56ddb52a9e9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:13.208715 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e3b3fe72-001a-45e9-8281-b56ddb52a9e9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:13.334749 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-e3b3fe72-001a-45e9-8281-b56ddb52a9e9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:13.342277 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e3b3fe72-001a-45e9-8281-b56ddb52a9e9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.146643 Jan 11 15:21:13.342838 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 653/1282] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:13 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:14.359167 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-fb377d14-35e7-4b5c-99a9-ea74526f684a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:14.359811 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-fb377d14-35e7-4b5c-99a9-ea74526f684a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:14.366122 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fb377d14-35e7-4b5c-99a9-ea74526f684a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:14.366572 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fb377d14-35e7-4b5c-99a9-ea74526f684a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:14.367370 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fb377d14-35e7-4b5c-99a9-ea74526f684a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:14.367812 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fb377d14-35e7-4b5c-99a9-ea74526f684a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:14.492662 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-fb377d14-35e7-4b5c-99a9-ea74526f684a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:14.500626 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-fb377d14-35e7-4b5c-99a9-ea74526f684a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.145587 Jan 11 15:21:14.501191 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 630/1283] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:14 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:15.517199 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-0756ab61-f4b3-45dd-b0ef-ebc69f9679b9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:15.517730 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-0756ab61-f4b3-45dd-b0ef-ebc69f9679b9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:15.524004 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0756ab61-f4b3-45dd-b0ef-ebc69f9679b9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:15.524452 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0756ab61-f4b3-45dd-b0ef-ebc69f9679b9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:15.525221 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0756ab61-f4b3-45dd-b0ef-ebc69f9679b9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:15.525650 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0756ab61-f4b3-45dd-b0ef-ebc69f9679b9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:15.653728 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-0756ab61-f4b3-45dd-b0ef-ebc69f9679b9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:15.660938 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-0756ab61-f4b3-45dd-b0ef-ebc69f9679b9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.148250 Jan 11 15:21:15.661493 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 654/1284] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:15 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:16.677399 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3c5fddbf-7a4a-4f3a-95d0-f2e4128c3599 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:16.677957 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3c5fddbf-7a4a-4f3a-95d0-f2e4128c3599 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:16.684775 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c5fddbf-7a4a-4f3a-95d0-f2e4128c3599 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:16.685223 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c5fddbf-7a4a-4f3a-95d0-f2e4128c3599 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:16.686000 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c5fddbf-7a4a-4f3a-95d0-f2e4128c3599 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:16.686440 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c5fddbf-7a4a-4f3a-95d0-f2e4128c3599 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:16.817623 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3c5fddbf-7a4a-4f3a-95d0-f2e4128c3599 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:16.824826 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3c5fddbf-7a4a-4f3a-95d0-f2e4128c3599 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.151154 Jan 11 15:21:16.825384 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 631/1285] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:16 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:17.841832 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-728bc386-04af-4de2-8687-53026751f3cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:17.842434 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-728bc386-04af-4de2-8687-53026751f3cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:17.848655 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-728bc386-04af-4de2-8687-53026751f3cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:17.849106 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-728bc386-04af-4de2-8687-53026751f3cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:17.849872 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-728bc386-04af-4de2-8687-53026751f3cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:17.850304 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-728bc386-04af-4de2-8687-53026751f3cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:17.979308 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-728bc386-04af-4de2-8687-53026751f3cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:17.986708 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-728bc386-04af-4de2-8687-53026751f3cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.148762 Jan 11 15:21:17.987268 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 655/1286] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:17 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:19.004984 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-97af6e94-afca-4c91-b9a9-ca601da8cd37 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:19.005595 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-97af6e94-afca-4c91-b9a9-ca601da8cd37 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:19.013006 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-97af6e94-afca-4c91-b9a9-ca601da8cd37 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:19.013781 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-97af6e94-afca-4c91-b9a9-ca601da8cd37 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:19.014615 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-97af6e94-afca-4c91-b9a9-ca601da8cd37 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:19.015434 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-97af6e94-afca-4c91-b9a9-ca601da8cd37 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:19.159002 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-97af6e94-afca-4c91-b9a9-ca601da8cd37 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:19.166397 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-97af6e94-afca-4c91-b9a9-ca601da8cd37 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.165948 Jan 11 15:21:19.167186 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 632/1287] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:18 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:20.183892 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-0a8780cd-aa8d-4807-a393-11660e9fa4da tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:20.185037 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-0a8780cd-aa8d-4807-a393-11660e9fa4da tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:20.191260 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0a8780cd-aa8d-4807-a393-11660e9fa4da tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:20.191734 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0a8780cd-aa8d-4807-a393-11660e9fa4da tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:20.192501 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0a8780cd-aa8d-4807-a393-11660e9fa4da tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:20.192934 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0a8780cd-aa8d-4807-a393-11660e9fa4da tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:20.322603 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-0a8780cd-aa8d-4807-a393-11660e9fa4da tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:20.330089 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-0a8780cd-aa8d-4807-a393-11660e9fa4da tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.149814 Jan 11 15:21:20.330638 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 656/1288] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:20 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:20.558303 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:21:20.561531 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: Tue Jan 11 15:21:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:21:21.346906 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-31984424-069f-4af9-8260-d85a515ade1d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:21.347601 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-31984424-069f-4af9-8260-d85a515ade1d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:21.354179 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-31984424-069f-4af9-8260-d85a515ade1d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:21.354624 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-31984424-069f-4af9-8260-d85a515ade1d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:21.355433 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-31984424-069f-4af9-8260-d85a515ade1d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:21.355890 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-31984424-069f-4af9-8260-d85a515ade1d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:21.480990 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-31984424-069f-4af9-8260-d85a515ade1d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:21.488369 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-31984424-069f-4af9-8260-d85a515ade1d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.145153 Jan 11 15:21:21.488906 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 633/1289] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:21 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:22.505419 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7280c80a-24aa-489c-9f1d-0203b80aee29 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:22.506025 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7280c80a-24aa-489c-9f1d-0203b80aee29 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:22.512340 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7280c80a-24aa-489c-9f1d-0203b80aee29 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:22.513240 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7280c80a-24aa-489c-9f1d-0203b80aee29 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:22.514001 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7280c80a-24aa-489c-9f1d-0203b80aee29 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:22.514435 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7280c80a-24aa-489c-9f1d-0203b80aee29 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:22.639004 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-7280c80a-24aa-489c-9f1d-0203b80aee29 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:22.646146 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7280c80a-24aa-489c-9f1d-0203b80aee29 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.144463 Jan 11 15:21:22.646700 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 657/1290] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:22 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:23.663218 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b332d4ff-dae4-4afd-84a9-fb2b58d5c699 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:23.663854 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b332d4ff-dae4-4afd-84a9-fb2b58d5c699 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:23.669764 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b332d4ff-dae4-4afd-84a9-fb2b58d5c699 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:23.670210 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b332d4ff-dae4-4afd-84a9-fb2b58d5c699 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:23.670972 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b332d4ff-dae4-4afd-84a9-fb2b58d5c699 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:23.671432 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b332d4ff-dae4-4afd-84a9-fb2b58d5c699 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:23.811584 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b332d4ff-dae4-4afd-84a9-fb2b58d5c699 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:23.818867 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b332d4ff-dae4-4afd-84a9-fb2b58d5c699 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.159296 Jan 11 15:21:23.819447 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 634/1291] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:23 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:24.836470 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ccf4f7e0-030c-4506-ae36-f3dc1c1cb9b3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:24.837017 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-ccf4f7e0-030c-4506-ae36-f3dc1c1cb9b3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:24.843056 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ccf4f7e0-030c-4506-ae36-f3dc1c1cb9b3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:24.843585 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ccf4f7e0-030c-4506-ae36-f3dc1c1cb9b3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:24.844357 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ccf4f7e0-030c-4506-ae36-f3dc1c1cb9b3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:24.844792 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ccf4f7e0-030c-4506-ae36-f3dc1c1cb9b3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:24.969750 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-ccf4f7e0-030c-4506-ae36-f3dc1c1cb9b3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:24.977013 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-ccf4f7e0-030c-4506-ae36-f3dc1c1cb9b3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.144287 Jan 11 15:21:24.977566 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 658/1292] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:24 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:25.993999 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-fe3965ee-a241-4e72-8b6e-0129481a4809 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:25.994587 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-fe3965ee-a241-4e72-8b6e-0129481a4809 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:26.001545 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fe3965ee-a241-4e72-8b6e-0129481a4809 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:26.001995 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fe3965ee-a241-4e72-8b6e-0129481a4809 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:26.002772 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fe3965ee-a241-4e72-8b6e-0129481a4809 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:26.003209 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fe3965ee-a241-4e72-8b6e-0129481a4809 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:26.131366 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-fe3965ee-a241-4e72-8b6e-0129481a4809 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:26.138646 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-fe3965ee-a241-4e72-8b6e-0129481a4809 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.148267 Jan 11 15:21:26.139212 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 635/1293] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:25 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:27.155098 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ed6a2926-d18e-4610-9341-de0d603385d9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:27.155667 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-ed6a2926-d18e-4610-9341-de0d603385d9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:27.161953 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ed6a2926-d18e-4610-9341-de0d603385d9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:27.162406 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ed6a2926-d18e-4610-9341-de0d603385d9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:27.163181 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ed6a2926-d18e-4610-9341-de0d603385d9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:27.163653 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ed6a2926-d18e-4610-9341-de0d603385d9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:27.289578 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-ed6a2926-d18e-4610-9341-de0d603385d9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:27.296820 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-ed6a2926-d18e-4610-9341-de0d603385d9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.146024 Jan 11 15:21:27.297411 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 659/1294] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:27 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:28.313459 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-36d67e06-8823-4f95-8702-139c35407a8f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:28.314074 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-36d67e06-8823-4f95-8702-139c35407a8f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:28.320356 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-36d67e06-8823-4f95-8702-139c35407a8f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:28.320806 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-36d67e06-8823-4f95-8702-139c35407a8f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:28.321586 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-36d67e06-8823-4f95-8702-139c35407a8f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:28.322025 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-36d67e06-8823-4f95-8702-139c35407a8f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:28.446123 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-36d67e06-8823-4f95-8702-139c35407a8f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:28.453708 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-36d67e06-8823-4f95-8702-139c35407a8f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.143929 Jan 11 15:21:28.454600 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 636/1295] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:28 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:29.469740 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-14be8384-ebea-4dc4-a155-70e5934f4d76 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:29.470300 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-14be8384-ebea-4dc4-a155-70e5934f4d76 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:29.476471 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-14be8384-ebea-4dc4-a155-70e5934f4d76 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:29.476925 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-14be8384-ebea-4dc4-a155-70e5934f4d76 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:29.477729 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-14be8384-ebea-4dc4-a155-70e5934f4d76 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:29.478169 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-14be8384-ebea-4dc4-a155-70e5934f4d76 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:29.609184 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-14be8384-ebea-4dc4-a155-70e5934f4d76 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:29.616477 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-14be8384-ebea-4dc4-a155-70e5934f4d76 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.150498 Jan 11 15:21:29.617035 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 660/1296] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:29 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:30.633685 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b2242276-a18f-4c29-b8b5-bac3af82b99b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:30.634223 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b2242276-a18f-4c29-b8b5-bac3af82b99b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:30.640994 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b2242276-a18f-4c29-b8b5-bac3af82b99b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:30.641447 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b2242276-a18f-4c29-b8b5-bac3af82b99b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:30.642226 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b2242276-a18f-4c29-b8b5-bac3af82b99b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:30.642696 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b2242276-a18f-4c29-b8b5-bac3af82b99b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:30.768706 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b2242276-a18f-4c29-b8b5-bac3af82b99b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:30.776084 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b2242276-a18f-4c29-b8b5-bac3af82b99b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.146122 Jan 11 15:21:30.776645 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 637/1297] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:30 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:31.792546 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-208cef9c-1e77-40b9-b169-5c852404c962 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:31.793137 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-208cef9c-1e77-40b9-b169-5c852404c962 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:31.799356 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-208cef9c-1e77-40b9-b169-5c852404c962 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:31.799806 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-208cef9c-1e77-40b9-b169-5c852404c962 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:31.800575 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-208cef9c-1e77-40b9-b169-5c852404c962 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:31.801010 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-208cef9c-1e77-40b9-b169-5c852404c962 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:31.930262 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-208cef9c-1e77-40b9-b169-5c852404c962 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:31.937922 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-208cef9c-1e77-40b9-b169-5c852404c962 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.149266 Jan 11 15:21:31.938474 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 661/1298] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:31 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:32.954361 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-eb063e8a-3d25-4133-a839-96b127261f54 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:32.954974 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-eb063e8a-3d25-4133-a839-96b127261f54 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:32.961233 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-eb063e8a-3d25-4133-a839-96b127261f54 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:32.966512 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-eb063e8a-3d25-4133-a839-96b127261f54 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:32.966512 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-eb063e8a-3d25-4133-a839-96b127261f54 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:32.966512 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-eb063e8a-3d25-4133-a839-96b127261f54 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:33.089444 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-eb063e8a-3d25-4133-a839-96b127261f54 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:33.096666 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-eb063e8a-3d25-4133-a839-96b127261f54 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.146690 Jan 11 15:21:33.097186 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 638/1299] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:32 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:34.112956 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-93a85b9b-5f43-43c4-a331-5348c8b0a925 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:34.113570 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-93a85b9b-5f43-43c4-a331-5348c8b0a925 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:34.119997 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-93a85b9b-5f43-43c4-a331-5348c8b0a925 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:34.120477 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-93a85b9b-5f43-43c4-a331-5348c8b0a925 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:34.121289 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-93a85b9b-5f43-43c4-a331-5348c8b0a925 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:34.122293 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-93a85b9b-5f43-43c4-a331-5348c8b0a925 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:34.251839 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-93a85b9b-5f43-43c4-a331-5348c8b0a925 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:34.259172 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-93a85b9b-5f43-43c4-a331-5348c8b0a925 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.149891 Jan 11 15:21:34.259752 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 662/1300] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:34 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:35.275262 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b4da8aab-8c97-42ec-87ca-e2b6741aa8de tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:35.275911 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b4da8aab-8c97-42ec-87ca-e2b6741aa8de tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:35.282840 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b4da8aab-8c97-42ec-87ca-e2b6741aa8de tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:35.292308 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b4da8aab-8c97-42ec-87ca-e2b6741aa8de tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:35.292308 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b4da8aab-8c97-42ec-87ca-e2b6741aa8de tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:35.292308 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b4da8aab-8c97-42ec-87ca-e2b6741aa8de tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:35.409690 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b4da8aab-8c97-42ec-87ca-e2b6741aa8de tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:35.416902 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b4da8aab-8c97-42ec-87ca-e2b6741aa8de tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.145271 Jan 11 15:21:35.417454 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 639/1301] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:35 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:36.433428 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-1ff76f97-af55-4353-a51a-1593638ec5eb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:36.434635 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-1ff76f97-af55-4353-a51a-1593638ec5eb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:36.445274 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1ff76f97-af55-4353-a51a-1593638ec5eb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:36.445732 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1ff76f97-af55-4353-a51a-1593638ec5eb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:36.446580 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1ff76f97-af55-4353-a51a-1593638ec5eb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:36.447023 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1ff76f97-af55-4353-a51a-1593638ec5eb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:36.572218 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-1ff76f97-af55-4353-a51a-1593638ec5eb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:36.580296 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-1ff76f97-af55-4353-a51a-1593638ec5eb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.150553 Jan 11 15:21:36.580858 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 663/1302] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:36 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:37.598587 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b4fc4cc6-9bb8-40a5-a22b-2bcf668636e0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:37.599137 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b4fc4cc6-9bb8-40a5-a22b-2bcf668636e0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:37.605696 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b4fc4cc6-9bb8-40a5-a22b-2bcf668636e0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:37.606140 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b4fc4cc6-9bb8-40a5-a22b-2bcf668636e0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:37.606921 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b4fc4cc6-9bb8-40a5-a22b-2bcf668636e0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:37.607394 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b4fc4cc6-9bb8-40a5-a22b-2bcf668636e0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:37.735820 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b4fc4cc6-9bb8-40a5-a22b-2bcf668636e0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:37.743268 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b4fc4cc6-9bb8-40a5-a22b-2bcf668636e0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.149460 Jan 11 15:21:37.743864 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 640/1303] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:37 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:38.759232 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-471c01ce-1ce7-4b69-9cc4-03b21de562a9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:38.759874 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-471c01ce-1ce7-4b69-9cc4-03b21de562a9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:38.766828 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-471c01ce-1ce7-4b69-9cc4-03b21de562a9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:38.767283 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-471c01ce-1ce7-4b69-9cc4-03b21de562a9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:38.776197 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-471c01ce-1ce7-4b69-9cc4-03b21de562a9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:38.776738 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-471c01ce-1ce7-4b69-9cc4-03b21de562a9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:38.903270 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-471c01ce-1ce7-4b69-9cc4-03b21de562a9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:38.910564 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-471c01ce-1ce7-4b69-9cc4-03b21de562a9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.155036 Jan 11 15:21:38.911166 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 664/1304] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:38 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:39.927135 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-cccfa75e-c0af-4a57-971b-b72d2db1c354 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:39.927815 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-cccfa75e-c0af-4a57-971b-b72d2db1c354 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:39.934667 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cccfa75e-c0af-4a57-971b-b72d2db1c354 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:39.935118 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cccfa75e-c0af-4a57-971b-b72d2db1c354 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:39.935922 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cccfa75e-c0af-4a57-971b-b72d2db1c354 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:39.936363 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cccfa75e-c0af-4a57-971b-b72d2db1c354 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:40.041873 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-fd9e615c-03d7-4e1b-9f4c-5676375c6663 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:40.042357 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-fd9e615c-03d7-4e1b-9f4c-5676375c6663 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:40.049285 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fd9e615c-03d7-4e1b-9f4c-5676375c6663 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:40.049661 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fd9e615c-03d7-4e1b-9f4c-5676375c6663 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:40.050439 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fd9e615c-03d7-4e1b-9f4c-5676375c6663 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:40.050864 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fd9e615c-03d7-4e1b-9f4c-5676375c6663 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:40.074201 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-cccfa75e-c0af-4a57-971b-b72d2db1c354 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:40.082178 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-cccfa75e-c0af-4a57-971b-b72d2db1c354 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.158710 Jan 11 15:21:40.082739 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 641/1305] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:39 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:40.138637 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-116d7826-f345-4c9b-9f95-22d31d16942b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:40.139060 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-116d7826-f345-4c9b-9f95-22d31d16942b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:40.145521 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-116d7826-f345-4c9b-9f95-22d31d16942b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:40.145998 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-116d7826-f345-4c9b-9f95-22d31d16942b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:40.146775 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-116d7826-f345-4c9b-9f95-22d31d16942b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:40.147626 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-116d7826-f345-4c9b-9f95-22d31d16942b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:40.173580 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-116d7826-f345-4c9b-9f95-22d31d16942b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Going to try to terminate instance {{(pid=116902) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 15:21:40.508899 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-116d7826-f345-4c9b-9f95-22d31d16942b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda" status: 204 len: 0 microversion: 2.20 time: 0.373710 Jan 11 15:21:40.509487 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 642/1306] 10.222.0.52 () {60 vars in 1279 bytes} [Tue Jan 11 15:21:40 2022] DELETE /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 11 15:21:40.515118 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-22f4a308-ae92-440a-8e9d-517d57debfb0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:40.515730 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-22f4a308-ae92-440a-8e9d-517d57debfb0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:40.521381 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-22f4a308-ae92-440a-8e9d-517d57debfb0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:40.521920 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-22f4a308-ae92-440a-8e9d-517d57debfb0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:40.522619 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-22f4a308-ae92-440a-8e9d-517d57debfb0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:40.523061 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-22f4a308-ae92-440a-8e9d-517d57debfb0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:40.548128 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-22f4a308-ae92-440a-8e9d-517d57debfb0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Going to try to terminate instance {{(pid=116902) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 15:21:40.820382 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-22f4a308-ae92-440a-8e9d-517d57debfb0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be" status: 204 len: 0 microversion: 2.1 time: 0.309437 Jan 11 15:21:40.821001 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 643/1307] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jan 11 15:21:40 2022] DELETE /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 15:21:40.826513 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-97592ff3-5c16-4c4d-ac27-b547ed98f37a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:40.830569 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-97592ff3-5c16-4c4d-ac27-b547ed98f37a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:40.832781 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-97592ff3-5c16-4c4d-ac27-b547ed98f37a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:40.833232 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-97592ff3-5c16-4c4d-ac27-b547ed98f37a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:40.834009 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-97592ff3-5c16-4c4d-ac27-b547ed98f37a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:40.834451 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-97592ff3-5c16-4c4d-ac27-b547ed98f37a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:40.859622 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-97592ff3-5c16-4c4d-ac27-b547ed98f37a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Going to try to terminate instance {{(pid=116902) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 15:21:41.157479 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-97592ff3-5c16-4c4d-ac27-b547ed98f37a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "DELETE /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 204 len: 0 microversion: 2.1 time: 0.334842 Jan 11 15:21:41.158117 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 644/1308] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jan 11 15:21:40 2022] DELETE /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 15:21:41.162842 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9508e38e-2386-413c-afb5-b37921ef998e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:41.167354 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9508e38e-2386-413c-afb5-b37921ef998e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:41.170007 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9508e38e-2386-413c-afb5-b37921ef998e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:41.170466 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9508e38e-2386-413c-afb5-b37921ef998e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:41.171244 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9508e38e-2386-413c-afb5-b37921ef998e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:41.171721 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9508e38e-2386-413c-afb5-b37921ef998e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:41.299703 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-9508e38e-2386-413c-afb5-b37921ef998e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:41.307371 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-9508e38e-2386-413c-afb5-b37921ef998e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:41.308878 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-9508e38e-2386-413c-afb5-b37921ef998e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:41.310027 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9508e38e-2386-413c-afb5-b37921ef998e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda" status: 200 len: 1723 microversion: 2.20 time: 0.151003 Jan 11 15:21:41.310591 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 645/1309] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:21:41 2022] GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 15:21:41.314727 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-14682b6b-88a5-4638-897e-7904e7fbe165 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:41.315360 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-14682b6b-88a5-4638-897e-7904e7fbe165 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:41.321180 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-14682b6b-88a5-4638-897e-7904e7fbe165 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:41.321740 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-14682b6b-88a5-4638-897e-7904e7fbe165 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:41.322527 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-14682b6b-88a5-4638-897e-7904e7fbe165 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:41.322999 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-14682b6b-88a5-4638-897e-7904e7fbe165 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:41.476997 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-14682b6b-88a5-4638-897e-7904e7fbe165 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:41.484309 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-14682b6b-88a5-4638-897e-7904e7fbe165 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be" status: 200 len: 1515 microversion: 2.1 time: 0.172738 Jan 11 15:21:41.485185 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 646/1310] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:41 2022] GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:41.489411 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3119726c-e4d5-4470-9f06-29890160338f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:41.490011 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3119726c-e4d5-4470-9f06-29890160338f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:41.495669 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3119726c-e4d5-4470-9f06-29890160338f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:41.496120 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3119726c-e4d5-4470-9f06-29890160338f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:41.496894 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3119726c-e4d5-4470-9f06-29890160338f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:41.497347 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3119726c-e4d5-4470-9f06-29890160338f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:41.714297 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3119726c-e4d5-4470-9f06-29890160338f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:41.721609 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3119726c-e4d5-4470-9f06-29890160338f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.235449 Jan 11 15:21:41.722379 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 647/1311] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:41 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:41.726579 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e64588e1-87f0-4a38-9e41-fad577f76326 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:41.727153 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e64588e1-87f0-4a38-9e41-fad577f76326 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:41.732737 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e64588e1-87f0-4a38-9e41-fad577f76326 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:41.733192 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e64588e1-87f0-4a38-9e41-fad577f76326 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:41.733975 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e64588e1-87f0-4a38-9e41-fad577f76326 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:41.734420 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e64588e1-87f0-4a38-9e41-fad577f76326 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:42.031415 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e64588e1-87f0-4a38-9e41-fad577f76326 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:42.039431 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e64588e1-87f0-4a38-9e41-fad577f76326 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 200 len: 1674 microversion: 2.1 time: 0.316159 Jan 11 15:21:42.040202 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 648/1312] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:41 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 1674 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:42.331075 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1c2086d9-9b79-439e-8e81-8b8fde7c9417 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:42.332442 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1c2086d9-9b79-439e-8e81-8b8fde7c9417 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:42.338643 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1c2086d9-9b79-439e-8e81-8b8fde7c9417 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:42.339323 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1c2086d9-9b79-439e-8e81-8b8fde7c9417 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:42.340902 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1c2086d9-9b79-439e-8e81-8b8fde7c9417 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:42.341513 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1c2086d9-9b79-439e-8e81-8b8fde7c9417 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:42.420315 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1c2086d9-9b79-439e-8e81-8b8fde7c9417 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:42.430349 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1c2086d9-9b79-439e-8e81-8b8fde7c9417 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:42.432663 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1c2086d9-9b79-439e-8e81-8b8fde7c9417 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:42.436229 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1c2086d9-9b79-439e-8e81-8b8fde7c9417 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda" status: 200 len: 1655 microversion: 2.20 time: 0.109705 Jan 11 15:21:42.446708 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 649/1313] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:21:42 2022] GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda => generated 1655 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 15:21:42.514842 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-a57430af-a5e7-475e-89da-df782d9637a8 req-2698ddbc-ff66-4bcd-a017-8ce5fba6a42a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e78f846-beb6-49c6-8f01-5cc343dbb7be", "name": "network-vif-deleted", "tag": "699cc465-fddf-4b17-9874-9bfcf03e258d"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:21:42.516714 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:21:42.516714 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:21:42.525451 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-a57430af-a5e7-475e-89da-df782d9637a8 req-2698ddbc-ff66-4bcd-a017-8ce5fba6a42a service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:42.525451 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-a57430af-a5e7-475e-89da-df782d9637a8 req-2698ddbc-ff66-4bcd-a017-8ce5fba6a42a service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:42.536672 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-a57430af-a5e7-475e-89da-df782d9637a8 req-2698ddbc-ff66-4bcd-a017-8ce5fba6a42a service nova] Creating event network-vif-deleted:699cc465-fddf-4b17-9874-9bfcf03e258d for instance 6e78f846-beb6-49c6-8f01-5cc343dbb7be on hv-cinder-82418 Jan 11 15:21:42.542222 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [req-a57430af-a5e7-475e-89da-df782d9637a8 req-2698ddbc-ff66-4bcd-a017-8ce5fba6a42a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098775 Jan 11 15:21:42.543266 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 650/1314] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:21:42.548685 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5f0c2d77-c7b8-4906-a509-6ea9d47902f0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:42.550140 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5f0c2d77-c7b8-4906-a509-6ea9d47902f0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:42.560468 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5f0c2d77-c7b8-4906-a509-6ea9d47902f0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:42.560468 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5f0c2d77-c7b8-4906-a509-6ea9d47902f0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:42.560468 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5f0c2d77-c7b8-4906-a509-6ea9d47902f0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:42.561025 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5f0c2d77-c7b8-4906-a509-6ea9d47902f0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:42.697981 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-5f0c2d77-c7b8-4906-a509-6ea9d47902f0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f0a933d4d34f8984292406266866a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed51a96e66d44ca9c02bbe820c68180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:42.708284 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5f0c2d77-c7b8-4906-a509-6ea9d47902f0 tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be" status: 200 len: 1473 microversion: 2.1 time: 0.163742 Jan 11 15:21:42.710000 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 651/1315] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:42 2022] GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be => generated 1473 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:42.789947 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-6ba6eb0d-70f6-4940-b5c0-63c1124d087d req-02f0fd57-5dad-4cbd-9c56-3ddd1d69fb76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdd2d856-37d5-436b-b0c4-9874da364cda", "name": "network-vif-deleted", "tag": "cdf915de-7c8e-41e0-bca7-ba954f5c9fed"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:21:42.792184 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:21:42.792184 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:21:42.803127 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-6ba6eb0d-70f6-4940-b5c0-63c1124d087d req-02f0fd57-5dad-4cbd-9c56-3ddd1d69fb76 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:42.803738 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-6ba6eb0d-70f6-4940-b5c0-63c1124d087d req-02f0fd57-5dad-4cbd-9c56-3ddd1d69fb76 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:42.817617 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-6ba6eb0d-70f6-4940-b5c0-63c1124d087d req-02f0fd57-5dad-4cbd-9c56-3ddd1d69fb76 service nova] Creating event network-vif-deleted:cdf915de-7c8e-41e0-bca7-ba954f5c9fed for instance bdd2d856-37d5-436b-b0c4-9874da364cda on hv-cinder-82418 Jan 11 15:21:42.822896 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [req-6ba6eb0d-70f6-4940-b5c0-63c1124d087d req-02f0fd57-5dad-4cbd-9c56-3ddd1d69fb76 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111607 Jan 11 15:21:42.827456 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 652/1316] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:21:42.834651 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-86ed296f-3b3a-4a29-958b-b78a83920eef tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:42.836560 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-86ed296f-3b3a-4a29-958b-b78a83920eef tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:42.845171 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-86ed296f-3b3a-4a29-958b-b78a83920eef tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:42.845685 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-86ed296f-3b3a-4a29-958b-b78a83920eef tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:42.846590 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-86ed296f-3b3a-4a29-958b-b78a83920eef tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:42.847037 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-86ed296f-3b3a-4a29-958b-b78a83920eef tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:43.002700 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-86ed296f-3b3a-4a29-958b-b78a83920eef tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:43.010642 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-86ed296f-3b3a-4a29-958b-b78a83920eef tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.181567 Jan 11 15:21:43.011221 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 653/1317] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:42 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:43.058883 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d79fa670-0a63-4299-a592-702c6f587540 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:43.060066 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d79fa670-0a63-4299-a592-702c6f587540 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:43.066604 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d79fa670-0a63-4299-a592-702c6f587540 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:43.067369 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d79fa670-0a63-4299-a592-702c6f587540 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:43.068420 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d79fa670-0a63-4299-a592-702c6f587540 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:43.069044 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d79fa670-0a63-4299-a592-702c6f587540 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:43.225522 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d79fa670-0a63-4299-a592-702c6f587540 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:43.240407 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d79fa670-0a63-4299-a592-702c6f587540 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 200 len: 1674 microversion: 2.1 time: 0.184417 Jan 11 15:21:43.247344 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 654/1318] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:43 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 1674 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:43.455469 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6f49dd16-6b34-44c7-a3ee-f39d6170141f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:43.456247 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6f49dd16-6b34-44c7-a3ee-f39d6170141f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:43.464201 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6f49dd16-6b34-44c7-a3ee-f39d6170141f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:43.468482 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6f49dd16-6b34-44c7-a3ee-f39d6170141f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:43.470150 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6f49dd16-6b34-44c7-a3ee-f39d6170141f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:43.476900 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6f49dd16-6b34-44c7-a3ee-f39d6170141f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:43.528047 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6f49dd16-6b34-44c7-a3ee-f39d6170141f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:43.528502 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6f49dd16-6b34-44c7-a3ee-f39d6170141f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:43.529576 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.objects.instance [None req-6f49dd16-6b34-44c7-a3ee-f39d6170141f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lazy-loading 'fault' on Instance uuid bdd2d856-37d5-436b-b0c4-9874da364cda {{(pid=116902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 15:21:43.585411 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6f49dd16-6b34-44c7-a3ee-f39d6170141f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:43.593588 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6f49dd16-6b34-44c7-a3ee-f39d6170141f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:43.599686 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6f49dd16-6b34-44c7-a3ee-f39d6170141f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:43.601808 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6f49dd16-6b34-44c7-a3ee-f39d6170141f tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda" status: 200 len: 1371 microversion: 2.20 time: 0.149993 Jan 11 15:21:43.612646 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 655/1319] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:21:43 2022] GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 15:21:43.725779 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c770294a-a11e-447b-b46e-8339747394ff tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:43.726395 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c770294a-a11e-447b-b46e-8339747394ff tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] [instance: 6e78f846-beb6-49c6-8f01-5cc343dbb7be] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:43.734118 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c770294a-a11e-447b-b46e-8339747394ff tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:43.734665 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c770294a-a11e-447b-b46e-8339747394ff tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:43.735377 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c770294a-a11e-447b-b46e-8339747394ff tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:43.735825 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c770294a-a11e-447b-b46e-8339747394ff tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:43.768675 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.wsgi [None req-c770294a-a11e-447b-b46e-8339747394ff tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] HTTP exception thrown: Instance 6e78f846-beb6-49c6-8f01-5cc343dbb7be could not be found. Jan 11 15:21:43.769271 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c770294a-a11e-447b-b46e-8339747394ff tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] Returning 404 to user: Instance 6e78f846-beb6-49c6-8f01-5cc343dbb7be could not be found. {{(pid=116902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:21:43.780272 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c770294a-a11e-447b-b46e-8339747394ff tempest-AttachVolumeNegativeTest-221788784 tempest-AttachVolumeNegativeTest-221788784-project] 10.222.0.52 "GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be" status: 404 len: 111 microversion: 2.1 time: 0.057814 Jan 11 15:21:43.781165 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 656/1320] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:43 2022] GET /compute/v2.1/servers/6e78f846-beb6-49c6-8f01-5cc343dbb7be => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 11 15:21:44.028068 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0827da85-3096-4b7c-b2c5-3240991374a7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:44.028708 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0827da85-3096-4b7c-b2c5-3240991374a7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:44.038102 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0827da85-3096-4b7c-b2c5-3240991374a7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:44.038558 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0827da85-3096-4b7c-b2c5-3240991374a7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:44.041676 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0827da85-3096-4b7c-b2c5-3240991374a7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:44.041676 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0827da85-3096-4b7c-b2c5-3240991374a7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:44.289034 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0827da85-3096-4b7c-b2c5-3240991374a7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:44.297863 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0827da85-3096-4b7c-b2c5-3240991374a7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.274393 Jan 11 15:21:44.298438 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 657/1321] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:44 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:44.304256 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-225e7211-937d-4f6a-b34c-a67bfd5beaa7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:44.304869 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-225e7211-937d-4f6a-b34c-a67bfd5beaa7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:44.314135 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-225e7211-937d-4f6a-b34c-a67bfd5beaa7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:44.314586 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-225e7211-937d-4f6a-b34c-a67bfd5beaa7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:44.317175 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-225e7211-937d-4f6a-b34c-a67bfd5beaa7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:44.317175 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-225e7211-937d-4f6a-b34c-a67bfd5beaa7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:44.356458 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-225e7211-937d-4f6a-b34c-a67bfd5beaa7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:44.356915 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-225e7211-937d-4f6a-b34c-a67bfd5beaa7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:44.357372 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.objects.instance [None req-225e7211-937d-4f6a-b34c-a67bfd5beaa7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lazy-loading 'fault' on Instance uuid 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 {{(pid=116902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 15:21:44.399779 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-225e7211-937d-4f6a-b34c-a67bfd5beaa7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:44.411914 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-225e7211-937d-4f6a-b34c-a67bfd5beaa7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 200 len: 1328 microversion: 2.1 time: 0.111791 Jan 11 15:21:44.415495 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 658/1322] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:44 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 1328 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:44.588589 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-791e8358-6453-4e38-8cf5-776d97218fe1 req-7255234b-c593-4d42-b696-862f162d76f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "556650b4-5ee6-4ed5-ad51-cb3c36cca0b4", "name": "network-vif-deleted", "tag": "3c3557a2-ffc2-4330-a17d-f0701fba5be9"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:21:44.591378 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:21:44.591378 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:21:44.600602 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-791e8358-6453-4e38-8cf5-776d97218fe1 req-7255234b-c593-4d42-b696-862f162d76f8 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:44.601195 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-791e8358-6453-4e38-8cf5-776d97218fe1 req-7255234b-c593-4d42-b696-862f162d76f8 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:44.614121 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-791e8358-6453-4e38-8cf5-776d97218fe1 req-7255234b-c593-4d42-b696-862f162d76f8 service nova] Creating event network-vif-deleted:3c3557a2-ffc2-4330-a17d-f0701fba5be9 for instance 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 on hv-cinder-82418 Jan 11 15:21:44.621157 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [req-791e8358-6453-4e38-8cf5-776d97218fe1 req-7255234b-c593-4d42-b696-862f162d76f8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038702 Jan 11 15:21:44.623392 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 659/1323] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:21:44.629735 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4ba2bcf8-a28b-471f-9003-fd08c4683c95 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:44.630648 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-4ba2bcf8-a28b-471f-9003-fd08c4683c95 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:44.646119 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4ba2bcf8-a28b-471f-9003-fd08c4683c95 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:44.646722 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4ba2bcf8-a28b-471f-9003-fd08c4683c95 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:44.648994 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4ba2bcf8-a28b-471f-9003-fd08c4683c95 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:44.649783 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4ba2bcf8-a28b-471f-9003-fd08c4683c95 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:44.669754 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.wsgi [None req-4ba2bcf8-a28b-471f-9003-fd08c4683c95 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] HTTP exception thrown: Instance bdd2d856-37d5-436b-b0c4-9874da364cda could not be found. Jan 11 15:21:44.670265 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4ba2bcf8-a28b-471f-9003-fd08c4683c95 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Returning 404 to user: Instance bdd2d856-37d5-436b-b0c4-9874da364cda could not be found. {{(pid=116902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:21:44.671105 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4ba2bcf8-a28b-471f-9003-fd08c4683c95 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda" status: 404 len: 111 microversion: 2.20 time: 0.046556 Jan 11 15:21:44.675173 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 660/1324] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:21:44 2022] GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 11 15:21:44.680087 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-67d5cfe8-2552-4c6a-92c2-3774e3bb4151 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '.version_select at 0x7f16b9e911f0>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:44.836689 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-67d5cfe8-2552-4c6a-92c2-3774e3bb4151 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-830658203" status: 204 len: 0 microversion: 2.20 time: 0.160343 Jan 11 15:21:44.837575 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 661/1325] 10.222.0.52 () {60 vars in 1258 bytes} [Tue Jan 11 15:21:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-830658203 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 11 15:21:45.315684 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8611e0c0-6712-40a3-baf4-d4175a52cd34 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:45.316415 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8611e0c0-6712-40a3-baf4-d4175a52cd34 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:45.331855 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8611e0c0-6712-40a3-baf4-d4175a52cd34 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:45.333103 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8611e0c0-6712-40a3-baf4-d4175a52cd34 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:45.334642 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8611e0c0-6712-40a3-baf4-d4175a52cd34 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:45.335374 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8611e0c0-6712-40a3-baf4-d4175a52cd34 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:45.568072 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-8611e0c0-6712-40a3-baf4-d4175a52cd34 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:45.576498 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8611e0c0-6712-40a3-baf4-d4175a52cd34 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.264522 Jan 11 15:21:45.577310 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 662/1326] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:45 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:21:45.582492 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-21ba5375-9cd0-4235-9fdb-c06ef7b69c11 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:45.583372 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-21ba5375-9cd0-4235-9fdb-c06ef7b69c11 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:45.590615 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-21ba5375-9cd0-4235-9fdb-c06ef7b69c11 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:45.592079 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-21ba5375-9cd0-4235-9fdb-c06ef7b69c11 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:45.592889 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-21ba5375-9cd0-4235-9fdb-c06ef7b69c11 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:45.593325 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-21ba5375-9cd0-4235-9fdb-c06ef7b69c11 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:45.609440 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.wsgi [None req-21ba5375-9cd0-4235-9fdb-c06ef7b69c11 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] HTTP exception thrown: Instance 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 could not be found. Jan 11 15:21:45.609991 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-21ba5375-9cd0-4235-9fdb-c06ef7b69c11 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Returning 404 to user: Instance 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 could not be found. {{(pid=116902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:21:45.611392 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-21ba5375-9cd0-4235-9fdb-c06ef7b69c11 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 404 len: 111 microversion: 2.1 time: 0.032439 Jan 11 15:21:45.616268 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 663/1327] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:45 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 15:21:45.623352 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-bbdb8501-da00-4730-932a-dfc4e2aaa260 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '.version_select at 0x7f16b9e914c0>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:45.698139 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-bbdb8501-da00-4730-932a-dfc4e2aaa260 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1576827656" status: 202 len: 0 microversion: 2.1 time: 0.080214 Jan 11 15:21:45.709739 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 664/1328] 10.222.0.52 () {58 vars in 1220 bytes} [Tue Jan 11 15:21:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1576827656 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:21:45.967440 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5aec3f8a-c308-4898-aecc-4e18aa3be4cc tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'create', calling method: .version_select at 0x7f16b9f713a0>, body: {"keypair": {"name": "tempest-keypair-708647409"}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:21:45.981336 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.quota [None req-5aec3f8a-c308-4898-aecc-4e18aa3be4cc tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Getting quotas for project 06f9437149e449d6b1d1d9a69601b197. Resources: {'key_pairs'} {{(pid=116902) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 15:21:45.985180 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.quota [None req-5aec3f8a-c308-4898-aecc-4e18aa3be4cc tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Getting quotas for user 055cca7e9794424a8962422a9b5dda1d and project 06f9437149e449d6b1d1d9a69601b197. Resources: {'key_pairs'} {{(pid=116902) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 15:21:46.328757 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.quota [None req-5aec3f8a-c308-4898-aecc-4e18aa3be4cc tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Getting quotas for project 06f9437149e449d6b1d1d9a69601b197. Resources: {'key_pairs'} {{(pid=116902) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 15:21:46.332906 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.quota [None req-5aec3f8a-c308-4898-aecc-4e18aa3be4cc tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Getting quotas for user 055cca7e9794424a8962422a9b5dda1d and project 06f9437149e449d6b1d1d9a69601b197. Resources: {'key_pairs'} {{(pid=116902) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 15:21:46.347211 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5aec3f8a-c308-4898-aecc-4e18aa3be4cc tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.384591 Jan 11 15:21:46.347851 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 665/1329] 10.222.0.52 () {62 vars in 1198 bytes} [Tue Jan 11 15:21:45 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 386 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 11 15:21:46.597244 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-043dc4b8-85cb-4756-b2d5-fc382f21ad8f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:46.597895 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-043dc4b8-85cb-4756-b2d5-fc382f21ad8f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:46.603666 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-043dc4b8-85cb-4756-b2d5-fc382f21ad8f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:46.604123 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-043dc4b8-85cb-4756-b2d5-fc382f21ad8f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:46.604909 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-043dc4b8-85cb-4756-b2d5-fc382f21ad8f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:46.606063 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-043dc4b8-85cb-4756-b2d5-fc382f21ad8f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:46.771132 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-043dc4b8-85cb-4756-b2d5-fc382f21ad8f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:46.778689 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-043dc4b8-85cb-4756-b2d5-fc382f21ad8f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.185084 Jan 11 15:21:46.787636 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 666/1330] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:46 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:21:46.793576 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-147cdf06-1d26-440c-86b1-27ca556cfa15 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'create', calling method: .version_select at 0x7f16ba035e50>, body: {"keypair": {"name": "tempest-keypair-1103885072"}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:21:46.809921 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.quota [None req-147cdf06-1d26-440c-86b1-27ca556cfa15 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Getting quotas for project 9d979bb0d7f04bbe99fa7215278f1051. Resources: {'key_pairs'} {{(pid=116902) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 15:21:46.816101 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.quota [None req-147cdf06-1d26-440c-86b1-27ca556cfa15 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Getting quotas for user b805c31cc5924c6d98c83718d1884440 and project 9d979bb0d7f04bbe99fa7215278f1051. Resources: {'key_pairs'} {{(pid=116902) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 15:21:47.299980 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.quota [None req-147cdf06-1d26-440c-86b1-27ca556cfa15 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Getting quotas for project 9d979bb0d7f04bbe99fa7215278f1051. Resources: {'key_pairs'} {{(pid=116902) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 15:21:47.304491 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.quota [None req-147cdf06-1d26-440c-86b1-27ca556cfa15 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Getting quotas for user b805c31cc5924c6d98c83718d1884440 and project 9d979bb0d7f04bbe99fa7215278f1051. Resources: {'key_pairs'} {{(pid=116902) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 15:21:47.318722 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-147cdf06-1d26-440c-86b1-27ca556cfa15 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.529742 Jan 11 15:21:47.319392 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 667/1331] 10.222.0.52 () {60 vars in 1157 bytes} [Tue Jan 11 15:21:46 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:47.800822 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6ca39e93-5efb-4b35-8025-ed94675c8eae tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:47.802310 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6ca39e93-5efb-4b35-8025-ed94675c8eae tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:47.809332 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6ca39e93-5efb-4b35-8025-ed94675c8eae tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:47.810198 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6ca39e93-5efb-4b35-8025-ed94675c8eae tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:47.811040 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6ca39e93-5efb-4b35-8025-ed94675c8eae tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:47.811529 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6ca39e93-5efb-4b35-8025-ed94675c8eae tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:48.072207 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6ca39e93-5efb-4b35-8025-ed94675c8eae tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:48.080877 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6ca39e93-5efb-4b35-8025-ed94675c8eae tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.283918 Jan 11 15:21:48.081456 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 668/1332] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:47 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:21:49.102226 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-90d63435-f6ed-4eb3-9423-f51e95a18ffa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:49.103941 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-90d63435-f6ed-4eb3-9423-f51e95a18ffa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:49.111596 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-90d63435-f6ed-4eb3-9423-f51e95a18ffa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:49.112254 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-90d63435-f6ed-4eb3-9423-f51e95a18ffa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:49.113042 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-90d63435-f6ed-4eb3-9423-f51e95a18ffa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:49.113477 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-90d63435-f6ed-4eb3-9423-f51e95a18ffa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:49.274430 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-90d63435-f6ed-4eb3-9423-f51e95a18ffa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:49.282706 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-90d63435-f6ed-4eb3-9423-f51e95a18ffa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.185163 Jan 11 15:21:49.283828 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 669/1333] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:49 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:49.291273 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-50c6a830-2983-4f86-9575-79cffddede01 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1440735561", "imageRef": "d0ce98ab-06a2-4e75-9f37-288864a22cb9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5b9f0d65-d5f3-4656-9171-4a158424da81"}], "security_groups": [{"name": "tempest-securitygroup--1465703178"}], "key_name": "tempest-keypair-708647409", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:21:49.406183 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.network.neutron [None req-50c6a830-2983-4f86-9575-79cffddede01 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] validate_networks() for [('5b9f0d65-d5f3-4656-9171-4a158424da81', None, None, None, None, None)] {{(pid=116902) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 15:21:49.885362 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-50c6a830-2983-4f86-9575-79cffddede01 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Flavor limits 0:0:0 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 15:21:49.885785 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-50c6a830-2983-4f86-9575-79cffddede01 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Image limits 0:0:0 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 15:21:49.886260 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-50c6a830-2983-4f86-9575-79cffddede01 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Flavor pref 0:0:0 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 15:21:49.886720 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-50c6a830-2983-4f86-9575-79cffddede01 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Image pref 0:0:0 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 15:21:49.887706 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-50c6a830-2983-4f86-9575-79cffddede01 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 15:21:49.897656 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-50c6a830-2983-4f86-9575-79cffddede01 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:49.898444 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-50c6a830-2983-4f86-9575-79cffddede01 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:49.898969 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-50c6a830-2983-4f86-9575-79cffddede01 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:49.899445 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-50c6a830-2983-4f86-9575-79cffddede01 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:49.915997 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.quota [None req-50c6a830-2983-4f86-9575-79cffddede01 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Getting quotas for project 06f9437149e449d6b1d1d9a69601b197. Resources: {'instances', 'cores', 'ram'} {{(pid=116902) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 15:21:49.919942 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.quota [None req-50c6a830-2983-4f86-9575-79cffddede01 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Getting quotas for user 055cca7e9794424a8962422a9b5dda1d and project 06f9437149e449d6b1d1d9a69601b197. Resources: {'instances', 'cores', 'ram'} {{(pid=116902) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 15:21:49.930355 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-50c6a830-2983-4f86-9575-79cffddede01 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Going to run 1 instances... {{(pid=116902) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 15:21:49.932660 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-50c6a830-2983-4f86-9575-79cffddede01 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0ce98ab-06a2-4e75-9f37-288864a22cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 15:21:50.080463 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-50c6a830-2983-4f86-9575-79cffddede01 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.794902 Jan 11 15:21:50.081199 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 670/1334] 10.222.0.52 () {62 vars in 1187 bytes} [Tue Jan 11 15:21:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 11 15:21:50.086431 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f280611b-b469-439f-bed8-bac9a531a079 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1543090489", "imageRef": "d0ce98ab-06a2-4e75-9f37-288864a22cb9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f4d94b5-b203-4c46-b51c-c22a8f4a2dc1"}], "security_groups": [{"name": "tempest-securitygroup--830660079"}], "key_name": "tempest-keypair-1103885072", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:21:50.187402 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.network.neutron [None req-f280611b-b469-439f-bed8-bac9a531a079 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] validate_networks() for [('3f4d94b5-b203-4c46-b51c-c22a8f4a2dc1', None, None, None, None, None)] {{(pid=116902) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 15:21:50.551833 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-f280611b-b469-439f-bed8-bac9a531a079 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Flavor limits 0:0:0 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 15:21:50.558501 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-f280611b-b469-439f-bed8-bac9a531a079 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Image limits 0:0:0 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 15:21:50.558501 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-f280611b-b469-439f-bed8-bac9a531a079 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Flavor pref 0:0:0 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 15:21:50.558501 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-f280611b-b469-439f-bed8-bac9a531a079 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Image pref 0:0:0 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 15:21:50.558501 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-f280611b-b469-439f-bed8-bac9a531a079 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 15:21:50.563337 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f280611b-b469-439f-bed8-bac9a531a079 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:50.563996 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f280611b-b469-439f-bed8-bac9a531a079 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:50.564813 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f280611b-b469-439f-bed8-bac9a531a079 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:50.565256 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f280611b-b469-439f-bed8-bac9a531a079 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:50.581865 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.quota [None req-f280611b-b469-439f-bed8-bac9a531a079 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Getting quotas for project 9d979bb0d7f04bbe99fa7215278f1051. Resources: {'instances', 'cores', 'ram'} {{(pid=116902) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 15:21:50.585536 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.quota [None req-f280611b-b469-439f-bed8-bac9a531a079 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Getting quotas for user b805c31cc5924c6d98c83718d1884440 and project 9d979bb0d7f04bbe99fa7215278f1051. Resources: {'instances', 'cores', 'ram'} {{(pid=116902) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 15:21:50.596673 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f280611b-b469-439f-bed8-bac9a531a079 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Going to run 1 instances... {{(pid=116902) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 15:21:50.598807 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f280611b-b469-439f-bed8-bac9a531a079 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0ce98ab-06a2-4e75-9f37-288864a22cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 15:21:50.750459 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f280611b-b469-439f-bed8-bac9a531a079 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.668038 Jan 11 15:21:50.751455 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 671/1335] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jan 11 15:21:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 15:21:50.755694 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-60a48936-e9ab-4173-b1cd-417917f85843 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:50.756517 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-60a48936-e9ab-4173-b1cd-417917f85843 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:50.808119 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-60a48936-e9ab-4173-b1cd-417917f85843 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:50.815218 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-60a48936-e9ab-4173-b1cd-417917f85843 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:50.816745 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-60a48936-e9ab-4173-b1cd-417917f85843 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:50.817824 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-60a48936-e9ab-4173-b1cd-417917f85843 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60" status: 200 len: 1281 microversion: 2.20 time: 0.065556 Jan 11 15:21:50.818621 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 672/1336] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:21:50 2022] GET /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60 => generated 1281 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 15:21:50.832788 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b495d56b-a97d-4d5c-85e7-841984c902d6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:50.833400 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b495d56b-a97d-4d5c-85e7-841984c902d6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:50.840319 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b495d56b-a97d-4d5c-85e7-841984c902d6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:50.840825 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b495d56b-a97d-4d5c-85e7-841984c902d6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:50.841605 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b495d56b-a97d-4d5c-85e7-841984c902d6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:50.842091 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b495d56b-a97d-4d5c-85e7-841984c902d6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:50.975735 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b495d56b-a97d-4d5c-85e7-841984c902d6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:50.983795 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b495d56b-a97d-4d5c-85e7-841984c902d6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.154371 Jan 11 15:21:50.984362 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 673/1337] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:50 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:50.988593 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f21fa113-77ac-4b01-abd1-6aef2e6e8aa0 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:50.989205 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f21fa113-77ac-4b01-abd1-6aef2e6e8aa0 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:51.041111 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f21fa113-77ac-4b01-abd1-6aef2e6e8aa0 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:51.047939 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f21fa113-77ac-4b01-abd1-6aef2e6e8aa0 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08" status: 200 len: 1238 microversion: 2.1 time: 0.062561 Jan 11 15:21:51.048511 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 674/1338] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:50 2022] GET /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08 => generated 1238 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:51.835789 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c7542e1a-ad1e-409d-b314-7c1508a74ebd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:51.836376 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c7542e1a-ad1e-409d-b314-7c1508a74ebd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:51.842273 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c7542e1a-ad1e-409d-b314-7c1508a74ebd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:51.842723 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c7542e1a-ad1e-409d-b314-7c1508a74ebd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:51.843553 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c7542e1a-ad1e-409d-b314-7c1508a74ebd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:51.843987 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c7542e1a-ad1e-409d-b314-7c1508a74ebd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:51.909396 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c7542e1a-ad1e-409d-b314-7c1508a74ebd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:51.917484 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c7542e1a-ad1e-409d-b314-7c1508a74ebd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:51.919658 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c7542e1a-ad1e-409d-b314-7c1508a74ebd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:51.920797 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c7542e1a-ad1e-409d-b314-7c1508a74ebd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60" status: 200 len: 1333 microversion: 2.20 time: 0.088840 Jan 11 15:21:51.921348 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 675/1339] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:21:51 2022] GET /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60 => generated 1333 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 15:21:52.001297 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e3c67a7a-a65f-4fc8-9daa-e97d5e8543a8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:52.001903 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e3c67a7a-a65f-4fc8-9daa-e97d5e8543a8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:52.007614 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e3c67a7a-a65f-4fc8-9daa-e97d5e8543a8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:52.008064 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e3c67a7a-a65f-4fc8-9daa-e97d5e8543a8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:52.008829 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e3c67a7a-a65f-4fc8-9daa-e97d5e8543a8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:52.009264 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e3c67a7a-a65f-4fc8-9daa-e97d5e8543a8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:52.142816 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e3c67a7a-a65f-4fc8-9daa-e97d5e8543a8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:52.153824 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e3c67a7a-a65f-4fc8-9daa-e97d5e8543a8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.156184 Jan 11 15:21:52.154731 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 676/1340] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:51 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:21:52.158869 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f0e41e2d-299e-49da-9c94-13b446b46bd7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:52.159454 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f0e41e2d-299e-49da-9c94-13b446b46bd7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:52.165324 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f0e41e2d-299e-49da-9c94-13b446b46bd7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:52.165785 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f0e41e2d-299e-49da-9c94-13b446b46bd7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:52.166572 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f0e41e2d-299e-49da-9c94-13b446b46bd7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:52.167095 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f0e41e2d-299e-49da-9c94-13b446b46bd7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:52.229000 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f0e41e2d-299e-49da-9c94-13b446b46bd7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:52.238447 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f0e41e2d-299e-49da-9c94-13b446b46bd7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08" status: 200 len: 1234 microversion: 2.1 time: 0.082783 Jan 11 15:21:52.239047 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 677/1341] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:52 2022] GET /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08 => generated 1234 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:52.940188 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-874d8f1b-326c-4997-8334-2156c21ca4a1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:52.940941 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-874d8f1b-326c-4997-8334-2156c21ca4a1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:52.947659 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-874d8f1b-326c-4997-8334-2156c21ca4a1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:52.948105 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-874d8f1b-326c-4997-8334-2156c21ca4a1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:52.949979 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-874d8f1b-326c-4997-8334-2156c21ca4a1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:52.950591 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-874d8f1b-326c-4997-8334-2156c21ca4a1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:53.194181 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-874d8f1b-326c-4997-8334-2156c21ca4a1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:53.210056 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-874d8f1b-326c-4997-8334-2156c21ca4a1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:53.213994 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-874d8f1b-326c-4997-8334-2156c21ca4a1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:53.215193 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-874d8f1b-326c-4997-8334-2156c21ca4a1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60" status: 200 len: 1407 microversion: 2.20 time: 0.280512 Jan 11 15:21:53.222753 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 678/1342] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:21:52 2022] GET /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60 => generated 1407 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 15:21:53.226139 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5cfd7d9a-e86d-4065-ac01-6616cf8d1179 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:53.226748 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5cfd7d9a-e86d-4065-ac01-6616cf8d1179 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:53.237042 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5cfd7d9a-e86d-4065-ac01-6616cf8d1179 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:53.237494 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5cfd7d9a-e86d-4065-ac01-6616cf8d1179 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:53.238307 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5cfd7d9a-e86d-4065-ac01-6616cf8d1179 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:53.238978 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5cfd7d9a-e86d-4065-ac01-6616cf8d1179 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:53.464914 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-5cfd7d9a-e86d-4065-ac01-6616cf8d1179 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:53.472268 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5cfd7d9a-e86d-4065-ac01-6616cf8d1179 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.252964 Jan 11 15:21:53.472920 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 679/1343] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:53 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:53.477105 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f3aa58fe-ef06-4762-af82-4b0cb33c2234 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:53.477707 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f3aa58fe-ef06-4762-af82-4b0cb33c2234 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:53.483896 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f3aa58fe-ef06-4762-af82-4b0cb33c2234 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:53.488206 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f3aa58fe-ef06-4762-af82-4b0cb33c2234 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:53.488206 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f3aa58fe-ef06-4762-af82-4b0cb33c2234 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:53.488206 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f3aa58fe-ef06-4762-af82-4b0cb33c2234 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:53.582064 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f3aa58fe-ef06-4762-af82-4b0cb33c2234 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:53.593508 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f3aa58fe-ef06-4762-af82-4b0cb33c2234 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08" status: 200 len: 1296 microversion: 2.1 time: 0.119591 Jan 11 15:21:53.595267 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 680/1344] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:53 2022] GET /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08 => generated 1296 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:53.863772 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-8d4113b9-aa57-46ed-a9e7-9db5a87a04a7 req-34e23d97-8d13-4237-ab95-f4d8d8ae49f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b985a02a-bb5c-4090-be39-c0f345538f60", "tag": "dd8f847b-635b-4dd4-ad83-c81b71ea0393"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:21:53.867460 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:21:53.867460 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:21:53.883378 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-8d4113b9-aa57-46ed-a9e7-9db5a87a04a7 req-34e23d97-8d13-4237-ab95-f4d8d8ae49f4 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:53.885627 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-8d4113b9-aa57-46ed-a9e7-9db5a87a04a7 req-34e23d97-8d13-4237-ab95-f4d8d8ae49f4 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:53.904774 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-8d4113b9-aa57-46ed-a9e7-9db5a87a04a7 req-34e23d97-8d13-4237-ab95-f4d8d8ae49f4 service nova] Creating event network-changed:dd8f847b-635b-4dd4-ad83-c81b71ea0393 for instance b985a02a-bb5c-4090-be39-c0f345538f60 on hv-cinder-82418 Jan 11 15:21:53.911043 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [req-8d4113b9-aa57-46ed-a9e7-9db5a87a04a7 req-34e23d97-8d13-4237-ab95-f4d8d8ae49f4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051085 Jan 11 15:21:53.912133 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 681/1345] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:21:54.237079 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3c29d16d-b04f-4041-9e3c-ce59e3f6e0c7 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:54.238595 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3c29d16d-b04f-4041-9e3c-ce59e3f6e0c7 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:54.245563 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c29d16d-b04f-4041-9e3c-ce59e3f6e0c7 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:54.246827 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c29d16d-b04f-4041-9e3c-ce59e3f6e0c7 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:54.247701 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c29d16d-b04f-4041-9e3c-ce59e3f6e0c7 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:54.248150 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c29d16d-b04f-4041-9e3c-ce59e3f6e0c7 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:54.426459 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3c29d16d-b04f-4041-9e3c-ce59e3f6e0c7 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:54.434708 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3c29d16d-b04f-4041-9e3c-ce59e3f6e0c7 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:54.436240 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3c29d16d-b04f-4041-9e3c-ce59e3f6e0c7 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:54.437382 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3c29d16d-b04f-4041-9e3c-ce59e3f6e0c7 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60" status: 200 len: 1407 microversion: 2.20 time: 0.204707 Jan 11 15:21:54.438201 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 682/1346] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:21:54 2022] GET /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 15:21:54.489598 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ce2b928c-059b-4cbb-adc2-1bf6bcfb0841 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:54.500487 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ce2b928c-059b-4cbb-adc2-1bf6bcfb0841 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:54.507957 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ce2b928c-059b-4cbb-adc2-1bf6bcfb0841 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:54.510846 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ce2b928c-059b-4cbb-adc2-1bf6bcfb0841 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:54.512156 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ce2b928c-059b-4cbb-adc2-1bf6bcfb0841 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:54.512696 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ce2b928c-059b-4cbb-adc2-1bf6bcfb0841 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:54.724827 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ce2b928c-059b-4cbb-adc2-1bf6bcfb0841 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:54.732806 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ce2b928c-059b-4cbb-adc2-1bf6bcfb0841 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.246878 Jan 11 15:21:54.733372 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 683/1347] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:54 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:21:54.737640 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-296b4ea2-c033-4c48-9e8c-f5cff5c41532 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:54.738226 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-296b4ea2-c033-4c48-9e8c-f5cff5c41532 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:54.744065 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-296b4ea2-c033-4c48-9e8c-f5cff5c41532 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:54.744648 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-296b4ea2-c033-4c48-9e8c-f5cff5c41532 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:54.745453 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-296b4ea2-c033-4c48-9e8c-f5cff5c41532 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:54.745900 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-296b4ea2-c033-4c48-9e8c-f5cff5c41532 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:54.920667 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-296b4ea2-c033-4c48-9e8c-f5cff5c41532 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:54.930519 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-296b4ea2-c033-4c48-9e8c-f5cff5c41532 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08" status: 200 len: 1363 microversion: 2.1 time: 0.194386 Jan 11 15:21:54.944605 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 684/1348] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:54 2022] GET /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:54.950425 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-450c47d2-b989-4c0a-97a2-c3570045fa36 req-7313ea83-e006-4e95-89af-0479fd72e387 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d028c6b-fa47-42d1-859e-8576f3b3cb08", "tag": "ec1fb3ae-0012-43de-9cf3-275eb887651d"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:21:54.952043 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:21:54.952043 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:21:54.959123 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-450c47d2-b989-4c0a-97a2-c3570045fa36 req-7313ea83-e006-4e95-89af-0479fd72e387 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:54.962560 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-450c47d2-b989-4c0a-97a2-c3570045fa36 req-7313ea83-e006-4e95-89af-0479fd72e387 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:54.971967 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-450c47d2-b989-4c0a-97a2-c3570045fa36 req-7313ea83-e006-4e95-89af-0479fd72e387 service nova] Creating event network-changed:ec1fb3ae-0012-43de-9cf3-275eb887651d for instance 4d028c6b-fa47-42d1-859e-8576f3b3cb08 on hv-cinder-82418 Jan 11 15:21:54.976736 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [req-450c47d2-b989-4c0a-97a2-c3570045fa36 req-7313ea83-e006-4e95-89af-0479fd72e387 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030869 Jan 11 15:21:54.977341 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 685/1349] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:21:55.456469 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0481847a-04dd-40fe-90a5-a8d6efbb301c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:55.457170 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0481847a-04dd-40fe-90a5-a8d6efbb301c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:55.463255 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0481847a-04dd-40fe-90a5-a8d6efbb301c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:55.463784 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0481847a-04dd-40fe-90a5-a8d6efbb301c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:55.465089 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0481847a-04dd-40fe-90a5-a8d6efbb301c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:55.465537 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0481847a-04dd-40fe-90a5-a8d6efbb301c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:55.663150 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0481847a-04dd-40fe-90a5-a8d6efbb301c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:55.671517 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0481847a-04dd-40fe-90a5-a8d6efbb301c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:55.673016 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0481847a-04dd-40fe-90a5-a8d6efbb301c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:55.674109 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0481847a-04dd-40fe-90a5-a8d6efbb301c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60" status: 200 len: 1407 microversion: 2.20 time: 0.222092 Jan 11 15:21:55.674676 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 686/1350] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:21:55 2022] GET /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 15:21:55.749520 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-769146d5-144d-434f-9e52-2c3f2ef41e93 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:55.750130 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-769146d5-144d-434f-9e52-2c3f2ef41e93 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:55.755962 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-769146d5-144d-434f-9e52-2c3f2ef41e93 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:55.762108 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-769146d5-144d-434f-9e52-2c3f2ef41e93 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:55.762108 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-769146d5-144d-434f-9e52-2c3f2ef41e93 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:55.762108 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-769146d5-144d-434f-9e52-2c3f2ef41e93 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:55.884089 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-769146d5-144d-434f-9e52-2c3f2ef41e93 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:55.892133 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-769146d5-144d-434f-9e52-2c3f2ef41e93 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.146493 Jan 11 15:21:55.892726 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 687/1351] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:55 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:21:55.945139 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e405a7c9-4ef3-4fc5-b84a-e6602e534789 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:55.945751 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e405a7c9-4ef3-4fc5-b84a-e6602e534789 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:55.952558 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e405a7c9-4ef3-4fc5-b84a-e6602e534789 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:55.953012 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e405a7c9-4ef3-4fc5-b84a-e6602e534789 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:55.953795 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e405a7c9-4ef3-4fc5-b84a-e6602e534789 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:55.954246 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e405a7c9-4ef3-4fc5-b84a-e6602e534789 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:56.076623 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e405a7c9-4ef3-4fc5-b84a-e6602e534789 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:56.083882 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e405a7c9-4ef3-4fc5-b84a-e6602e534789 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08" status: 200 len: 1363 microversion: 2.1 time: 0.142205 Jan 11 15:21:56.084379 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 688/1352] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:55 2022] GET /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08 => generated 1363 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:21:56.691527 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-150e3be0-94c4-4c0e-9a4c-112a8deef363 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:56.692161 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-150e3be0-94c4-4c0e-9a4c-112a8deef363 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:56.698407 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-150e3be0-94c4-4c0e-9a4c-112a8deef363 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:56.698869 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-150e3be0-94c4-4c0e-9a4c-112a8deef363 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:56.700594 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-150e3be0-94c4-4c0e-9a4c-112a8deef363 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:56.701039 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-150e3be0-94c4-4c0e-9a4c-112a8deef363 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:56.825967 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-150e3be0-94c4-4c0e-9a4c-112a8deef363 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:56.833709 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-150e3be0-94c4-4c0e-9a4c-112a8deef363 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:56.835218 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-150e3be0-94c4-4c0e-9a4c-112a8deef363 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:56.836335 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-150e3be0-94c4-4c0e-9a4c-112a8deef363 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60" status: 200 len: 1407 microversion: 2.20 time: 0.148573 Jan 11 15:21:56.836893 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 689/1353] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:21:56 2022] GET /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 15:21:56.907858 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0ecf1a83-a541-44ab-8b65-66b31bf327f8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:56.908464 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0ecf1a83-a541-44ab-8b65-66b31bf327f8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:56.914201 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0ecf1a83-a541-44ab-8b65-66b31bf327f8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:56.914658 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0ecf1a83-a541-44ab-8b65-66b31bf327f8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:56.915469 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0ecf1a83-a541-44ab-8b65-66b31bf327f8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:56.915922 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0ecf1a83-a541-44ab-8b65-66b31bf327f8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:57.041799 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0ecf1a83-a541-44ab-8b65-66b31bf327f8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:57.049573 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0ecf1a83-a541-44ab-8b65-66b31bf327f8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.145139 Jan 11 15:21:57.050129 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 690/1354] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:56 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:21:57.099705 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8263e689-a8a2-418b-9caf-b80552609985 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:57.100324 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8263e689-a8a2-418b-9caf-b80552609985 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:57.106597 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8263e689-a8a2-418b-9caf-b80552609985 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:57.107045 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8263e689-a8a2-418b-9caf-b80552609985 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:57.107850 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8263e689-a8a2-418b-9caf-b80552609985 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:57.108291 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8263e689-a8a2-418b-9caf-b80552609985 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:57.233211 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-8263e689-a8a2-418b-9caf-b80552609985 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:57.240374 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8263e689-a8a2-418b-9caf-b80552609985 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08" status: 200 len: 1363 microversion: 2.1 time: 0.144011 Jan 11 15:21:57.240930 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 691/1355] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:57 2022] GET /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08 => generated 1363 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:21:57.853772 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-77bd23f6-95dd-4b2a-b4be-67ee1b484e47 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:57.854414 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-77bd23f6-95dd-4b2a-b4be-67ee1b484e47 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:57.860561 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-77bd23f6-95dd-4b2a-b4be-67ee1b484e47 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:57.861014 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-77bd23f6-95dd-4b2a-b4be-67ee1b484e47 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:57.861785 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-77bd23f6-95dd-4b2a-b4be-67ee1b484e47 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:57.862224 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-77bd23f6-95dd-4b2a-b4be-67ee1b484e47 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:57.992367 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-77bd23f6-95dd-4b2a-b4be-67ee1b484e47 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:58.000023 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-77bd23f6-95dd-4b2a-b4be-67ee1b484e47 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:58.001442 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-77bd23f6-95dd-4b2a-b4be-67ee1b484e47 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:58.002522 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-77bd23f6-95dd-4b2a-b4be-67ee1b484e47 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60" status: 200 len: 1407 microversion: 2.20 time: 0.152487 Jan 11 15:21:58.003364 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 692/1356] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:21:57 2022] GET /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 15:21:58.067002 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ab8be800-a3ef-45eb-9d35-8ca8a172e6ae tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:58.068162 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ab8be800-a3ef-45eb-9d35-8ca8a172e6ae tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:58.074367 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ab8be800-a3ef-45eb-9d35-8ca8a172e6ae tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:58.075156 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ab8be800-a3ef-45eb-9d35-8ca8a172e6ae tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:58.075961 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ab8be800-a3ef-45eb-9d35-8ca8a172e6ae tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:58.076579 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ab8be800-a3ef-45eb-9d35-8ca8a172e6ae tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:58.201746 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ab8be800-a3ef-45eb-9d35-8ca8a172e6ae tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:58.208866 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ab8be800-a3ef-45eb-9d35-8ca8a172e6ae tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.146709 Jan 11 15:21:58.209425 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 693/1357] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:58 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:21:58.256752 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-28b54662-a94a-4547-8619-d79b5ff90322 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:58.257764 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-28b54662-a94a-4547-8619-d79b5ff90322 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:58.263105 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-28b54662-a94a-4547-8619-d79b5ff90322 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:58.263596 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-28b54662-a94a-4547-8619-d79b5ff90322 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:58.264371 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-28b54662-a94a-4547-8619-d79b5ff90322 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:58.264809 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-28b54662-a94a-4547-8619-d79b5ff90322 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:58.393167 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-28b54662-a94a-4547-8619-d79b5ff90322 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:58.400316 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-28b54662-a94a-4547-8619-d79b5ff90322 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08" status: 200 len: 1363 microversion: 2.1 time: 0.146981 Jan 11 15:21:58.400887 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 694/1358] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:58 2022] GET /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:21:59.020746 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b17f7b9a-f9ce-483a-b48f-4776bf432ba8 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:59.021424 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b17f7b9a-f9ce-483a-b48f-4776bf432ba8 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:59.027631 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b17f7b9a-f9ce-483a-b48f-4776bf432ba8 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:59.028080 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b17f7b9a-f9ce-483a-b48f-4776bf432ba8 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:59.028860 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b17f7b9a-f9ce-483a-b48f-4776bf432ba8 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:59.029297 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b17f7b9a-f9ce-483a-b48f-4776bf432ba8 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:59.151664 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b17f7b9a-f9ce-483a-b48f-4776bf432ba8 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:59.159398 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b17f7b9a-f9ce-483a-b48f-4776bf432ba8 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:59.160871 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b17f7b9a-f9ce-483a-b48f-4776bf432ba8 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:59.161947 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b17f7b9a-f9ce-483a-b48f-4776bf432ba8 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60" status: 200 len: 1407 microversion: 2.20 time: 0.144910 Jan 11 15:21:59.162706 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 695/1359] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:21:59 2022] GET /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60 => generated 1407 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 15:21:59.225304 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f52edd0a-dcae-4c58-a0fc-6565f6a0aa96 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:59.225900 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f52edd0a-dcae-4c58-a0fc-6565f6a0aa96 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:59.232275 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f52edd0a-dcae-4c58-a0fc-6565f6a0aa96 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:59.232726 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f52edd0a-dcae-4c58-a0fc-6565f6a0aa96 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:59.233500 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f52edd0a-dcae-4c58-a0fc-6565f6a0aa96 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:59.233937 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f52edd0a-dcae-4c58-a0fc-6565f6a0aa96 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:59.365546 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f52edd0a-dcae-4c58-a0fc-6565f6a0aa96 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:59.373228 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f52edd0a-dcae-4c58-a0fc-6565f6a0aa96 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.151389 Jan 11 15:21:59.373789 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 696/1360] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:59 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:21:59.416585 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-fce18e55-55a0-4187-9734-2f97bd0670a8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:21:59.417115 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-fce18e55-55a0-4187-9734-2f97bd0670a8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:21:59.423261 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fce18e55-55a0-4187-9734-2f97bd0670a8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:59.423738 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fce18e55-55a0-4187-9734-2f97bd0670a8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:59.424509 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fce18e55-55a0-4187-9734-2f97bd0670a8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:21:59.424947 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fce18e55-55a0-4187-9734-2f97bd0670a8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:21:59.546779 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-fce18e55-55a0-4187-9734-2f97bd0670a8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:21:59.553857 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-fce18e55-55a0-4187-9734-2f97bd0670a8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08" status: 200 len: 1363 microversion: 2.1 time: 0.140667 Jan 11 15:21:59.554415 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 697/1361] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:21:59 2022] GET /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08 => generated 1363 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:22:00.124675 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-e24ee1df-0fbe-4b0e-b892-217393a688a4 req-92abe96f-ca5e-4ebf-80bc-7c83d1aaf8c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b985a02a-bb5c-4090-be39-c0f345538f60", "name": "network-vif-plugged", "status": "completed", "tag": "dd8f847b-635b-4dd4-ad83-c81b71ea0393"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:00.126253 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:22:00.126253 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:22:00.133438 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-e24ee1df-0fbe-4b0e-b892-217393a688a4 req-92abe96f-ca5e-4ebf-80bc-7c83d1aaf8c5 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:00.133880 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-e24ee1df-0fbe-4b0e-b892-217393a688a4 req-92abe96f-ca5e-4ebf-80bc-7c83d1aaf8c5 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:00.144998 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-e24ee1df-0fbe-4b0e-b892-217393a688a4 req-92abe96f-ca5e-4ebf-80bc-7c83d1aaf8c5 service nova] Creating event network-vif-plugged:dd8f847b-635b-4dd4-ad83-c81b71ea0393 for instance b985a02a-bb5c-4090-be39-c0f345538f60 on hv-cinder-82418 Jan 11 15:22:00.149984 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [req-e24ee1df-0fbe-4b0e-b892-217393a688a4 req-92abe96f-ca5e-4ebf-80bc-7c83d1aaf8c5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028975 Jan 11 15:22:00.150554 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 698/1362] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:22:00.179809 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-02180c1b-8b2c-44f7-89d4-067611967d68 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:00.180604 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-02180c1b-8b2c-44f7-89d4-067611967d68 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:00.186717 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-02180c1b-8b2c-44f7-89d4-067611967d68 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:00.187166 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-02180c1b-8b2c-44f7-89d4-067611967d68 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:00.187977 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-02180c1b-8b2c-44f7-89d4-067611967d68 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:00.188418 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-02180c1b-8b2c-44f7-89d4-067611967d68 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:00.330806 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-02180c1b-8b2c-44f7-89d4-067611967d68 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:00.338508 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-02180c1b-8b2c-44f7-89d4-067611967d68 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:00.340653 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-02180c1b-8b2c-44f7-89d4-067611967d68 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:00.341734 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-02180c1b-8b2c-44f7-89d4-067611967d68 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60" status: 200 len: 1407 microversion: 2.20 time: 0.165923 Jan 11 15:22:00.342284 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 699/1363] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:22:00 2022] GET /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 15:22:00.390069 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2d3905b6-af6f-42a7-bc6a-09061b633624 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:00.390673 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2d3905b6-af6f-42a7-bc6a-09061b633624 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:00.396561 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2d3905b6-af6f-42a7-bc6a-09061b633624 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:00.400690 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2d3905b6-af6f-42a7-bc6a-09061b633624 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:00.400690 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2d3905b6-af6f-42a7-bc6a-09061b633624 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:00.400690 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2d3905b6-af6f-42a7-bc6a-09061b633624 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:00.565668 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-2d3905b6-af6f-42a7-bc6a-09061b633624 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:00.572990 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2d3905b6-af6f-42a7-bc6a-09061b633624 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.187148 Jan 11 15:22:00.573560 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 700/1364] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:00 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:22:00.578783 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3733179c-feda-476c-8b9c-2ad6a7eb577c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:00.579338 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3733179c-feda-476c-8b9c-2ad6a7eb577c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:00.586706 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3733179c-feda-476c-8b9c-2ad6a7eb577c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:00.587157 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3733179c-feda-476c-8b9c-2ad6a7eb577c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:00.588055 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3733179c-feda-476c-8b9c-2ad6a7eb577c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:00.588492 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3733179c-feda-476c-8b9c-2ad6a7eb577c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:00.716785 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3733179c-feda-476c-8b9c-2ad6a7eb577c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:00.724097 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3733179c-feda-476c-8b9c-2ad6a7eb577c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08" status: 200 len: 1363 microversion: 2.1 time: 0.148715 Jan 11 15:22:00.724674 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 701/1365] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:00 2022] GET /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:22:01.359839 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e28517e2-a357-443c-aa85-b88b4346ecc3 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:01.360502 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e28517e2-a357-443c-aa85-b88b4346ecc3 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:01.366745 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e28517e2-a357-443c-aa85-b88b4346ecc3 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:01.367195 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e28517e2-a357-443c-aa85-b88b4346ecc3 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:01.368009 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e28517e2-a357-443c-aa85-b88b4346ecc3 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:01.368454 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e28517e2-a357-443c-aa85-b88b4346ecc3 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:01.491722 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e28517e2-a357-443c-aa85-b88b4346ecc3 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:01.499382 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e28517e2-a357-443c-aa85-b88b4346ecc3 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:01.500920 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e28517e2-a357-443c-aa85-b88b4346ecc3 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:01.502010 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e28517e2-a357-443c-aa85-b88b4346ecc3 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60" status: 200 len: 1407 microversion: 2.20 time: 0.145885 Jan 11 15:22:01.502565 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 702/1366] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:22:01 2022] GET /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60 => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 15:22:01.590899 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a1f0f455-d01c-4e18-b867-b94cb2a36db1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:01.591488 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a1f0f455-d01c-4e18-b867-b94cb2a36db1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:01.597052 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a1f0f455-d01c-4e18-b867-b94cb2a36db1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:01.597506 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a1f0f455-d01c-4e18-b867-b94cb2a36db1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:01.598293 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a1f0f455-d01c-4e18-b867-b94cb2a36db1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:01.598739 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a1f0f455-d01c-4e18-b867-b94cb2a36db1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:01.729484 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a1f0f455-d01c-4e18-b867-b94cb2a36db1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:01.736830 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a1f0f455-d01c-4e18-b867-b94cb2a36db1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.149958 Jan 11 15:22:01.737390 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 703/1367] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:01 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:22:01.741561 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-dee7d9fd-a46d-4c21-aa3d-3381d5b097a8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:01.742161 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-dee7d9fd-a46d-4c21-aa3d-3381d5b097a8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:01.747829 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dee7d9fd-a46d-4c21-aa3d-3381d5b097a8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:01.748282 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dee7d9fd-a46d-4c21-aa3d-3381d5b097a8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:01.749059 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dee7d9fd-a46d-4c21-aa3d-3381d5b097a8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:01.749494 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dee7d9fd-a46d-4c21-aa3d-3381d5b097a8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:01.875922 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-dee7d9fd-a46d-4c21-aa3d-3381d5b097a8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:01.883122 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-dee7d9fd-a46d-4c21-aa3d-3381d5b097a8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08" status: 200 len: 1363 microversion: 2.1 time: 0.144799 Jan 11 15:22:01.883705 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 704/1368] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:01 2022] GET /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08 => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:22:02.164678 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-65402dd9-5988-42b0-b59c-8d5506124773 req-bc019950-28ad-4abc-a4ea-7d48fcd5f9fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d028c6b-fa47-42d1-859e-8576f3b3cb08", "name": "network-vif-plugged", "status": "completed", "tag": "ec1fb3ae-0012-43de-9cf3-275eb887651d"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:02.166853 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:22:02.166853 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:22:02.175216 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-65402dd9-5988-42b0-b59c-8d5506124773 req-bc019950-28ad-4abc-a4ea-7d48fcd5f9fb service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:02.175712 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-65402dd9-5988-42b0-b59c-8d5506124773 req-bc019950-28ad-4abc-a4ea-7d48fcd5f9fb service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:02.188800 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-65402dd9-5988-42b0-b59c-8d5506124773 req-bc019950-28ad-4abc-a4ea-7d48fcd5f9fb service nova] Creating event network-vif-plugged:ec1fb3ae-0012-43de-9cf3-275eb887651d for instance 4d028c6b-fa47-42d1-859e-8576f3b3cb08 on hv-cinder-82418 Jan 11 15:22:02.194007 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [req-65402dd9-5988-42b0-b59c-8d5506124773 req-bc019950-28ad-4abc-a4ea-7d48fcd5f9fb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033085 Jan 11 15:22:02.194717 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 705/1369] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:22:02.520613 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-cc90a828-5e25-4eb4-8ca7-df80efaf30e9 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:02.521301 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-cc90a828-5e25-4eb4-8ca7-df80efaf30e9 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:02.527877 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cc90a828-5e25-4eb4-8ca7-df80efaf30e9 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:02.528328 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cc90a828-5e25-4eb4-8ca7-df80efaf30e9 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:02.529300 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cc90a828-5e25-4eb4-8ca7-df80efaf30e9 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:02.529738 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cc90a828-5e25-4eb4-8ca7-df80efaf30e9 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:02.889530 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-cc90a828-5e25-4eb4-8ca7-df80efaf30e9 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:02.897703 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-cc90a828-5e25-4eb4-8ca7-df80efaf30e9 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:02.899177 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-cc90a828-5e25-4eb4-8ca7-df80efaf30e9 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '055cca7e9794424a8962422a9b5dda1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f9437149e449d6b1d1d9a69601b197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:02.900346 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-cc90a828-5e25-4eb4-8ca7-df80efaf30e9 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60" status: 200 len: 1599 microversion: 2.20 time: 0.383908 Jan 11 15:22:02.900892 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 706/1370] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:22:02 2022] GET /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60 => generated 1599 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 15:22:02.905060 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8b429959-1352-4c19-b529-c231e66c1be7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:02.905657 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8b429959-1352-4c19-b529-c231e66c1be7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:02.911915 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8b429959-1352-4c19-b529-c231e66c1be7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:02.912463 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8b429959-1352-4c19-b529-c231e66c1be7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:02.916664 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8b429959-1352-4c19-b529-c231e66c1be7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:02.916664 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8b429959-1352-4c19-b529-c231e66c1be7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:03.039995 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-8b429959-1352-4c19-b529-c231e66c1be7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:03.048012 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8b429959-1352-4c19-b529-c231e66c1be7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.146180 Jan 11 15:22:03.048577 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 707/1371] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:02 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:22:03.052789 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-117141eb-dc79-418e-978e-d7d64b8d8e30 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:03.053386 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-117141eb-dc79-418e-978e-d7d64b8d8e30 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:03.059344 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-117141eb-dc79-418e-978e-d7d64b8d8e30 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:03.059797 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-117141eb-dc79-418e-978e-d7d64b8d8e30 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:03.060567 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-117141eb-dc79-418e-978e-d7d64b8d8e30 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:03.061004 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-117141eb-dc79-418e-978e-d7d64b8d8e30 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:03.186847 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-117141eb-dc79-418e-978e-d7d64b8d8e30 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:03.194224 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-117141eb-dc79-418e-978e-d7d64b8d8e30 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08" status: 200 len: 1363 microversion: 2.1 time: 0.144666 Jan 11 15:22:03.194800 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 708/1372] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:03 2022] GET /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08 => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:22:03.199924 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f4b2f3d8-c003-4cdb-a61c-8e67be5bb918 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:03.200500 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f4b2f3d8-c003-4cdb-a61c-8e67be5bb918 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:03.207030 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f4b2f3d8-c003-4cdb-a61c-8e67be5bb918 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:03.207574 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f4b2f3d8-c003-4cdb-a61c-8e67be5bb918 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:03.208365 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f4b2f3d8-c003-4cdb-a61c-8e67be5bb918 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:03.209553 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f4b2f3d8-c003-4cdb-a61c-8e67be5bb918 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:03.285383 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f4b2f3d8-c003-4cdb-a61c-8e67be5bb918 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089219 Jan 11 15:22:03.288859 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 709/1373] 10.222.0.52 () {60 vars in 1315 bytes} [Tue Jan 11 15:22:03 2022] GET /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:22:04.064825 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3ca8a3cb-d407-46f9-8a32-1a33def43e60 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:04.065553 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3ca8a3cb-d407-46f9-8a32-1a33def43e60 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:04.071905 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3ca8a3cb-d407-46f9-8a32-1a33def43e60 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:04.072460 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3ca8a3cb-d407-46f9-8a32-1a33def43e60 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:04.073252 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3ca8a3cb-d407-46f9-8a32-1a33def43e60 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:04.074208 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3ca8a3cb-d407-46f9-8a32-1a33def43e60 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:04.302502 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3ca8a3cb-d407-46f9-8a32-1a33def43e60 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:04.310705 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3ca8a3cb-d407-46f9-8a32-1a33def43e60 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.249596 Jan 11 15:22:04.311272 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 710/1374] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:04 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:22:04.315644 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-eb126457-a32d-45ba-bdb8-a575fe50e378 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:04.316061 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-eb126457-a32d-45ba-bdb8-a575fe50e378 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:04.321688 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-eb126457-a32d-45ba-bdb8-a575fe50e378 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:04.324919 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-eb126457-a32d-45ba-bdb8-a575fe50e378 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:04.324919 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-eb126457-a32d-45ba-bdb8-a575fe50e378 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:04.324919 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-eb126457-a32d-45ba-bdb8-a575fe50e378 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:04.453929 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-eb126457-a32d-45ba-bdb8-a575fe50e378 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805c31cc5924c6d98c83718d1884440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d979bb0d7f04bbe99fa7215278f1051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:04.461538 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-eb126457-a32d-45ba-bdb8-a575fe50e378 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08" status: 200 len: 1550 microversion: 2.1 time: 0.149285 Jan 11 15:22:04.462102 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 711/1375] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:04 2022] GET /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08 => generated 1550 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:22:04.468259 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2fb6667c-b4e3-4c39-96d6-51328e6bdbfd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:04.468259 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2fb6667c-b4e3-4c39-96d6-51328e6bdbfd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:04.477254 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2fb6667c-b4e3-4c39-96d6-51328e6bdbfd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:04.477702 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2fb6667c-b4e3-4c39-96d6-51328e6bdbfd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:04.478474 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2fb6667c-b4e3-4c39-96d6-51328e6bdbfd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:04.478908 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2fb6667c-b4e3-4c39-96d6-51328e6bdbfd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:04.536917 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2fb6667c-b4e3-4c39-96d6-51328e6bdbfd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action" status: 200 len: 14 microversion: 2.20 time: 0.073588 Jan 11 15:22:04.537539 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 712/1376] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:22:04 2022] POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:22:04.542884 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-6157c3fa-bcce-4a3f-b8c1-27eabe7edcc7 req-0ddc3988-3433-4947-9bdc-46b8a433b496 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b985a02a-bb5c-4090-be39-c0f345538f60", "tag": "dd8f847b-635b-4dd4-ad83-c81b71ea0393"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:04.544439 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:22:04.544439 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:22:04.552183 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-6157c3fa-bcce-4a3f-b8c1-27eabe7edcc7 req-0ddc3988-3433-4947-9bdc-46b8a433b496 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:04.552625 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-6157c3fa-bcce-4a3f-b8c1-27eabe7edcc7 req-0ddc3988-3433-4947-9bdc-46b8a433b496 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:04.571136 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-6157c3fa-bcce-4a3f-b8c1-27eabe7edcc7 req-0ddc3988-3433-4947-9bdc-46b8a433b496 service nova] Creating event network-changed:dd8f847b-635b-4dd4-ad83-c81b71ea0393 for instance b985a02a-bb5c-4090-be39-c0f345538f60 on hv-cinder-82418 Jan 11 15:22:04.571693 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [req-6157c3fa-bcce-4a3f-b8c1-27eabe7edcc7 req-0ddc3988-3433-4947-9bdc-46b8a433b496 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032823 Jan 11 15:22:04.572305 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 713/1377] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:22:04.577788 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6016da88-317a-4d77-8d21-363bbf5fda50 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:04.578362 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6016da88-317a-4d77-8d21-363bbf5fda50 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:04.585898 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6016da88-317a-4d77-8d21-363bbf5fda50 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:04.586355 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6016da88-317a-4d77-8d21-363bbf5fda50 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:04.587144 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6016da88-317a-4d77-8d21-363bbf5fda50 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:04.587621 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6016da88-317a-4d77-8d21-363bbf5fda50 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:04.696038 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6016da88-317a-4d77-8d21-363bbf5fda50 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.122421 Jan 11 15:22:04.696806 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 714/1378] 10.222.0.52 () {58 vars in 1274 bytes} [Tue Jan 11 15:22:04 2022] GET /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/os-interface => generated 285 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:22:05.329397 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-610d26cc-919a-4619-9d9b-545ee795cd3f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:05.330095 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-610d26cc-919a-4619-9d9b-545ee795cd3f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:05.336221 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-610d26cc-919a-4619-9d9b-545ee795cd3f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:05.336676 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-610d26cc-919a-4619-9d9b-545ee795cd3f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:05.337474 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-610d26cc-919a-4619-9d9b-545ee795cd3f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:05.337950 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-610d26cc-919a-4619-9d9b-545ee795cd3f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:05.810591 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-610d26cc-919a-4619-9d9b-545ee795cd3f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:05.820590 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-610d26cc-919a-4619-9d9b-545ee795cd3f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.494979 Jan 11 15:22:05.829887 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 715/1379] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:05 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:22:05.829887 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-04596612-ea48-4df5-bba9-090c6a9c8931 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:05.829887 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-04596612-ea48-4df5-bba9-090c6a9c8931 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:05.837237 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-04596612-ea48-4df5-bba9-090c6a9c8931 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:05.837695 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-04596612-ea48-4df5-bba9-090c6a9c8931 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:05.838496 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-04596612-ea48-4df5-bba9-090c6a9c8931 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:05.838928 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-04596612-ea48-4df5-bba9-090c6a9c8931 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:05.907080 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-04596612-ea48-4df5-bba9-090c6a9c8931 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action" status: 200 len: 14 microversion: 2.20 time: 0.083775 Jan 11 15:22:05.908021 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 716/1380] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:22:05 2022] POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:22:06.218879 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2de2ac36-d168-44cb-a783-9d2c5a67e831 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:06.223139 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2de2ac36-d168-44cb-a783-9d2c5a67e831 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:06.228219 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2de2ac36-d168-44cb-a783-9d2c5a67e831 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:06.229055 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2de2ac36-d168-44cb-a783-9d2c5a67e831 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:06.229650 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2de2ac36-d168-44cb-a783-9d2c5a67e831 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:06.230148 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2de2ac36-d168-44cb-a783-9d2c5a67e831 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:06.298076 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2de2ac36-d168-44cb-a783-9d2c5a67e831 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action" status: 200 len: 14 microversion: 2.1 time: 0.085253 Jan 11 15:22:06.298729 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 717/1381] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:22:06 2022] POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 15:22:06.586503 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-459d2190-3486-4a96-8406-276af7f5a5ef req-b4841cdc-5b28-41a3-8084-661f70f363a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d028c6b-fa47-42d1-859e-8576f3b3cb08", "tag": "ec1fb3ae-0012-43de-9cf3-275eb887651d"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:06.588095 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:22:06.588095 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:22:06.596059 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-459d2190-3486-4a96-8406-276af7f5a5ef req-b4841cdc-5b28-41a3-8084-661f70f363a0 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:06.596587 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-459d2190-3486-4a96-8406-276af7f5a5ef req-b4841cdc-5b28-41a3-8084-661f70f363a0 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:06.607528 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-459d2190-3486-4a96-8406-276af7f5a5ef req-b4841cdc-5b28-41a3-8084-661f70f363a0 service nova] Creating event network-changed:ec1fb3ae-0012-43de-9cf3-275eb887651d for instance 4d028c6b-fa47-42d1-859e-8576f3b3cb08 on hv-cinder-82418 Jan 11 15:22:06.612679 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [req-459d2190-3486-4a96-8406-276af7f5a5ef req-b4841cdc-5b28-41a3-8084-661f70f363a0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030007 Jan 11 15:22:06.613548 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 718/1382] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:22:06.838469 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-40b209c5-1bdb-408c-9640-eec1cccd6580 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:06.839533 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-40b209c5-1bdb-408c-9640-eec1cccd6580 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:06.846174 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-40b209c5-1bdb-408c-9640-eec1cccd6580 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:06.846620 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-40b209c5-1bdb-408c-9640-eec1cccd6580 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:06.847669 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-40b209c5-1bdb-408c-9640-eec1cccd6580 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:06.848111 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-40b209c5-1bdb-408c-9640-eec1cccd6580 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:06.996726 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-40b209c5-1bdb-408c-9640-eec1cccd6580 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:07.004074 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-40b209c5-1bdb-408c-9640-eec1cccd6580 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.170049 Jan 11 15:22:07.004845 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 719/1383] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:06 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:22:07.008973 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d2ac8703-220f-4645-bad3-0a6230b44c1c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:07.009873 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d2ac8703-220f-4645-bad3-0a6230b44c1c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:07.018124 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d2ac8703-220f-4645-bad3-0a6230b44c1c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:07.018577 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d2ac8703-220f-4645-bad3-0a6230b44c1c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:07.019391 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d2ac8703-220f-4645-bad3-0a6230b44c1c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:07.019831 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d2ac8703-220f-4645-bad3-0a6230b44c1c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:07.082158 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d2ac8703-220f-4645-bad3-0a6230b44c1c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action" status: 200 len: 14 microversion: 2.20 time: 0.076230 Jan 11 15:22:07.083112 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 720/1384] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:22:07 2022] POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:22:07.310688 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2ba84b25-cd00-41b0-a4a6-6846e15ae602 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:07.311720 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2ba84b25-cd00-41b0-a4a6-6846e15ae602 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:07.318928 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2ba84b25-cd00-41b0-a4a6-6846e15ae602 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:07.319416 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2ba84b25-cd00-41b0-a4a6-6846e15ae602 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:07.320325 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2ba84b25-cd00-41b0-a4a6-6846e15ae602 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:07.320646 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2ba84b25-cd00-41b0-a4a6-6846e15ae602 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:07.378291 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2ba84b25-cd00-41b0-a4a6-6846e15ae602 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action" status: 200 len: 14 microversion: 2.1 time: 0.072297 Jan 11 15:22:07.378839 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 721/1385] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:22:07 2022] POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 11 15:22:08.021882 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6a0a95e5-f57b-44f3-8c65-a4d14612395f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:08.022579 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6a0a95e5-f57b-44f3-8c65-a4d14612395f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:08.029326 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6a0a95e5-f57b-44f3-8c65-a4d14612395f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:08.031165 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6a0a95e5-f57b-44f3-8c65-a4d14612395f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:08.031165 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6a0a95e5-f57b-44f3-8c65-a4d14612395f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:08.031165 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6a0a95e5-f57b-44f3-8c65-a4d14612395f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:08.161211 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6a0a95e5-f57b-44f3-8c65-a4d14612395f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:08.168987 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6a0a95e5-f57b-44f3-8c65-a4d14612395f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.151217 Jan 11 15:22:08.169546 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 722/1386] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:08 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:22:08.173789 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-aa11d597-666f-4455-ba25-9df95c1d331a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:08.174681 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-aa11d597-666f-4455-ba25-9df95c1d331a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:08.180078 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aa11d597-666f-4455-ba25-9df95c1d331a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:08.180531 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aa11d597-666f-4455-ba25-9df95c1d331a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:08.181307 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aa11d597-666f-4455-ba25-9df95c1d331a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:08.181746 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aa11d597-666f-4455-ba25-9df95c1d331a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:08.239674 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-aa11d597-666f-4455-ba25-9df95c1d331a tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action" status: 200 len: 14 microversion: 2.20 time: 0.068900 Jan 11 15:22:08.240290 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 723/1387] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:22:08 2022] POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action => generated 14 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:22:08.389548 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-10864ae5-05c4-4fc5-8935-747c5ca0fa35 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:08.390467 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-10864ae5-05c4-4fc5-8935-747c5ca0fa35 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:08.397261 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-10864ae5-05c4-4fc5-8935-747c5ca0fa35 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:08.397714 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-10864ae5-05c4-4fc5-8935-747c5ca0fa35 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:08.398493 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-10864ae5-05c4-4fc5-8935-747c5ca0fa35 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:08.398933 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-10864ae5-05c4-4fc5-8935-747c5ca0fa35 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:08.456543 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-10864ae5-05c4-4fc5-8935-747c5ca0fa35 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action" status: 200 len: 14 microversion: 2.1 time: 0.071003 Jan 11 15:22:08.457138 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 724/1388] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:22:08 2022] POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 11 15:22:09.185929 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-23073e52-a1d6-48e3-a2a8-c9299484df0e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:09.186554 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-23073e52-a1d6-48e3-a2a8-c9299484df0e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:09.193337 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-23073e52-a1d6-48e3-a2a8-c9299484df0e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:09.193786 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-23073e52-a1d6-48e3-a2a8-c9299484df0e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:09.194564 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-23073e52-a1d6-48e3-a2a8-c9299484df0e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:09.195003 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-23073e52-a1d6-48e3-a2a8-c9299484df0e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:09.326636 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-23073e52-a1d6-48e3-a2a8-c9299484df0e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:09.334685 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-23073e52-a1d6-48e3-a2a8-c9299484df0e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.152808 Jan 11 15:22:09.335249 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 725/1389] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:09 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:22:09.340293 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2f170c25-b3a1-42ba-90af-107ea3d40826 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:09.341187 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2f170c25-b3a1-42ba-90af-107ea3d40826 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:09.346926 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2f170c25-b3a1-42ba-90af-107ea3d40826 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:09.347430 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2f170c25-b3a1-42ba-90af-107ea3d40826 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:09.348215 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2f170c25-b3a1-42ba-90af-107ea3d40826 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:09.348658 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2f170c25-b3a1-42ba-90af-107ea3d40826 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:09.406253 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2f170c25-b3a1-42ba-90af-107ea3d40826 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action" status: 200 len: 14 microversion: 2.20 time: 0.069713 Jan 11 15:22:09.406896 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 726/1390] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:22:09 2022] POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:22:09.468131 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b37891c1-f930-4fca-9b1a-6fa9ca59320c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:09.469055 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b37891c1-f930-4fca-9b1a-6fa9ca59320c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:09.476174 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b37891c1-f930-4fca-9b1a-6fa9ca59320c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:09.476633 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b37891c1-f930-4fca-9b1a-6fa9ca59320c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:09.478532 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b37891c1-f930-4fca-9b1a-6fa9ca59320c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:09.478532 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b37891c1-f930-4fca-9b1a-6fa9ca59320c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:09.536044 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b37891c1-f930-4fca-9b1a-6fa9ca59320c tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action" status: 200 len: 14 microversion: 2.1 time: 0.072146 Jan 11 15:22:09.536649 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 727/1391] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:22:09 2022] POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 11 15:22:10.351733 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a395af31-dfcc-453b-8772-138f8f6552dd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:10.352363 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a395af31-dfcc-453b-8772-138f8f6552dd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:10.359202 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a395af31-dfcc-453b-8772-138f8f6552dd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:10.359680 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a395af31-dfcc-453b-8772-138f8f6552dd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:10.360459 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a395af31-dfcc-453b-8772-138f8f6552dd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:10.360908 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a395af31-dfcc-453b-8772-138f8f6552dd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:10.488485 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a395af31-dfcc-453b-8772-138f8f6552dd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:10.496761 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a395af31-dfcc-453b-8772-138f8f6552dd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.149160 Jan 11 15:22:10.497319 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 728/1392] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:10 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:22:10.502559 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8d761074-a8ba-4cad-8a34-201bbdbfd7e1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:10.503489 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8d761074-a8ba-4cad-8a34-201bbdbfd7e1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:10.508926 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8d761074-a8ba-4cad-8a34-201bbdbfd7e1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:10.509383 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8d761074-a8ba-4cad-8a34-201bbdbfd7e1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:10.510156 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8d761074-a8ba-4cad-8a34-201bbdbfd7e1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:10.510591 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8d761074-a8ba-4cad-8a34-201bbdbfd7e1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:10.565819 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8d761074-a8ba-4cad-8a34-201bbdbfd7e1 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action" status: 200 len: 14 microversion: 2.20 time: 0.066559 Jan 11 15:22:10.566408 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 729/1393] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:22:10 2022] POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action => generated 14 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:22:10.571082 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-56dc78bf-9357-4a1a-81a1-5e2a36a899ca tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:10.572095 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-56dc78bf-9357-4a1a-81a1-5e2a36a899ca tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:10.578877 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-56dc78bf-9357-4a1a-81a1-5e2a36a899ca tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:10.579356 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-56dc78bf-9357-4a1a-81a1-5e2a36a899ca tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:10.580127 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-56dc78bf-9357-4a1a-81a1-5e2a36a899ca tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:10.580566 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-56dc78bf-9357-4a1a-81a1-5e2a36a899ca tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:10.635369 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-56dc78bf-9357-4a1a-81a1-5e2a36a899ca tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action" status: 200 len: 14 microversion: 2.1 time: 0.067617 Jan 11 15:22:10.635897 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 730/1394] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:22:10 2022] POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action => generated 14 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 15:22:11.514463 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6be77738-f080-4662-ac42-a26799b9c77e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:11.515065 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6be77738-f080-4662-ac42-a26799b9c77e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:11.521899 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6be77738-f080-4662-ac42-a26799b9c77e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:11.522347 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6be77738-f080-4662-ac42-a26799b9c77e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:11.523111 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6be77738-f080-4662-ac42-a26799b9c77e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:11.523573 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6be77738-f080-4662-ac42-a26799b9c77e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:11.654308 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6be77738-f080-4662-ac42-a26799b9c77e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:11.661925 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6be77738-f080-4662-ac42-a26799b9c77e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.152100 Jan 11 15:22:11.662670 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 731/1395] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:11 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:22:11.667084 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-186cd54e-63b4-4e0c-8c51-b49819a02aff tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:11.667995 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-186cd54e-63b4-4e0c-8c51-b49819a02aff tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:11.673255 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-186cd54e-63b4-4e0c-8c51-b49819a02aff tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:11.673704 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-186cd54e-63b4-4e0c-8c51-b49819a02aff tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:11.674473 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-186cd54e-63b4-4e0c-8c51-b49819a02aff tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:11.674911 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-186cd54e-63b4-4e0c-8c51-b49819a02aff tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:11.734671 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-186cd54e-63b4-4e0c-8c51-b49819a02aff tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action" status: 200 len: 14 microversion: 2.20 time: 0.070590 Jan 11 15:22:11.735322 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 732/1396] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:22:11 2022] POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:22:11.740055 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ddff9c86-2efa-438f-889e-30afb8ac7220 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:11.741025 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ddff9c86-2efa-438f-889e-30afb8ac7220 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:11.747687 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ddff9c86-2efa-438f-889e-30afb8ac7220 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:11.748133 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ddff9c86-2efa-438f-889e-30afb8ac7220 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:11.748898 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ddff9c86-2efa-438f-889e-30afb8ac7220 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:11.749332 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ddff9c86-2efa-438f-889e-30afb8ac7220 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:11.804755 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ddff9c86-2efa-438f-889e-30afb8ac7220 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action" status: 200 len: 14 microversion: 2.1 time: 0.068055 Jan 11 15:22:11.805270 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 733/1397] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:22:11 2022] POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action => generated 14 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 15:22:12.679362 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b92f1b41-4f4a-4fb1-be4e-885e1011330c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:12.680008 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b92f1b41-4f4a-4fb1-be4e-885e1011330c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:12.686777 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b92f1b41-4f4a-4fb1-be4e-885e1011330c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:12.687208 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b92f1b41-4f4a-4fb1-be4e-885e1011330c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:12.688009 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b92f1b41-4f4a-4fb1-be4e-885e1011330c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:12.688452 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b92f1b41-4f4a-4fb1-be4e-885e1011330c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:12.816675 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b92f1b41-4f4a-4fb1-be4e-885e1011330c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:12.825113 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b92f1b41-4f4a-4fb1-be4e-885e1011330c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.149894 Jan 11 15:22:12.825674 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 734/1398] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:12 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:22:12.830014 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4f699c0f-7f96-40f8-9236-42f24c8dec9b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:12.830893 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-4f699c0f-7f96-40f8-9236-42f24c8dec9b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:12.836153 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4f699c0f-7f96-40f8-9236-42f24c8dec9b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:12.836603 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4f699c0f-7f96-40f8-9236-42f24c8dec9b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:12.837370 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4f699c0f-7f96-40f8-9236-42f24c8dec9b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:12.837824 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4f699c0f-7f96-40f8-9236-42f24c8dec9b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:12.895982 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4f699c0f-7f96-40f8-9236-42f24c8dec9b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action" status: 200 len: 14 microversion: 2.20 time: 0.069038 Jan 11 15:22:12.896641 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 735/1399] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:22:12 2022] POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action => generated 14 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:22:12.902096 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-21e0664b-58b4-4048-8196-5c750b7dd642 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:12.902971 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-21e0664b-58b4-4048-8196-5c750b7dd642 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:12.909637 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-21e0664b-58b4-4048-8196-5c750b7dd642 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:12.910173 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-21e0664b-58b4-4048-8196-5c750b7dd642 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:12.910955 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-21e0664b-58b4-4048-8196-5c750b7dd642 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:12.911423 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-21e0664b-58b4-4048-8196-5c750b7dd642 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:12.975975 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-21e0664b-58b4-4048-8196-5c750b7dd642 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action" status: 200 len: 14 microversion: 2.1 time: 0.077902 Jan 11 15:22:12.976530 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 736/1400] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:22:12 2022] POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 15:22:13.842091 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ab508e7b-4cf0-4a7a-b25f-8aca01139185 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:13.842781 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ab508e7b-4cf0-4a7a-b25f-8aca01139185 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:13.849522 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ab508e7b-4cf0-4a7a-b25f-8aca01139185 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:13.849963 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ab508e7b-4cf0-4a7a-b25f-8aca01139185 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:13.850729 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ab508e7b-4cf0-4a7a-b25f-8aca01139185 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:13.851190 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ab508e7b-4cf0-4a7a-b25f-8aca01139185 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:13.980661 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ab508e7b-4cf0-4a7a-b25f-8aca01139185 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:13.988266 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ab508e7b-4cf0-4a7a-b25f-8aca01139185 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.150219 Jan 11 15:22:13.988823 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 737/1401] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:13 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:22:13.993092 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6974e4ef-67e7-47ec-958d-6813409de738 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:13.993968 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6974e4ef-67e7-47ec-958d-6813409de738 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:13.999248 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6974e4ef-67e7-47ec-958d-6813409de738 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:13.999726 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6974e4ef-67e7-47ec-958d-6813409de738 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:14.000497 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6974e4ef-67e7-47ec-958d-6813409de738 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:14.000950 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6974e4ef-67e7-47ec-958d-6813409de738 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:14.065061 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6974e4ef-67e7-47ec-958d-6813409de738 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action" status: 200 len: 14 microversion: 2.20 time: 0.075082 Jan 11 15:22:14.065645 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 738/1402] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:22:13 2022] POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:22:14.070272 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a6b9b92a-e9e9-45df-9e83-b2e7671d16e8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:14.071236 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a6b9b92a-e9e9-45df-9e83-b2e7671d16e8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:14.077886 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a6b9b92a-e9e9-45df-9e83-b2e7671d16e8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:14.078334 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a6b9b92a-e9e9-45df-9e83-b2e7671d16e8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:14.079096 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a6b9b92a-e9e9-45df-9e83-b2e7671d16e8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:14.079698 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a6b9b92a-e9e9-45df-9e83-b2e7671d16e8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:14.139277 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a6b9b92a-e9e9-45df-9e83-b2e7671d16e8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action" status: 200 len: 14 microversion: 2.1 time: 0.072305 Jan 11 15:22:14.139815 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 739/1403] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:22:14 2022] POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 15:22:15.004739 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5e708eda-7bf7-4b65-891c-5608b846a423 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:15.005440 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5e708eda-7bf7-4b65-891c-5608b846a423 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:15.012767 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5e708eda-7bf7-4b65-891c-5608b846a423 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:15.013224 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5e708eda-7bf7-4b65-891c-5608b846a423 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:15.014002 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5e708eda-7bf7-4b65-891c-5608b846a423 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:15.014442 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5e708eda-7bf7-4b65-891c-5608b846a423 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:15.143460 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-5e708eda-7bf7-4b65-891c-5608b846a423 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:15.151221 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5e708eda-7bf7-4b65-891c-5608b846a423 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.150494 Jan 11 15:22:15.152367 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 740/1404] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:14 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:22:15.156631 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ef7caad1-7b50-4d7b-b74a-e1318b66b9bd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:15.157510 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ef7caad1-7b50-4d7b-b74a-e1318b66b9bd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:15.162877 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ef7caad1-7b50-4d7b-b74a-e1318b66b9bd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:15.163335 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ef7caad1-7b50-4d7b-b74a-e1318b66b9bd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:15.164108 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ef7caad1-7b50-4d7b-b74a-e1318b66b9bd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:15.164538 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ef7caad1-7b50-4d7b-b74a-e1318b66b9bd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:15.240906 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ef7caad1-7b50-4d7b-b74a-e1318b66b9bd tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action" status: 200 len: 11860 microversion: 2.20 time: 0.087313 Jan 11 15:22:15.241574 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 741/1405] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:22:15 2022] POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action => generated 11860 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:22:15.246747 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a2d16e26-0f1c-42a1-8530-7842bbe391f7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:15.247754 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a2d16e26-0f1c-42a1-8530-7842bbe391f7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:15.254715 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a2d16e26-0f1c-42a1-8530-7842bbe391f7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:15.255479 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a2d16e26-0f1c-42a1-8530-7842bbe391f7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:15.256111 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a2d16e26-0f1c-42a1-8530-7842bbe391f7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:15.256593 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a2d16e26-0f1c-42a1-8530-7842bbe391f7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:15.327134 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a2d16e26-0f1c-42a1-8530-7842bbe391f7 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action" status: 200 len: 14 microversion: 2.1 time: 0.084052 Jan 11 15:22:15.334918 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 742/1406] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:22:15 2022] POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 15:22:16.168973 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-26acd277-1f92-4b4c-b859-a47b44b948e7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:16.169665 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-26acd277-1f92-4b4c-b859-a47b44b948e7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:16.176648 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-26acd277-1f92-4b4c-b859-a47b44b948e7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:16.177098 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-26acd277-1f92-4b4c-b859-a47b44b948e7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:16.177875 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-26acd277-1f92-4b4c-b859-a47b44b948e7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:16.178318 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-26acd277-1f92-4b4c-b859-a47b44b948e7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:16.305833 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-26acd277-1f92-4b4c-b859-a47b44b948e7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:16.314144 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-26acd277-1f92-4b4c-b859-a47b44b948e7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.149191 Jan 11 15:22:16.314707 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 743/1407] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:16 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:22:16.318984 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8d39a6bf-a5fa-4d9d-80e4-1bc23a722a95 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:16.322424 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8d39a6bf-a5fa-4d9d-80e4-1bc23a722a95 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:16.326291 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8d39a6bf-a5fa-4d9d-80e4-1bc23a722a95 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:16.326748 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8d39a6bf-a5fa-4d9d-80e4-1bc23a722a95 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:16.327562 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8d39a6bf-a5fa-4d9d-80e4-1bc23a722a95 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:16.328055 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8d39a6bf-a5fa-4d9d-80e4-1bc23a722a95 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:16.398723 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8d39a6bf-a5fa-4d9d-80e4-1bc23a722a95 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action" status: 200 len: 18449 microversion: 2.20 time: 0.082771 Jan 11 15:22:16.400220 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 744/1408] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:22:16 2022] POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action => generated 18449 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:22:16.404247 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1a054815-36e9-49e1-9b5e-6cdbed35d3e5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:16.405366 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1a054815-36e9-49e1-9b5e-6cdbed35d3e5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:16.412198 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1a054815-36e9-49e1-9b5e-6cdbed35d3e5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:16.412647 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1a054815-36e9-49e1-9b5e-6cdbed35d3e5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:16.413417 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1a054815-36e9-49e1-9b5e-6cdbed35d3e5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:16.413850 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1a054815-36e9-49e1-9b5e-6cdbed35d3e5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:16.491619 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1a054815-36e9-49e1-9b5e-6cdbed35d3e5 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action" status: 200 len: 9290 microversion: 2.1 time: 0.090816 Jan 11 15:22:16.492140 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 745/1409] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:22:16 2022] POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action => generated 9290 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:22:17.331917 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0021a302-9725-4c07-8060-028bf3d3e5f6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:17.332609 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0021a302-9725-4c07-8060-028bf3d3e5f6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:17.339529 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0021a302-9725-4c07-8060-028bf3d3e5f6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:17.339977 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0021a302-9725-4c07-8060-028bf3d3e5f6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:17.340823 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0021a302-9725-4c07-8060-028bf3d3e5f6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:17.341357 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0021a302-9725-4c07-8060-028bf3d3e5f6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:17.471966 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0021a302-9725-4c07-8060-028bf3d3e5f6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:17.480222 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0021a302-9725-4c07-8060-028bf3d3e5f6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.151765 Jan 11 15:22:17.480777 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 746/1410] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:17 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:22:17.485146 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-36302caf-0c37-4fbc-825c-f05515be4cab tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:17.486031 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-36302caf-0c37-4fbc-825c-f05515be4cab tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:17.491394 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-36302caf-0c37-4fbc-825c-f05515be4cab tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:17.491842 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-36302caf-0c37-4fbc-825c-f05515be4cab tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:17.492610 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-36302caf-0c37-4fbc-825c-f05515be4cab tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:17.493050 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-36302caf-0c37-4fbc-825c-f05515be4cab tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:17.568016 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-36302caf-0c37-4fbc-825c-f05515be4cab tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action" status: 200 len: 19342 microversion: 2.20 time: 0.085959 Jan 11 15:22:17.568550 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 747/1411] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:22:17 2022] POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action => generated 19342 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:22:17.573852 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-46b7ef40-a6be-4c5d-8bcb-93f5d4b748f8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:17.575076 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-46b7ef40-a6be-4c5d-8bcb-93f5d4b748f8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:17.581677 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-46b7ef40-a6be-4c5d-8bcb-93f5d4b748f8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:17.582136 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-46b7ef40-a6be-4c5d-8bcb-93f5d4b748f8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:17.582918 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-46b7ef40-a6be-4c5d-8bcb-93f5d4b748f8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:17.583392 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-46b7ef40-a6be-4c5d-8bcb-93f5d4b748f8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:17.670383 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-46b7ef40-a6be-4c5d-8bcb-93f5d4b748f8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action" status: 200 len: 16877 microversion: 2.1 time: 0.100429 Jan 11 15:22:17.671013 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 748/1412] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:22:17 2022] POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action => generated 16877 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:22:18.497370 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6dc9a372-48f6-4b21-afbc-6f46faff171c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:18.498020 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6dc9a372-48f6-4b21-afbc-6f46faff171c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:18.504904 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6dc9a372-48f6-4b21-afbc-6f46faff171c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:18.505354 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6dc9a372-48f6-4b21-afbc-6f46faff171c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:18.506131 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6dc9a372-48f6-4b21-afbc-6f46faff171c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:18.506571 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6dc9a372-48f6-4b21-afbc-6f46faff171c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:18.637060 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6dc9a372-48f6-4b21-afbc-6f46faff171c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:18.644736 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6dc9a372-48f6-4b21-afbc-6f46faff171c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.151443 Jan 11 15:22:18.645294 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 749/1413] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:18 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:22:18.649512 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8cceea98-d446-4fec-a12b-869300de375d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:18.650393 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8cceea98-d446-4fec-a12b-869300de375d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:18.656271 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8cceea98-d446-4fec-a12b-869300de375d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:18.656716 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8cceea98-d446-4fec-a12b-869300de375d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:18.657481 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8cceea98-d446-4fec-a12b-869300de375d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:18.657917 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8cceea98-d446-4fec-a12b-869300de375d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:18.737761 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8cceea98-d446-4fec-a12b-869300de375d tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action" status: 200 len: 21840 microversion: 2.20 time: 0.091263 Jan 11 15:22:18.741432 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 750/1414] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:22:18 2022] POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action => generated 21840 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:22:18.743176 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3defd4c4-6a74-416e-8f23-d2352c4fe684 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:18.744158 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3defd4c4-6a74-416e-8f23-d2352c4fe684 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:18.750885 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3defd4c4-6a74-416e-8f23-d2352c4fe684 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:18.751276 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3defd4c4-6a74-416e-8f23-d2352c4fe684 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:18.752067 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3defd4c4-6a74-416e-8f23-d2352c4fe684 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:18.752501 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3defd4c4-6a74-416e-8f23-d2352c4fe684 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:18.838316 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3defd4c4-6a74-416e-8f23-d2352c4fe684 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action" status: 200 len: 18083 microversion: 2.1 time: 0.098647 Jan 11 15:22:18.839568 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 751/1415] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:22:18 2022] POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action => generated 18083 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:22:19.663048 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f3fedc01-4bf7-4b86-a6c4-51169136e937 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:19.663729 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f3fedc01-4bf7-4b86-a6c4-51169136e937 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:19.670458 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f3fedc01-4bf7-4b86-a6c4-51169136e937 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:19.670936 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f3fedc01-4bf7-4b86-a6c4-51169136e937 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:19.671735 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f3fedc01-4bf7-4b86-a6c4-51169136e937 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:19.672170 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f3fedc01-4bf7-4b86-a6c4-51169136e937 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:19.814790 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f3fedc01-4bf7-4b86-a6c4-51169136e937 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:19.825390 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f3fedc01-4bf7-4b86-a6c4-51169136e937 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.166374 Jan 11 15:22:19.825954 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 752/1416] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:19 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:22:19.830415 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-45060512-ad13-4116-bfd6-b026b2f3f7fc tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:19.831332 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-45060512-ad13-4116-bfd6-b026b2f3f7fc tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:19.838190 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-45060512-ad13-4116-bfd6-b026b2f3f7fc tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:19.839240 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-45060512-ad13-4116-bfd6-b026b2f3f7fc tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:19.840065 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-45060512-ad13-4116-bfd6-b026b2f3f7fc tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:19.840501 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-45060512-ad13-4116-bfd6-b026b2f3f7fc tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:19.913677 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-45060512-ad13-4116-bfd6-b026b2f3f7fc tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action" status: 200 len: 23235 microversion: 2.20 time: 0.086408 Jan 11 15:22:19.918683 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 753/1417] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:22:19 2022] POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action => generated 23235 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:22:19.919492 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e122a002-7985-423d-ace3-0248de00f03f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:19.920484 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e122a002-7985-423d-ace3-0248de00f03f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:19.927335 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e122a002-7985-423d-ace3-0248de00f03f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:19.927797 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e122a002-7985-423d-ace3-0248de00f03f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:19.928586 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e122a002-7985-423d-ace3-0248de00f03f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:19.929029 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e122a002-7985-423d-ace3-0248de00f03f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:20.005629 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e122a002-7985-423d-ace3-0248de00f03f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action" status: 200 len: 21112 microversion: 2.1 time: 0.090024 Jan 11 15:22:20.006295 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 754/1418] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:22:19 2022] POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action => generated 21112 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:22:20.842724 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4f82e085-a889-42f0-847c-0646fe9d48dd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:20.843451 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-4f82e085-a889-42f0-847c-0646fe9d48dd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:20.850231 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4f82e085-a889-42f0-847c-0646fe9d48dd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:20.850681 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4f82e085-a889-42f0-847c-0646fe9d48dd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:20.851496 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4f82e085-a889-42f0-847c-0646fe9d48dd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:20.851936 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4f82e085-a889-42f0-847c-0646fe9d48dd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:20.982001 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-4f82e085-a889-42f0-847c-0646fe9d48dd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:20.989683 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4f82e085-a889-42f0-847c-0646fe9d48dd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.151457 Jan 11 15:22:20.990264 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 755/1419] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:20 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:22:20.994544 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a81a614e-38b3-4569-a2f6-05d8754c41d4 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:20.995490 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a81a614e-38b3-4569-a2f6-05d8754c41d4 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:21.000871 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a81a614e-38b3-4569-a2f6-05d8754c41d4 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:21.001324 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a81a614e-38b3-4569-a2f6-05d8754c41d4 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:21.002092 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a81a614e-38b3-4569-a2f6-05d8754c41d4 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:21.002561 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a81a614e-38b3-4569-a2f6-05d8754c41d4 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:21.080309 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a81a614e-38b3-4569-a2f6-05d8754c41d4 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action" status: 200 len: 24562 microversion: 2.20 time: 0.088894 Jan 11 15:22:21.084922 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 756/1420] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:22:20 2022] POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action => generated 24562 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:22:21.086040 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3e8a498f-8a47-4517-bd8c-21236cc5f3b9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:21.087012 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3e8a498f-8a47-4517-bd8c-21236cc5f3b9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:21.094351 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3e8a498f-8a47-4517-bd8c-21236cc5f3b9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:21.094806 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3e8a498f-8a47-4517-bd8c-21236cc5f3b9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:21.095612 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3e8a498f-8a47-4517-bd8c-21236cc5f3b9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:21.096055 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3e8a498f-8a47-4517-bd8c-21236cc5f3b9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:21.164397 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3e8a498f-8a47-4517-bd8c-21236cc5f3b9 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action" status: 200 len: 23043 microversion: 2.1 time: 0.082084 Jan 11 15:22:21.164999 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 757/1421] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:22:21 2022] POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action => generated 23043 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:22:22.006758 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7dda292b-1d58-4831-a234-c2cde43e4c62 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:22.007470 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-7dda292b-1d58-4831-a234-c2cde43e4c62 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:22.014246 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7dda292b-1d58-4831-a234-c2cde43e4c62 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:22.014697 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7dda292b-1d58-4831-a234-c2cde43e4c62 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:22.015635 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7dda292b-1d58-4831-a234-c2cde43e4c62 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:22.016075 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7dda292b-1d58-4831-a234-c2cde43e4c62 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:22.154110 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-7dda292b-1d58-4831-a234-c2cde43e4c62 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:22.161334 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7dda292b-1d58-4831-a234-c2cde43e4c62 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.158618 Jan 11 15:22:22.161893 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 758/1422] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:22 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:22:22.166081 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a3e55b68-2a31-4506-a129-f64f3d84c6cb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:22.166961 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a3e55b68-2a31-4506-a129-f64f3d84c6cb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:22.172842 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a3e55b68-2a31-4506-a129-f64f3d84c6cb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:22.173295 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a3e55b68-2a31-4506-a129-f64f3d84c6cb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:22.174064 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a3e55b68-2a31-4506-a129-f64f3d84c6cb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:22.174498 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a3e55b68-2a31-4506-a129-f64f3d84c6cb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:22.255276 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a3e55b68-2a31-4506-a129-f64f3d84c6cb tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action" status: 200 len: 26067 microversion: 2.20 time: 0.092171 Jan 11 15:22:22.255939 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 759/1423] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:22:22 2022] POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action => generated 26067 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:22:22.260793 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-236f86a0-7ac5-43db-b06b-2ef726bde196 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:22.261771 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-236f86a0-7ac5-43db-b06b-2ef726bde196 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:22.268474 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-236f86a0-7ac5-43db-b06b-2ef726bde196 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:22.268926 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-236f86a0-7ac5-43db-b06b-2ef726bde196 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:22.269711 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-236f86a0-7ac5-43db-b06b-2ef726bde196 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:22.270155 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-236f86a0-7ac5-43db-b06b-2ef726bde196 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:22.345182 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-236f86a0-7ac5-43db-b06b-2ef726bde196 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action" status: 200 len: 24859 microversion: 2.1 time: 0.087859 Jan 11 15:22:22.345816 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 760/1424] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:22:22 2022] POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action => generated 24859 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:22:23.178170 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d203afa0-ae92-4443-a987-75fb41d74e5d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:23.178808 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d203afa0-ae92-4443-a987-75fb41d74e5d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:23.186093 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d203afa0-ae92-4443-a987-75fb41d74e5d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:23.186535 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d203afa0-ae92-4443-a987-75fb41d74e5d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:23.187342 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d203afa0-ae92-4443-a987-75fb41d74e5d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:23.187756 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d203afa0-ae92-4443-a987-75fb41d74e5d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:23.318016 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d203afa0-ae92-4443-a987-75fb41d74e5d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:23.326071 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d203afa0-ae92-4443-a987-75fb41d74e5d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.151931 Jan 11 15:22:23.326633 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 761/1425] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:23 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:22:23.330947 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-168dc625-f945-4e2e-9e76-29ec748c743c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:23.331873 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-168dc625-f945-4e2e-9e76-29ec748c743c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:23.337286 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-168dc625-f945-4e2e-9e76-29ec748c743c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:23.337739 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-168dc625-f945-4e2e-9e76-29ec748c743c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:23.338524 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-168dc625-f945-4e2e-9e76-29ec748c743c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:23.338968 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-168dc625-f945-4e2e-9e76-29ec748c743c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:23.421717 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-168dc625-f945-4e2e-9e76-29ec748c743c tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action" status: 200 len: 27235 microversion: 2.20 time: 0.093904 Jan 11 15:22:23.422364 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 762/1426] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:22:23 2022] POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action => generated 27235 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:22:23.427142 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-fe87f387-e442-428b-ba87-dd4433729171 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:23.428143 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-fe87f387-e442-428b-ba87-dd4433729171 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:23.435469 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fe87f387-e442-428b-ba87-dd4433729171 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:23.435865 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fe87f387-e442-428b-ba87-dd4433729171 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:23.436646 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fe87f387-e442-428b-ba87-dd4433729171 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:23.437087 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fe87f387-e442-428b-ba87-dd4433729171 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:23.513496 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-fe87f387-e442-428b-ba87-dd4433729171 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action" status: 200 len: 26441 microversion: 2.1 time: 0.089819 Jan 11 15:22:23.514109 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 763/1427] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:22:23 2022] POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action => generated 26441 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:22:24.342690 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0a1fb726-1f00-4ddb-a808-6a95d450f965 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:24.343495 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0a1fb726-1f00-4ddb-a808-6a95d450f965 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:24.350404 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0a1fb726-1f00-4ddb-a808-6a95d450f965 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:24.350859 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0a1fb726-1f00-4ddb-a808-6a95d450f965 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:24.351681 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0a1fb726-1f00-4ddb-a808-6a95d450f965 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:24.352126 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0a1fb726-1f00-4ddb-a808-6a95d450f965 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:24.482102 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0a1fb726-1f00-4ddb-a808-6a95d450f965 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:24.489830 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0a1fb726-1f00-4ddb-a808-6a95d450f965 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.151205 Jan 11 15:22:24.490386 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 764/1428] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:24 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:22:24.494814 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5bfc3e47-5fe6-4b3c-8258-b94d36ae2407 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:24.495721 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5bfc3e47-5fe6-4b3c-8258-b94d36ae2407 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:24.501569 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5bfc3e47-5fe6-4b3c-8258-b94d36ae2407 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:24.502015 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5bfc3e47-5fe6-4b3c-8258-b94d36ae2407 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:24.502784 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5bfc3e47-5fe6-4b3c-8258-b94d36ae2407 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:24.503216 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5bfc3e47-5fe6-4b3c-8258-b94d36ae2407 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:24.592474 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5bfc3e47-5fe6-4b3c-8258-b94d36ae2407 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action" status: 200 len: 27687 microversion: 2.20 time: 0.100858 Jan 11 15:22:24.596225 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 765/1429] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:22:24 2022] POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action => generated 27687 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:22:24.597910 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-83095fae-1e7f-4c53-94d1-97d6162d7195 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:24.598890 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-83095fae-1e7f-4c53-94d1-97d6162d7195 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:24.605653 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-83095fae-1e7f-4c53-94d1-97d6162d7195 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:24.606108 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-83095fae-1e7f-4c53-94d1-97d6162d7195 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:24.606955 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-83095fae-1e7f-4c53-94d1-97d6162d7195 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:24.607440 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-83095fae-1e7f-4c53-94d1-97d6162d7195 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:24.686477 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-83095fae-1e7f-4c53-94d1-97d6162d7195 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action" status: 200 len: 27529 microversion: 2.1 time: 0.092013 Jan 11 15:22:24.687107 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 766/1430] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:22:24 2022] POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action => generated 27529 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:22:25.509607 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c7af4741-73a9-4d82-a604-2feb2c9b257e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:25.510242 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c7af4741-73a9-4d82-a604-2feb2c9b257e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:25.517066 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c7af4741-73a9-4d82-a604-2feb2c9b257e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:25.517518 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c7af4741-73a9-4d82-a604-2feb2c9b257e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:25.518295 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c7af4741-73a9-4d82-a604-2feb2c9b257e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:25.518733 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c7af4741-73a9-4d82-a604-2feb2c9b257e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:25.653341 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c7af4741-73a9-4d82-a604-2feb2c9b257e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:25.660575 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c7af4741-73a9-4d82-a604-2feb2c9b257e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.155096 Jan 11 15:22:25.661137 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 767/1431] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:25 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:22:25.665536 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b0115de3-6f0c-4305-91b7-409ec084834b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:25.666477 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b0115de3-6f0c-4305-91b7-409ec084834b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:25.672368 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b0115de3-6f0c-4305-91b7-409ec084834b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:25.672813 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b0115de3-6f0c-4305-91b7-409ec084834b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:25.673586 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b0115de3-6f0c-4305-91b7-409ec084834b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:25.674017 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b0115de3-6f0c-4305-91b7-409ec084834b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:25.757121 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b0115de3-6f0c-4305-91b7-409ec084834b tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action" status: 200 len: 28072 microversion: 2.20 time: 0.094705 Jan 11 15:22:25.760995 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 768/1432] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:22:25 2022] POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action => generated 28072 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:22:25.762429 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8383a078-71f0-4b20-b0bc-1dfbf40bdea0 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:25.763449 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8383a078-71f0-4b20-b0bc-1dfbf40bdea0 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:25.770352 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8383a078-71f0-4b20-b0bc-1dfbf40bdea0 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:25.770798 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8383a078-71f0-4b20-b0bc-1dfbf40bdea0 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:25.771613 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8383a078-71f0-4b20-b0bc-1dfbf40bdea0 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:25.772047 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8383a078-71f0-4b20-b0bc-1dfbf40bdea0 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:25.879999 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8383a078-71f0-4b20-b0bc-1dfbf40bdea0 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action" status: 200 len: 27944 microversion: 2.1 time: 0.120908 Jan 11 15:22:25.880622 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 769/1433] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:22:25 2022] POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action => generated 27944 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:22:26.678079 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ae54a303-8b85-457b-a999-6bafb0b31621 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:26.678716 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ae54a303-8b85-457b-a999-6bafb0b31621 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:26.686066 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ae54a303-8b85-457b-a999-6bafb0b31621 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:26.686517 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ae54a303-8b85-457b-a999-6bafb0b31621 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:26.687307 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ae54a303-8b85-457b-a999-6bafb0b31621 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:26.687749 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ae54a303-8b85-457b-a999-6bafb0b31621 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:26.814757 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ae54a303-8b85-457b-a999-6bafb0b31621 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:26.822506 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ae54a303-8b85-457b-a999-6bafb0b31621 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.148486 Jan 11 15:22:26.823065 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 770/1434] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:26 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:22:26.828344 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b931bab0-ad7c-4faf-bc8a-1f1152780280 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:26.829259 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b931bab0-ad7c-4faf-bc8a-1f1152780280 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:26.834588 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b931bab0-ad7c-4faf-bc8a-1f1152780280 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:26.835039 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b931bab0-ad7c-4faf-bc8a-1f1152780280 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:26.835845 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b931bab0-ad7c-4faf-bc8a-1f1152780280 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:26.836285 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b931bab0-ad7c-4faf-bc8a-1f1152780280 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:26.911506 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b931bab0-ad7c-4faf-bc8a-1f1152780280 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action" status: 200 len: 28189 microversion: 2.20 time: 0.087193 Jan 11 15:22:26.912135 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 771/1435] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:22:26 2022] POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action => generated 28189 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:22:26.916931 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b211795c-4459-4113-bfa0-34cb573ecf15 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:26.917896 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b211795c-4459-4113-bfa0-34cb573ecf15 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:26.924564 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b211795c-4459-4113-bfa0-34cb573ecf15 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:26.925010 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b211795c-4459-4113-bfa0-34cb573ecf15 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:26.925785 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b211795c-4459-4113-bfa0-34cb573ecf15 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:26.926217 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b211795c-4459-4113-bfa0-34cb573ecf15 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:27.003950 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b211795c-4459-4113-bfa0-34cb573ecf15 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action" status: 200 len: 28239 microversion: 2.1 time: 0.090441 Jan 11 15:22:27.004497 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 772/1436] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:22:26 2022] POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action => generated 28239 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:22:27.840390 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-bcb52d4d-4fd4-426b-a11e-3f7f4c522cbd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:27.841678 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-bcb52d4d-4fd4-426b-a11e-3f7f4c522cbd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:27.848536 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bcb52d4d-4fd4-426b-a11e-3f7f4c522cbd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:27.848993 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bcb52d4d-4fd4-426b-a11e-3f7f4c522cbd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:27.849776 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bcb52d4d-4fd4-426b-a11e-3f7f4c522cbd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:27.850218 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bcb52d4d-4fd4-426b-a11e-3f7f4c522cbd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:27.980302 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-bcb52d4d-4fd4-426b-a11e-3f7f4c522cbd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:27.988025 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-bcb52d4d-4fd4-426b-a11e-3f7f4c522cbd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.151641 Jan 11 15:22:27.988590 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 773/1437] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:27 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:22:27.992911 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7cb044e6-fcb8-4b8b-8b0f-217e8642af5e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:27.993796 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-7cb044e6-fcb8-4b8b-8b0f-217e8642af5e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:27.999253 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7cb044e6-fcb8-4b8b-8b0f-217e8642af5e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:28.009843 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7cb044e6-fcb8-4b8b-8b0f-217e8642af5e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:28.009843 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7cb044e6-fcb8-4b8b-8b0f-217e8642af5e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:28.009843 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7cb044e6-fcb8-4b8b-8b0f-217e8642af5e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:28.063885 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7cb044e6-fcb8-4b8b-8b0f-217e8642af5e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action" status: 200 len: 28189 microversion: 2.20 time: 0.074085 Jan 11 15:22:28.064507 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 774/1438] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:22:27 2022] POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action => generated 28189 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:22:28.069311 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-512863ef-b4a2-4eb2-bd17-0a5aadf4ddf6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:28.070292 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-512863ef-b4a2-4eb2-bd17-0a5aadf4ddf6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:28.079001 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-512863ef-b4a2-4eb2-bd17-0a5aadf4ddf6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:28.080970 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-512863ef-b4a2-4eb2-bd17-0a5aadf4ddf6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:28.082949 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-512863ef-b4a2-4eb2-bd17-0a5aadf4ddf6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:28.083446 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-512863ef-b4a2-4eb2-bd17-0a5aadf4ddf6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:28.172388 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-512863ef-b4a2-4eb2-bd17-0a5aadf4ddf6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action" status: 200 len: 28239 microversion: 2.1 time: 0.106471 Jan 11 15:22:28.172930 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 775/1439] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:22:28 2022] POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action => generated 28239 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:22:29.005182 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d8cefcfb-22fc-4dbc-9e2e-319acf64d00f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:29.005886 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d8cefcfb-22fc-4dbc-9e2e-319acf64d00f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:29.012701 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d8cefcfb-22fc-4dbc-9e2e-319acf64d00f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:29.013159 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d8cefcfb-22fc-4dbc-9e2e-319acf64d00f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:29.013974 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d8cefcfb-22fc-4dbc-9e2e-319acf64d00f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:29.014423 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d8cefcfb-22fc-4dbc-9e2e-319acf64d00f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:29.144090 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d8cefcfb-22fc-4dbc-9e2e-319acf64d00f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:29.151859 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d8cefcfb-22fc-4dbc-9e2e-319acf64d00f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.150715 Jan 11 15:22:29.152457 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 776/1440] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:28 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:22:29.157240 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d2fe6287-29bc-41c7-80cf-723df7e899c9 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:29.158134 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d2fe6287-29bc-41c7-80cf-723df7e899c9 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:29.163586 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d2fe6287-29bc-41c7-80cf-723df7e899c9 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:29.164045 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d2fe6287-29bc-41c7-80cf-723df7e899c9 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:29.164829 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d2fe6287-29bc-41c7-80cf-723df7e899c9 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:29.165275 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d2fe6287-29bc-41c7-80cf-723df7e899c9 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:29.239715 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d2fe6287-29bc-41c7-80cf-723df7e899c9 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action" status: 200 len: 28189 microversion: 2.20 time: 0.085476 Jan 11 15:22:29.240375 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 777/1441] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:22:29 2022] POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action => generated 28189 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:22:29.245426 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-164f86d4-1cee-48f3-9130-188db88bc9c1 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:29.246409 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-164f86d4-1cee-48f3-9130-188db88bc9c1 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:29.253265 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-164f86d4-1cee-48f3-9130-188db88bc9c1 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:29.253725 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-164f86d4-1cee-48f3-9130-188db88bc9c1 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:29.254509 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-164f86d4-1cee-48f3-9130-188db88bc9c1 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:29.254956 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-164f86d4-1cee-48f3-9130-188db88bc9c1 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:29.316822 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-164f86d4-1cee-48f3-9130-188db88bc9c1 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action" status: 200 len: 28239 microversion: 2.1 time: 0.074866 Jan 11 15:22:29.317453 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 778/1442] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:22:29 2022] POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action => generated 28239 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:22:30.169595 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-92631828-3e8a-4f4a-9d64-e877085f4381 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:30.170287 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-92631828-3e8a-4f4a-9d64-e877085f4381 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:30.177113 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-92631828-3e8a-4f4a-9d64-e877085f4381 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:30.177562 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-92631828-3e8a-4f4a-9d64-e877085f4381 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:30.178335 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-92631828-3e8a-4f4a-9d64-e877085f4381 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:30.178773 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-92631828-3e8a-4f4a-9d64-e877085f4381 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:30.306998 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-92631828-3e8a-4f4a-9d64-e877085f4381 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:30.315220 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-92631828-3e8a-4f4a-9d64-e877085f4381 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.149670 Jan 11 15:22:30.315887 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 779/1443] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:30 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:22:30.320167 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7895bcdd-5456-43dc-9658-144ab0d63a8e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:30.321063 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-7895bcdd-5456-43dc-9658-144ab0d63a8e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:30.327459 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7895bcdd-5456-43dc-9658-144ab0d63a8e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:30.337373 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7895bcdd-5456-43dc-9658-144ab0d63a8e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:30.337373 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7895bcdd-5456-43dc-9658-144ab0d63a8e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:30.337373 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7895bcdd-5456-43dc-9658-144ab0d63a8e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:30.388860 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7895bcdd-5456-43dc-9658-144ab0d63a8e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action" status: 200 len: 28189 microversion: 2.20 time: 0.071805 Jan 11 15:22:30.389464 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 780/1444] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:22:30 2022] POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action => generated 28189 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:22:30.394155 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-078644cc-ba8e-436b-9e0a-6729f272293d tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:30.395129 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-078644cc-ba8e-436b-9e0a-6729f272293d tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:30.401682 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-078644cc-ba8e-436b-9e0a-6729f272293d tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:30.402135 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-078644cc-ba8e-436b-9e0a-6729f272293d tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:30.402910 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-078644cc-ba8e-436b-9e0a-6729f272293d tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:30.403378 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-078644cc-ba8e-436b-9e0a-6729f272293d tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:30.472768 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-078644cc-ba8e-436b-9e0a-6729f272293d tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action" status: 200 len: 28239 microversion: 2.1 time: 0.081933 Jan 11 15:22:30.473295 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 781/1445] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:22:30 2022] POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action => generated 28239 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:22:31.332778 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-44a628d3-ccf0-4b3f-bb49-e8c5e6e784c7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:31.333479 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-44a628d3-ccf0-4b3f-bb49-e8c5e6e784c7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:31.341188 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-44a628d3-ccf0-4b3f-bb49-e8c5e6e784c7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:31.341630 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-44a628d3-ccf0-4b3f-bb49-e8c5e6e784c7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:31.342443 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-44a628d3-ccf0-4b3f-bb49-e8c5e6e784c7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:31.342875 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-44a628d3-ccf0-4b3f-bb49-e8c5e6e784c7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:31.475099 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-44a628d3-ccf0-4b3f-bb49-e8c5e6e784c7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:31.483685 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-44a628d3-ccf0-4b3f-bb49-e8c5e6e784c7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.154925 Jan 11 15:22:31.484431 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 782/1446] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:31 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:22:31.488660 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-67ab4796-fdc0-4a26-928e-3f0486ee730e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:31.489543 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-67ab4796-fdc0-4a26-928e-3f0486ee730e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:31.494955 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-67ab4796-fdc0-4a26-928e-3f0486ee730e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:31.495433 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-67ab4796-fdc0-4a26-928e-3f0486ee730e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:31.496203 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-67ab4796-fdc0-4a26-928e-3f0486ee730e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:31.496636 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-67ab4796-fdc0-4a26-928e-3f0486ee730e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:31.561926 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-67ab4796-fdc0-4a26-928e-3f0486ee730e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action" status: 200 len: 28189 microversion: 2.20 time: 0.076219 Jan 11 15:22:31.565613 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 783/1447] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:22:31 2022] POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action => generated 28189 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:22:31.567319 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9b371fba-fe28-42b6-a4dc-a842c8346024 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:31.568284 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9b371fba-fe28-42b6-a4dc-a842c8346024 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:31.575167 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9b371fba-fe28-42b6-a4dc-a842c8346024 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:31.575647 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9b371fba-fe28-42b6-a4dc-a842c8346024 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:31.576419 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9b371fba-fe28-42b6-a4dc-a842c8346024 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:31.576859 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9b371fba-fe28-42b6-a4dc-a842c8346024 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:31.636107 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9b371fba-fe28-42b6-a4dc-a842c8346024 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action" status: 200 len: 28239 microversion: 2.1 time: 0.072320 Jan 11 15:22:31.636702 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 784/1448] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:22:31 2022] POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action => generated 28239 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:22:32.501795 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3e25fbc4-3f92-47ce-a9d8-8ec5aad2f155 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:32.502490 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3e25fbc4-3f92-47ce-a9d8-8ec5aad2f155 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:32.509418 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3e25fbc4-3f92-47ce-a9d8-8ec5aad2f155 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:32.509819 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3e25fbc4-3f92-47ce-a9d8-8ec5aad2f155 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:32.510592 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3e25fbc4-3f92-47ce-a9d8-8ec5aad2f155 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:32.511030 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3e25fbc4-3f92-47ce-a9d8-8ec5aad2f155 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:32.637602 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3e25fbc4-3f92-47ce-a9d8-8ec5aad2f155 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:32.645287 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3e25fbc4-3f92-47ce-a9d8-8ec5aad2f155 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.147544 Jan 11 15:22:32.645847 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 785/1449] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:32 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:22:32.650052 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4acd918c-feaf-4a71-8583-b00141f29970 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:32.650936 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-4acd918c-feaf-4a71-8583-b00141f29970 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:32.657794 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4acd918c-feaf-4a71-8583-b00141f29970 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:32.657794 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4acd918c-feaf-4a71-8583-b00141f29970 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:32.658133 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4acd918c-feaf-4a71-8583-b00141f29970 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:32.658376 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4acd918c-feaf-4a71-8583-b00141f29970 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:32.720469 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4acd918c-feaf-4a71-8583-b00141f29970 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action" status: 200 len: 28189 microversion: 2.20 time: 0.073450 Jan 11 15:22:32.721090 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 786/1450] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:22:32 2022] POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action => generated 28189 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:22:32.725782 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c2392d9a-8cca-4609-8190-7b7fd43787f4 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:32.726777 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c2392d9a-8cca-4609-8190-7b7fd43787f4 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:32.733926 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c2392d9a-8cca-4609-8190-7b7fd43787f4 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:32.734372 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c2392d9a-8cca-4609-8190-7b7fd43787f4 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:32.735157 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c2392d9a-8cca-4609-8190-7b7fd43787f4 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:32.735641 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c2392d9a-8cca-4609-8190-7b7fd43787f4 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:32.792364 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c2392d9a-8cca-4609-8190-7b7fd43787f4 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action" status: 200 len: 28239 microversion: 2.1 time: 0.069901 Jan 11 15:22:32.792897 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 787/1451] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:22:32 2022] POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action => generated 28239 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:22:33.662668 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c78e19ae-7953-4465-a6a6-5c47c966d365 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:33.663415 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c78e19ae-7953-4465-a6a6-5c47c966d365 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:33.670107 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c78e19ae-7953-4465-a6a6-5c47c966d365 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:33.670552 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c78e19ae-7953-4465-a6a6-5c47c966d365 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:33.671338 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c78e19ae-7953-4465-a6a6-5c47c966d365 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:33.671775 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c78e19ae-7953-4465-a6a6-5c47c966d365 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:33.805563 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c78e19ae-7953-4465-a6a6-5c47c966d365 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:33.813464 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c78e19ae-7953-4465-a6a6-5c47c966d365 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.155212 Jan 11 15:22:33.814020 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 788/1452] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:33 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:22:33.818257 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4b7137bf-2bf5-4c21-bff3-504b757363b0 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:33.819145 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-4b7137bf-2bf5-4c21-bff3-504b757363b0 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:33.824763 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4b7137bf-2bf5-4c21-bff3-504b757363b0 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:33.825205 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4b7137bf-2bf5-4c21-bff3-504b757363b0 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:33.825972 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4b7137bf-2bf5-4c21-bff3-504b757363b0 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:33.826404 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4b7137bf-2bf5-4c21-bff3-504b757363b0 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:33.887592 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4b7137bf-2bf5-4c21-bff3-504b757363b0 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action" status: 200 len: 28189 microversion: 2.20 time: 0.072395 Jan 11 15:22:33.888195 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 789/1453] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:22:33 2022] POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action => generated 28189 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:22:33.892840 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a73e9b99-432b-455a-b5c7-ebbc577e155f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:33.893796 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a73e9b99-432b-455a-b5c7-ebbc577e155f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:33.900286 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a73e9b99-432b-455a-b5c7-ebbc577e155f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:33.900733 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a73e9b99-432b-455a-b5c7-ebbc577e155f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:33.901497 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a73e9b99-432b-455a-b5c7-ebbc577e155f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:33.901924 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a73e9b99-432b-455a-b5c7-ebbc577e155f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:33.962037 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a73e9b99-432b-455a-b5c7-ebbc577e155f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action" status: 200 len: 28239 microversion: 2.1 time: 0.072428 Jan 11 15:22:33.962596 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 790/1454] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:22:33 2022] POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action => generated 28239 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:22:34.830627 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-21d7a471-7097-44a4-9cfa-ee4d29ccd503 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:34.831374 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-21d7a471-7097-44a4-9cfa-ee4d29ccd503 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:34.838184 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-21d7a471-7097-44a4-9cfa-ee4d29ccd503 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:34.838659 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-21d7a471-7097-44a4-9cfa-ee4d29ccd503 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:34.839473 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-21d7a471-7097-44a4-9cfa-ee4d29ccd503 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:34.839914 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-21d7a471-7097-44a4-9cfa-ee4d29ccd503 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:34.967372 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-21d7a471-7097-44a4-9cfa-ee4d29ccd503 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:34.975204 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-21d7a471-7097-44a4-9cfa-ee4d29ccd503 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.148655 Jan 11 15:22:34.975880 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 791/1455] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:34 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:22:34.980198 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0029154e-d79c-4057-8264-c751192a19af tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:34.981624 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0029154e-d79c-4057-8264-c751192a19af tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:34.987175 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0029154e-d79c-4057-8264-c751192a19af tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:34.987782 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0029154e-d79c-4057-8264-c751192a19af tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:34.988558 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0029154e-d79c-4057-8264-c751192a19af tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:34.988992 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0029154e-d79c-4057-8264-c751192a19af tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:35.049295 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0029154e-d79c-4057-8264-c751192a19af tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action" status: 200 len: 28189 microversion: 2.20 time: 0.072157 Jan 11 15:22:35.049916 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 792/1456] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:22:34 2022] POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action => generated 28189 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:22:35.054679 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3c13e5d6-de5e-4091-9c1d-2ca8a1bc07e8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:35.055669 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3c13e5d6-de5e-4091-9c1d-2ca8a1bc07e8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:35.062281 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c13e5d6-de5e-4091-9c1d-2ca8a1bc07e8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:35.062712 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c13e5d6-de5e-4091-9c1d-2ca8a1bc07e8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:35.063521 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c13e5d6-de5e-4091-9c1d-2ca8a1bc07e8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:35.063956 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c13e5d6-de5e-4091-9c1d-2ca8a1bc07e8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:35.127797 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3c13e5d6-de5e-4091-9c1d-2ca8a1bc07e8 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action" status: 200 len: 28239 microversion: 2.1 time: 0.076399 Jan 11 15:22:35.128662 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 793/1457] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:22:35 2022] POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action => generated 28239 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:22:35.993137 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c897db8e-aa8f-4b20-9426-a40fbc346467 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:35.993826 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c897db8e-aa8f-4b20-9426-a40fbc346467 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:36.001203 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c897db8e-aa8f-4b20-9426-a40fbc346467 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:36.001649 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c897db8e-aa8f-4b20-9426-a40fbc346467 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:36.002419 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c897db8e-aa8f-4b20-9426-a40fbc346467 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:36.002850 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c897db8e-aa8f-4b20-9426-a40fbc346467 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:36.138897 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c897db8e-aa8f-4b20-9426-a40fbc346467 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:36.146184 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c897db8e-aa8f-4b20-9426-a40fbc346467 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.157067 Jan 11 15:22:36.146736 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 794/1458] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:35 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:22:36.150956 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1cfc09ac-bdc2-48a6-92fd-add732ec1499 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:36.151867 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1cfc09ac-bdc2-48a6-92fd-add732ec1499 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:36.157348 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1cfc09ac-bdc2-48a6-92fd-add732ec1499 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:36.157810 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1cfc09ac-bdc2-48a6-92fd-add732ec1499 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:36.158601 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1cfc09ac-bdc2-48a6-92fd-add732ec1499 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:36.159049 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1cfc09ac-bdc2-48a6-92fd-add732ec1499 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:36.234674 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1cfc09ac-bdc2-48a6-92fd-add732ec1499 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action" status: 200 len: 28189 microversion: 2.20 time: 0.086733 Jan 11 15:22:36.235346 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 795/1459] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:22:36 2022] POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action => generated 28189 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:22:36.240367 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a468db7f-575b-4e26-871e-32aa5bbfd147 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:36.241347 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a468db7f-575b-4e26-871e-32aa5bbfd147 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:36.248929 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a468db7f-575b-4e26-871e-32aa5bbfd147 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:36.249311 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a468db7f-575b-4e26-871e-32aa5bbfd147 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:36.250080 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a468db7f-575b-4e26-871e-32aa5bbfd147 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:36.250518 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a468db7f-575b-4e26-871e-32aa5bbfd147 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:36.316170 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a468db7f-575b-4e26-871e-32aa5bbfd147 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action" status: 200 len: 28239 microversion: 2.1 time: 0.079479 Jan 11 15:22:36.316794 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 796/1460] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:22:36 2022] POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action => generated 28239 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:22:37.163870 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-96626da1-dbd9-46cd-a830-1c29b6155add tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:37.164524 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-96626da1-dbd9-46cd-a830-1c29b6155add tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:37.171299 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-96626da1-dbd9-46cd-a830-1c29b6155add tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:37.171767 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-96626da1-dbd9-46cd-a830-1c29b6155add tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:37.172544 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-96626da1-dbd9-46cd-a830-1c29b6155add tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:37.172988 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-96626da1-dbd9-46cd-a830-1c29b6155add tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:37.303097 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-96626da1-dbd9-46cd-a830-1c29b6155add tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:37.311380 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-96626da1-dbd9-46cd-a830-1c29b6155add tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.151591 Jan 11 15:22:37.311940 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 797/1461] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:37 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:22:37.316199 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-52d3c5a1-5bc3-410c-89f0-e1a7f2dee947 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:37.317081 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-52d3c5a1-5bc3-410c-89f0-e1a7f2dee947 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:37.322447 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-52d3c5a1-5bc3-410c-89f0-e1a7f2dee947 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:37.322932 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-52d3c5a1-5bc3-410c-89f0-e1a7f2dee947 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:37.324007 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-52d3c5a1-5bc3-410c-89f0-e1a7f2dee947 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:37.324465 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-52d3c5a1-5bc3-410c-89f0-e1a7f2dee947 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:37.403760 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-52d3c5a1-5bc3-410c-89f0-e1a7f2dee947 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action" status: 200 len: 28189 microversion: 2.20 time: 0.090613 Jan 11 15:22:37.407640 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 798/1462] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:22:37 2022] POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action => generated 28189 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:22:37.409082 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5239a264-d3b1-49c7-aa0b-13b695f7920f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:37.410048 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5239a264-d3b1-49c7-aa0b-13b695f7920f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:37.416649 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5239a264-d3b1-49c7-aa0b-13b695f7920f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:37.417044 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5239a264-d3b1-49c7-aa0b-13b695f7920f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:37.417815 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5239a264-d3b1-49c7-aa0b-13b695f7920f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:37.418257 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5239a264-d3b1-49c7-aa0b-13b695f7920f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:37.484937 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5239a264-d3b1-49c7-aa0b-13b695f7920f tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action" status: 200 len: 28239 microversion: 2.1 time: 0.079225 Jan 11 15:22:37.485569 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 799/1463] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:22:37 2022] POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action => generated 28239 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:22:38.329088 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8a641adc-48da-4bda-b4c9-d149e818a369 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:38.329814 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8a641adc-48da-4bda-b4c9-d149e818a369 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:38.336632 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8a641adc-48da-4bda-b4c9-d149e818a369 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:38.337086 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8a641adc-48da-4bda-b4c9-d149e818a369 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:38.337863 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8a641adc-48da-4bda-b4c9-d149e818a369 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:38.338308 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8a641adc-48da-4bda-b4c9-d149e818a369 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:38.466353 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-8a641adc-48da-4bda-b4c9-d149e818a369 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:38.474054 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8a641adc-48da-4bda-b4c9-d149e818a369 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.149490 Jan 11 15:22:38.474613 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 800/1464] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:38 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:22:38.478868 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ddd220c8-5d97-4fdc-9912-8e136a021645 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:38.479818 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ddd220c8-5d97-4fdc-9912-8e136a021645 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:38.485162 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ddd220c8-5d97-4fdc-9912-8e136a021645 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:38.485615 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ddd220c8-5d97-4fdc-9912-8e136a021645 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:38.486392 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ddd220c8-5d97-4fdc-9912-8e136a021645 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:38.486835 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ddd220c8-5d97-4fdc-9912-8e136a021645 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:38.553525 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ddd220c8-5d97-4fdc-9912-8e136a021645 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action" status: 200 len: 28189 microversion: 2.20 time: 0.077615 Jan 11 15:22:38.554055 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 801/1465] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:22:38 2022] POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action => generated 28189 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:22:38.558835 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-fbad43d1-d5f1-4eeb-a725-1f260e305bdf tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:38.560379 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-fbad43d1-d5f1-4eeb-a725-1f260e305bdf tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:38.567037 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fbad43d1-d5f1-4eeb-a725-1f260e305bdf tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:38.571359 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fbad43d1-d5f1-4eeb-a725-1f260e305bdf tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:38.571359 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fbad43d1-d5f1-4eeb-a725-1f260e305bdf tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:38.571359 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fbad43d1-d5f1-4eeb-a725-1f260e305bdf tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:38.634521 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-fbad43d1-d5f1-4eeb-a725-1f260e305bdf tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action" status: 200 len: 28239 microversion: 2.1 time: 0.079166 Jan 11 15:22:38.635126 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 802/1466] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:22:38 2022] POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action => generated 28239 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:22:39.490182 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-07fca34f-7df8-4fd2-93c4-974f391e88d4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:39.490892 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-07fca34f-7df8-4fd2-93c4-974f391e88d4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:39.497771 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-07fca34f-7df8-4fd2-93c4-974f391e88d4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:39.504315 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-07fca34f-7df8-4fd2-93c4-974f391e88d4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:39.504315 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-07fca34f-7df8-4fd2-93c4-974f391e88d4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:39.504315 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-07fca34f-7df8-4fd2-93c4-974f391e88d4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:39.629513 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-07fca34f-7df8-4fd2-93c4-974f391e88d4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:22:39.637217 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-07fca34f-7df8-4fd2-93c4-974f391e88d4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.151092 Jan 11 15:22:39.637787 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 803/1467] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:22:39 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:22:39.642064 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c3a9baa9-3238-4c4c-b435-46ad9d9b10a8 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:39.642957 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c3a9baa9-3238-4c4c-b435-46ad9d9b10a8 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:39.648577 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c3a9baa9-3238-4c4c-b435-46ad9d9b10a8 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:39.649034 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c3a9baa9-3238-4c4c-b435-46ad9d9b10a8 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:39.649815 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c3a9baa9-3238-4c4c-b435-46ad9d9b10a8 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:39.650259 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c3a9baa9-3238-4c4c-b435-46ad9d9b10a8 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:39.724313 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c3a9baa9-3238-4c4c-b435-46ad9d9b10a8 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action" status: 200 len: 28479 microversion: 2.20 time: 0.085277 Jan 11 15:22:39.724868 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 804/1468] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:22:39 2022] POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action => generated 28479 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:22:39.729609 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0d6a5f60-ec45-412c-9674-393424adcfd6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:22:39.730581 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0d6a5f60-ec45-412c-9674-393424adcfd6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:39.737211 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0d6a5f60-ec45-412c-9674-393424adcfd6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:39.737667 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0d6a5f60-ec45-412c-9674-393424adcfd6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:39.738444 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0d6a5f60-ec45-412c-9674-393424adcfd6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:39.738888 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0d6a5f60-ec45-412c-9674-393424adcfd6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:39.799032 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0d6a5f60-ec45-412c-9674-393424adcfd6 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action" status: 200 len: 28239 microversion: 2.1 time: 0.072869 Jan 11 15:22:39.799663 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 805/1469] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:22:39 2022] POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action => generated 28239 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:22:40.102305 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8e13081c-fadc-4757-a7f1-dac892845030 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:22:40.102885 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8e13081c-fadc-4757-a7f1-dac892845030 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:22:40.113244 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8e13081c-fadc-4757-a7f1-dac892845030 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:40.113701 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8e13081c-fadc-4757-a7f1-dac892845030 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:40.114572 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8e13081c-fadc-4757-a7f1-dac892845030 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:22:40.115011 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8e13081c-fadc-4757-a7f1-dac892845030 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:22:46.910943 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.objects.instance [None req-fd9e615c-03d7-4e1b-9f4c-5676375c6663 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lazy-loading 'services' on Instance uuid 92cb3dbf-b655-497a-9d23-6036c8b622f6 {{(pid=116903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 15:22:47.241575 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.objects.instance [None req-8e13081c-fadc-4757-a7f1-dac892845030 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lazy-loading 'services' on Instance uuid 92cb3dbf-b655-497a-9d23-6036c8b622f6 {{(pid=116902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 15:23:14.641244 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:23:14.641729 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: Tue Jan 11 15:23:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6/os-volume_attachments/f79b82a3-79b6-4d9c-a42d-e8c32d182e55 (ip 10.222.0.52) !!! Jan 11 15:23:40.928409 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-fd9e615c-03d7-4e1b-9f4c-5676375c6663 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "DELETE /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6/os-volume_attachments/f79b82a3-79b6-4d9c-a42d-e8c32d182e55" status: 202 len: 0 microversion: 2.1 time: 120.890156 Jan 11 15:23:40.929182 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 665/1470] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jan 11 15:21:40 2022] DELETE /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6/os-volume_attachments/f79b82a3-79b6-4d9c-a42d-e8c32d182e55 => generated 0 bytes in 120892 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:23:40.935534 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-465171a7-5913-43da-9ae6-dd4047cba819 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:23:40.936238 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-465171a7-5913-43da-9ae6-dd4047cba819 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:23:40.942999 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-465171a7-5913-43da-9ae6-dd4047cba819 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:40.943480 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-465171a7-5913-43da-9ae6-dd4047cba819 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:40.944260 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-465171a7-5913-43da-9ae6-dd4047cba819 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:40.944696 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-465171a7-5913-43da-9ae6-dd4047cba819 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:41.082664 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-465171a7-5913-43da-9ae6-dd4047cba819 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:23:41.089952 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-465171a7-5913-43da-9ae6-dd4047cba819 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.159464 Jan 11 15:23:41.090515 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 666/1471] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:23:40 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:23:41.095494 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e916e908-a171-48cb-ad36-9fc23b3dab6e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:23:41.096448 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e916e908-a171-48cb-ad36-9fc23b3dab6e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: b985a02a-bb5c-4090-be39-c0f345538f60] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:23:41.101762 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e916e908-a171-48cb-ad36-9fc23b3dab6e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:41.102218 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e916e908-a171-48cb-ad36-9fc23b3dab6e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:41.103067 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e916e908-a171-48cb-ad36-9fc23b3dab6e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:41.103467 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e916e908-a171-48cb-ad36-9fc23b3dab6e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:41.179530 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e916e908-a171-48cb-ad36-9fc23b3dab6e tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action" status: 200 len: 38343 microversion: 2.20 time: 0.087778 Jan 11 15:23:41.180189 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 667/1472] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jan 11 15:23:41 2022] POST /compute/v2.1/servers/b985a02a-bb5c-4090-be39-c0f345538f60/action => generated 38343 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:23:41.185118 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4fb58b81-f993-472c-b9e7-3a42ef65233a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:23:41.186103 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4fb58b81-f993-472c-b9e7-3a42ef65233a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 4d028c6b-fa47-42d1-859e-8576f3b3cb08] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:23:41.192844 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4fb58b81-f993-472c-b9e7-3a42ef65233a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:41.193304 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4fb58b81-f993-472c-b9e7-3a42ef65233a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:41.194088 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4fb58b81-f993-472c-b9e7-3a42ef65233a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:41.194531 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4fb58b81-f993-472c-b9e7-3a42ef65233a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:41.266756 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4fb58b81-f993-472c-b9e7-3a42ef65233a tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action" status: 200 len: 38364 microversion: 2.1 time: 0.085070 Jan 11 15:23:41.267677 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 668/1473] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:23:41 2022] POST /compute/v2.1/servers/4d028c6b-fa47-42d1-859e-8576f3b3cb08/action => generated 38364 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 15:23:41.272680 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a985bab7-f3e5-4cf0-a1fa-8a1c71fb6700 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:23:41.273253 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a985bab7-f3e5-4cf0-a1fa-8a1c71fb6700 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:23:41.280133 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a985bab7-f3e5-4cf0-a1fa-8a1c71fb6700 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:41.281382 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a985bab7-f3e5-4cf0-a1fa-8a1c71fb6700 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:41.282637 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a985bab7-f3e5-4cf0-a1fa-8a1c71fb6700 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:41.283086 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a985bab7-f3e5-4cf0-a1fa-8a1c71fb6700 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:41.525189 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.wsgi [None req-8e13081c-fadc-4757-a7f1-dac892845030 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-645da112-e8d7-4219-8e8d-42dd48009b3c) Jan 11 15:23:41.525800 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8e13081c-fadc-4757-a7f1-dac892845030 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-645da112-e8d7-4219-8e8d-42dd48009b3c) {{(pid=116902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:23:41.526665 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8e13081c-fadc-4757-a7f1-dac892845030 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "DELETE /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6/os-volume_attachments/f79b82a3-79b6-4d9c-a42d-e8c32d182e55" status: 400 len: 269 microversion: 2.1 time: 61.428605 Jan 11 15:23:41.527183 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 806/1474] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jan 11 15:22:40 2022] DELETE /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6/os-volume_attachments/f79b82a3-79b6-4d9c-a42d-e8c32d182e55 => generated 269 bytes in 61430 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 11 15:23:41.532329 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-60148e24-a986-4af3-94eb-87c5df4d0ac4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:23:41.532935 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-60148e24-a986-4af3-94eb-87c5df4d0ac4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:23:41.539514 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-60148e24-a986-4af3-94eb-87c5df4d0ac4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:41.545630 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-60148e24-a986-4af3-94eb-87c5df4d0ac4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:41.545630 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-60148e24-a986-4af3-94eb-87c5df4d0ac4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:41.545630 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-60148e24-a986-4af3-94eb-87c5df4d0ac4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:41.679592 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-60148e24-a986-4af3-94eb-87c5df4d0ac4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:23:41.687374 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-60148e24-a986-4af3-94eb-87c5df4d0ac4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.158647 Jan 11 15:23:41.687927 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 807/1475] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:23:41 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:23:41.692079 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-74a4c3db-e457-4a08-a293-5d3feb031d70 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '.version_select at 0x7f16b9f46c10>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:23:41.772641 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-74a4c3db-e457-4a08-a293-5d3feb031d70 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-708647409" status: 204 len: 0 microversion: 2.20 time: 0.083640 Jan 11 15:23:41.773125 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 808/1476] 10.222.0.52 () {60 vars in 1258 bytes} [Tue Jan 11 15:23:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-708647409 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 11 15:23:41.780629 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-65bf6053-7e39-4ad1-b255-ed9e3cda00fb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '.version_select at 0x7f16ba08b940>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:23:41.860652 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-65bf6053-7e39-4ad1-b255-ed9e3cda00fb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1103885072" status: 202 len: 0 microversion: 2.1 time: 0.086499 Jan 11 15:23:41.861248 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 809/1477] 10.222.0.52 () {58 vars in 1220 bytes} [Tue Jan 11 15:23:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1103885072 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:23:42.709907 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5e0d94a6-320b-4cd3-8a11-640005f66269 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:23:42.711472 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5e0d94a6-320b-4cd3-8a11-640005f66269 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:23:42.719402 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5e0d94a6-320b-4cd3-8a11-640005f66269 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:42.720182 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5e0d94a6-320b-4cd3-8a11-640005f66269 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:42.721353 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5e0d94a6-320b-4cd3-8a11-640005f66269 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:42.722022 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5e0d94a6-320b-4cd3-8a11-640005f66269 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:42.985092 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-5e0d94a6-320b-4cd3-8a11-640005f66269 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:23:42.992686 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5e0d94a6-320b-4cd3-8a11-640005f66269 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.286940 Jan 11 15:23:42.993936 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 810/1478] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:23:42 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:23:42.998692 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-7f7bd7b6-5369-41ee-8b10-7c4316192f3a req-582f720a-2bdf-4090-8b02-124f002def9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b985a02a-bb5c-4090-be39-c0f345538f60", "tag": "dd8f847b-635b-4dd4-ad83-c81b71ea0393"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:23:43.006270 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:23:43.006270 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:23:43.010117 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-7f7bd7b6-5369-41ee-8b10-7c4316192f3a req-582f720a-2bdf-4090-8b02-124f002def9d service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:43.010815 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-7f7bd7b6-5369-41ee-8b10-7c4316192f3a req-582f720a-2bdf-4090-8b02-124f002def9d service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:43.023392 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-7f7bd7b6-5369-41ee-8b10-7c4316192f3a req-582f720a-2bdf-4090-8b02-124f002def9d service nova] Creating event network-changed:dd8f847b-635b-4dd4-ad83-c81b71ea0393 for instance b985a02a-bb5c-4090-be39-c0f345538f60 on hv-cinder-82418 Jan 11 15:23:43.028668 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [req-7f7bd7b6-5369-41ee-8b10-7c4316192f3a req-582f720a-2bdf-4090-8b02-124f002def9d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033361 Jan 11 15:23:43.033388 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 811/1479] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:23:43.212382 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-fdacb364-6bf4-45ba-b11d-a4823037b14a req-fe40230d-89a5-40df-a5b0-5c5996171c57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d028c6b-fa47-42d1-859e-8576f3b3cb08", "tag": "ec1fb3ae-0012-43de-9cf3-275eb887651d"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:23:43.214933 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:23:43.214933 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:23:43.222174 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-fdacb364-6bf4-45ba-b11d-a4823037b14a req-fe40230d-89a5-40df-a5b0-5c5996171c57 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:43.222865 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-fdacb364-6bf4-45ba-b11d-a4823037b14a req-fe40230d-89a5-40df-a5b0-5c5996171c57 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:43.240122 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-fdacb364-6bf4-45ba-b11d-a4823037b14a req-fe40230d-89a5-40df-a5b0-5c5996171c57 service nova] Creating event network-changed:ec1fb3ae-0012-43de-9cf3-275eb887651d for instance 4d028c6b-fa47-42d1-859e-8576f3b3cb08 on hv-cinder-82418 Jan 11 15:23:43.245311 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [req-fdacb364-6bf4-45ba-b11d-a4823037b14a req-fe40230d-89a5-40df-a5b0-5c5996171c57 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044217 Jan 11 15:23:43.246473 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 812/1480] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:23:44.010985 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ef4bc6c2-745d-4124-b1b2-5bfa922ebc46 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:23:44.011737 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ef4bc6c2-745d-4124-b1b2-5bfa922ebc46 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:23:44.018070 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ef4bc6c2-745d-4124-b1b2-5bfa922ebc46 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:44.018519 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ef4bc6c2-745d-4124-b1b2-5bfa922ebc46 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:44.019356 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ef4bc6c2-745d-4124-b1b2-5bfa922ebc46 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:44.019756 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ef4bc6c2-745d-4124-b1b2-5bfa922ebc46 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:44.154914 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ef4bc6c2-745d-4124-b1b2-5bfa922ebc46 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:23:44.162823 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ef4bc6c2-745d-4124-b1b2-5bfa922ebc46 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.156248 Jan 11 15:23:44.163427 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 813/1481] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:23:44 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:23:45.178826 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-129b048c-4851-449e-a9c9-d63b47c58fd6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:23:45.179498 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-129b048c-4851-449e-a9c9-d63b47c58fd6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:23:45.185733 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-129b048c-4851-449e-a9c9-d63b47c58fd6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:45.186209 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-129b048c-4851-449e-a9c9-d63b47c58fd6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:45.187566 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-129b048c-4851-449e-a9c9-d63b47c58fd6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:45.187999 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-129b048c-4851-449e-a9c9-d63b47c58fd6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:45.316081 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-129b048c-4851-449e-a9c9-d63b47c58fd6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:23:45.323516 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-129b048c-4851-449e-a9c9-d63b47c58fd6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.148379 Jan 11 15:23:45.324096 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 814/1482] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:23:45 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:23:46.339607 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7386b209-ca26-42c9-8463-5ff6d74d0f7d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:23:46.340217 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-7386b209-ca26-42c9-8463-5ff6d74d0f7d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:23:46.346439 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7386b209-ca26-42c9-8463-5ff6d74d0f7d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:46.346882 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7386b209-ca26-42c9-8463-5ff6d74d0f7d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:46.347681 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7386b209-ca26-42c9-8463-5ff6d74d0f7d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:46.348126 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7386b209-ca26-42c9-8463-5ff6d74d0f7d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:46.485363 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-7386b209-ca26-42c9-8463-5ff6d74d0f7d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:23:46.492769 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7386b209-ca26-42c9-8463-5ff6d74d0f7d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.156715 Jan 11 15:23:46.493343 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 815/1483] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:23:46 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:23:47.510175 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1cbc1037-299f-478c-8125-bce5bd050638 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:23:47.510893 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1cbc1037-299f-478c-8125-bce5bd050638 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:23:47.517595 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1cbc1037-299f-478c-8125-bce5bd050638 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:47.518051 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1cbc1037-299f-478c-8125-bce5bd050638 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:47.518828 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1cbc1037-299f-478c-8125-bce5bd050638 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:47.519274 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1cbc1037-299f-478c-8125-bce5bd050638 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:47.644141 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1cbc1037-299f-478c-8125-bce5bd050638 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:23:47.651376 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1cbc1037-299f-478c-8125-bce5bd050638 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.144951 Jan 11 15:23:47.651945 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 816/1484] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:23:47 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:23:48.667984 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3f7b95dd-cb35-40d2-8f98-f4a752f09384 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:23:48.668669 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3f7b95dd-cb35-40d2-8f98-f4a752f09384 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:23:48.674926 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3f7b95dd-cb35-40d2-8f98-f4a752f09384 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:48.675418 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3f7b95dd-cb35-40d2-8f98-f4a752f09384 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:48.676201 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3f7b95dd-cb35-40d2-8f98-f4a752f09384 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:48.676641 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3f7b95dd-cb35-40d2-8f98-f4a752f09384 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:48.806871 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3f7b95dd-cb35-40d2-8f98-f4a752f09384 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:23:48.814193 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3f7b95dd-cb35-40d2-8f98-f4a752f09384 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.149896 Jan 11 15:23:48.814759 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 817/1485] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:23:48 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:23:49.830930 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-97a031a7-1e7e-411a-a0e1-4a0577384310 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:23:49.831625 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-97a031a7-1e7e-411a-a0e1-4a0577384310 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:23:49.837712 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-97a031a7-1e7e-411a-a0e1-4a0577384310 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:49.838155 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-97a031a7-1e7e-411a-a0e1-4a0577384310 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:49.838922 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-97a031a7-1e7e-411a-a0e1-4a0577384310 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:49.839382 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-97a031a7-1e7e-411a-a0e1-4a0577384310 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:49.965534 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-97a031a7-1e7e-411a-a0e1-4a0577384310 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:23:49.973353 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-97a031a7-1e7e-411a-a0e1-4a0577384310 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.146082 Jan 11 15:23:49.973919 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 818/1486] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:23:49 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:23:50.989970 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4878d481-e960-4fcb-a425-8a582a4396d6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:23:50.990573 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-4878d481-e960-4fcb-a425-8a582a4396d6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:23:50.996776 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4878d481-e960-4fcb-a425-8a582a4396d6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:50.997220 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4878d481-e960-4fcb-a425-8a582a4396d6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:50.997988 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4878d481-e960-4fcb-a425-8a582a4396d6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:50.998437 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4878d481-e960-4fcb-a425-8a582a4396d6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:51.129760 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-4878d481-e960-4fcb-a425-8a582a4396d6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:23:51.137004 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4878d481-e960-4fcb-a425-8a582a4396d6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.150668 Jan 11 15:23:51.137576 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 819/1487] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:23:50 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:23:52.153427 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1fdb4993-8fcc-4e46-9588-cc136e495b41 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:23:52.154096 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1fdb4993-8fcc-4e46-9588-cc136e495b41 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:23:52.160443 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1fdb4993-8fcc-4e46-9588-cc136e495b41 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:52.160892 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1fdb4993-8fcc-4e46-9588-cc136e495b41 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:52.161666 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1fdb4993-8fcc-4e46-9588-cc136e495b41 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:52.162102 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1fdb4993-8fcc-4e46-9588-cc136e495b41 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:52.292998 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1fdb4993-8fcc-4e46-9588-cc136e495b41 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:23:52.300898 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1fdb4993-8fcc-4e46-9588-cc136e495b41 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.151293 Jan 11 15:23:52.301470 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 820/1488] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:23:52 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:23:53.446296 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b43a26e9-8b7d-4883-9ef0-8d707726bf92 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:23:53.446916 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b43a26e9-8b7d-4883-9ef0-8d707726bf92 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:23:53.452777 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b43a26e9-8b7d-4883-9ef0-8d707726bf92 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:53.453234 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b43a26e9-8b7d-4883-9ef0-8d707726bf92 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:53.454015 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b43a26e9-8b7d-4883-9ef0-8d707726bf92 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:53.454511 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b43a26e9-8b7d-4883-9ef0-8d707726bf92 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:53.579437 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b43a26e9-8b7d-4883-9ef0-8d707726bf92 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:23:53.586754 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b43a26e9-8b7d-4883-9ef0-8d707726bf92 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.272283 Jan 11 15:23:53.587344 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 821/1489] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:23:53 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:23:54.603557 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3fe14319-7fbe-4d7d-80d9-7309c050ccd1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:23:54.604236 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3fe14319-7fbe-4d7d-80d9-7309c050ccd1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:23:54.610867 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3fe14319-7fbe-4d7d-80d9-7309c050ccd1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:54.611333 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3fe14319-7fbe-4d7d-80d9-7309c050ccd1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:54.612114 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3fe14319-7fbe-4d7d-80d9-7309c050ccd1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:54.612553 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3fe14319-7fbe-4d7d-80d9-7309c050ccd1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:54.742036 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3fe14319-7fbe-4d7d-80d9-7309c050ccd1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:23:54.750204 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3fe14319-7fbe-4d7d-80d9-7309c050ccd1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.150375 Jan 11 15:23:54.750949 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 822/1490] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:23:54 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:23:55.767619 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-84007fbc-054c-4180-b629-3bb8074ea2d6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:23:55.768302 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-84007fbc-054c-4180-b629-3bb8074ea2d6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:23:55.774433 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-84007fbc-054c-4180-b629-3bb8074ea2d6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:55.774882 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-84007fbc-054c-4180-b629-3bb8074ea2d6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:55.775690 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-84007fbc-054c-4180-b629-3bb8074ea2d6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:55.776123 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-84007fbc-054c-4180-b629-3bb8074ea2d6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:55.900988 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-84007fbc-054c-4180-b629-3bb8074ea2d6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:23:55.908252 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-84007fbc-054c-4180-b629-3bb8074ea2d6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.144915 Jan 11 15:23:55.908821 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 823/1491] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:23:55 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:23:56.923824 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-52f1bd49-4d29-428f-bfdd-69ad87c45ad4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:23:56.924468 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-52f1bd49-4d29-428f-bfdd-69ad87c45ad4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:23:56.930795 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-52f1bd49-4d29-428f-bfdd-69ad87c45ad4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:56.931248 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-52f1bd49-4d29-428f-bfdd-69ad87c45ad4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:56.932052 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-52f1bd49-4d29-428f-bfdd-69ad87c45ad4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:56.932508 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-52f1bd49-4d29-428f-bfdd-69ad87c45ad4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:57.063343 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-52f1bd49-4d29-428f-bfdd-69ad87c45ad4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:23:57.071184 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-52f1bd49-4d29-428f-bfdd-69ad87c45ad4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.150735 Jan 11 15:23:57.071792 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 824/1492] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:23:56 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:23:58.088568 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ab6fc243-0a53-4b6e-954e-5d82181702b1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:23:58.089274 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ab6fc243-0a53-4b6e-954e-5d82181702b1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:23:58.095466 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ab6fc243-0a53-4b6e-954e-5d82181702b1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:58.095923 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ab6fc243-0a53-4b6e-954e-5d82181702b1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:58.096702 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ab6fc243-0a53-4b6e-954e-5d82181702b1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:58.097143 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ab6fc243-0a53-4b6e-954e-5d82181702b1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:58.223739 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ab6fc243-0a53-4b6e-954e-5d82181702b1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:23:58.231153 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ab6fc243-0a53-4b6e-954e-5d82181702b1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.146274 Jan 11 15:23:58.231750 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 825/1493] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:23:58 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:23:59.247938 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b7d98e01-5e9e-48e2-8304-d74848a0a9a0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:23:59.249217 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b7d98e01-5e9e-48e2-8304-d74848a0a9a0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:23:59.255594 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b7d98e01-5e9e-48e2-8304-d74848a0a9a0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:59.256216 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b7d98e01-5e9e-48e2-8304-d74848a0a9a0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:59.256836 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b7d98e01-5e9e-48e2-8304-d74848a0a9a0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:23:59.257275 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b7d98e01-5e9e-48e2-8304-d74848a0a9a0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:23:59.383730 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b7d98e01-5e9e-48e2-8304-d74848a0a9a0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:23:59.391278 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b7d98e01-5e9e-48e2-8304-d74848a0a9a0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.147024 Jan 11 15:23:59.391869 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 826/1494] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:23:59 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:24:00.408008 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c967a0da-05eb-4e49-a022-39f6252341cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:00.413649 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c967a0da-05eb-4e49-a022-39f6252341cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:00.414738 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c967a0da-05eb-4e49-a022-39f6252341cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:00.415188 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c967a0da-05eb-4e49-a022-39f6252341cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:00.415986 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c967a0da-05eb-4e49-a022-39f6252341cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:00.416421 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c967a0da-05eb-4e49-a022-39f6252341cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:00.579040 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c967a0da-05eb-4e49-a022-39f6252341cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:24:00.587555 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c967a0da-05eb-4e49-a022-39f6252341cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.183261 Jan 11 15:24:00.588134 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 827/1495] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:24:00 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:24:01.608954 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-213a9b65-20a9-4e17-90f7-0fe74c10fd64 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:01.609591 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-213a9b65-20a9-4e17-90f7-0fe74c10fd64 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:01.616123 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-213a9b65-20a9-4e17-90f7-0fe74c10fd64 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:01.616588 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-213a9b65-20a9-4e17-90f7-0fe74c10fd64 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:01.617378 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-213a9b65-20a9-4e17-90f7-0fe74c10fd64 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:01.617824 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-213a9b65-20a9-4e17-90f7-0fe74c10fd64 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:01.754718 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-213a9b65-20a9-4e17-90f7-0fe74c10fd64 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:24:01.761902 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-213a9b65-20a9-4e17-90f7-0fe74c10fd64 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.157338 Jan 11 15:24:01.762457 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 828/1496] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:24:01 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:24:02.777585 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f80ab573-a32a-4400-a814-723536520d9e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:02.778243 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f80ab573-a32a-4400-a814-723536520d9e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:02.784517 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f80ab573-a32a-4400-a814-723536520d9e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:02.785010 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f80ab573-a32a-4400-a814-723536520d9e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:02.785759 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f80ab573-a32a-4400-a814-723536520d9e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:02.786204 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f80ab573-a32a-4400-a814-723536520d9e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:02.915668 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f80ab573-a32a-4400-a814-723536520d9e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:24:02.923457 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f80ab573-a32a-4400-a814-723536520d9e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.149532 Jan 11 15:24:02.924026 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 829/1497] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:24:02 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:24:03.940517 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-852a7805-b914-4ebd-b331-55041330c57d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:03.941197 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-852a7805-b914-4ebd-b331-55041330c57d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:03.947731 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-852a7805-b914-4ebd-b331-55041330c57d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:03.948188 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-852a7805-b914-4ebd-b331-55041330c57d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:03.948966 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-852a7805-b914-4ebd-b331-55041330c57d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:03.949407 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-852a7805-b914-4ebd-b331-55041330c57d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:04.074962 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-852a7805-b914-4ebd-b331-55041330c57d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:24:04.082862 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-852a7805-b914-4ebd-b331-55041330c57d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.146500 Jan 11 15:24:04.083460 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 830/1498] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:24:03 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:24:05.099485 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-738088ed-b399-4ddb-9fb0-4b9d7604e4ea tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:05.100183 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-738088ed-b399-4ddb-9fb0-4b9d7604e4ea tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:05.106464 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-738088ed-b399-4ddb-9fb0-4b9d7604e4ea tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:05.106918 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-738088ed-b399-4ddb-9fb0-4b9d7604e4ea tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:05.107753 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-738088ed-b399-4ddb-9fb0-4b9d7604e4ea tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:05.108191 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-738088ed-b399-4ddb-9fb0-4b9d7604e4ea tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:05.241330 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-738088ed-b399-4ddb-9fb0-4b9d7604e4ea tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:24:05.249646 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-738088ed-b399-4ddb-9fb0-4b9d7604e4ea tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.152930 Jan 11 15:24:05.249646 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 831/1499] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:24:05 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:24:06.265487 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-24768a07-781e-45b4-b7e8-88bf1384e69b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:06.266124 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-24768a07-781e-45b4-b7e8-88bf1384e69b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:06.272389 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-24768a07-781e-45b4-b7e8-88bf1384e69b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:06.272841 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-24768a07-781e-45b4-b7e8-88bf1384e69b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:06.273617 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-24768a07-781e-45b4-b7e8-88bf1384e69b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:06.274055 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-24768a07-781e-45b4-b7e8-88bf1384e69b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:06.398951 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-24768a07-781e-45b4-b7e8-88bf1384e69b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:24:06.407800 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-24768a07-781e-45b4-b7e8-88bf1384e69b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.145661 Jan 11 15:24:06.408748 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 832/1500] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:24:06 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:24:07.425379 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e82d35ba-ba05-43fa-9ab6-1fdbfb6477e5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:07.426047 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e82d35ba-ba05-43fa-9ab6-1fdbfb6477e5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:07.432216 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e82d35ba-ba05-43fa-9ab6-1fdbfb6477e5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:07.432669 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e82d35ba-ba05-43fa-9ab6-1fdbfb6477e5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:07.433446 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e82d35ba-ba05-43fa-9ab6-1fdbfb6477e5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:07.433883 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e82d35ba-ba05-43fa-9ab6-1fdbfb6477e5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:07.564603 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e82d35ba-ba05-43fa-9ab6-1fdbfb6477e5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:24:07.572852 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e82d35ba-ba05-43fa-9ab6-1fdbfb6477e5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.150973 Jan 11 15:24:07.574242 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 833/1501] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:24:07 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:24:08.591994 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b2a14010-12d7-4a0d-96e0-f09c1c6b69b3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:08.592653 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b2a14010-12d7-4a0d-96e0-f09c1c6b69b3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:08.598615 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b2a14010-12d7-4a0d-96e0-f09c1c6b69b3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:08.599057 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b2a14010-12d7-4a0d-96e0-f09c1c6b69b3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:08.599860 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b2a14010-12d7-4a0d-96e0-f09c1c6b69b3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:08.600291 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b2a14010-12d7-4a0d-96e0-f09c1c6b69b3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:08.730277 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b2a14010-12d7-4a0d-96e0-f09c1c6b69b3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:24:08.738637 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b2a14010-12d7-4a0d-96e0-f09c1c6b69b3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.150305 Jan 11 15:24:08.739208 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 834/1502] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:24:08 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:24:09.754806 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a2255691-1836-4ad6-b1b0-12d97ea75b6f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:09.755525 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a2255691-1836-4ad6-b1b0-12d97ea75b6f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:09.761582 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a2255691-1836-4ad6-b1b0-12d97ea75b6f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:09.762027 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a2255691-1836-4ad6-b1b0-12d97ea75b6f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:09.762795 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a2255691-1836-4ad6-b1b0-12d97ea75b6f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:09.763255 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a2255691-1836-4ad6-b1b0-12d97ea75b6f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:09.887807 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a2255691-1836-4ad6-b1b0-12d97ea75b6f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:24:09.895445 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a2255691-1836-4ad6-b1b0-12d97ea75b6f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.144283 Jan 11 15:24:09.896005 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 835/1503] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:24:09 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:24:10.912187 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-93387ef2-3f43-44fc-9aef-a09456729ec0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:10.912886 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-93387ef2-3f43-44fc-9aef-a09456729ec0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:10.919004 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-93387ef2-3f43-44fc-9aef-a09456729ec0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:10.919488 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-93387ef2-3f43-44fc-9aef-a09456729ec0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:10.920897 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-93387ef2-3f43-44fc-9aef-a09456729ec0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:10.921705 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-93387ef2-3f43-44fc-9aef-a09456729ec0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:11.067328 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-93387ef2-3f43-44fc-9aef-a09456729ec0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:24:11.074842 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-93387ef2-3f43-44fc-9aef-a09456729ec0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.166387 Jan 11 15:24:11.075425 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 836/1504] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:24:10 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:24:12.091217 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-73475874-943c-4543-9dca-5a8badbbd94f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:12.091929 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-73475874-943c-4543-9dca-5a8badbbd94f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:12.098102 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-73475874-943c-4543-9dca-5a8badbbd94f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:12.098550 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-73475874-943c-4543-9dca-5a8badbbd94f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:12.099337 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-73475874-943c-4543-9dca-5a8badbbd94f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:12.099777 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-73475874-943c-4543-9dca-5a8badbbd94f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:12.226269 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-73475874-943c-4543-9dca-5a8badbbd94f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:24:12.234105 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-73475874-943c-4543-9dca-5a8badbbd94f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.146545 Jan 11 15:24:12.234870 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 837/1505] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:24:12 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:24:13.250207 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3665a391-9ef7-49a1-ae58-058ff2860c70 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:13.250861 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3665a391-9ef7-49a1-ae58-058ff2860c70 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:13.257510 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3665a391-9ef7-49a1-ae58-058ff2860c70 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:13.257510 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3665a391-9ef7-49a1-ae58-058ff2860c70 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:13.258293 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3665a391-9ef7-49a1-ae58-058ff2860c70 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:13.258730 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3665a391-9ef7-49a1-ae58-058ff2860c70 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:13.394526 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3665a391-9ef7-49a1-ae58-058ff2860c70 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:24:13.401786 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3665a391-9ef7-49a1-ae58-058ff2860c70 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.155777 Jan 11 15:24:13.402353 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 838/1506] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:24:13 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:24:14.418885 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-db44e4cb-b2b5-4de4-982d-e12652ee72c0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:14.419599 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-db44e4cb-b2b5-4de4-982d-e12652ee72c0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:14.426324 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-db44e4cb-b2b5-4de4-982d-e12652ee72c0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:14.426774 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-db44e4cb-b2b5-4de4-982d-e12652ee72c0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:14.427574 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-db44e4cb-b2b5-4de4-982d-e12652ee72c0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:14.428012 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-db44e4cb-b2b5-4de4-982d-e12652ee72c0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:14.554858 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-db44e4cb-b2b5-4de4-982d-e12652ee72c0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:24:14.562058 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-db44e4cb-b2b5-4de4-982d-e12652ee72c0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.146826 Jan 11 15:24:14.562614 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 839/1507] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:24:14 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:24:15.578250 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-bb6130a4-425e-4715-b26d-6fadcae13406 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:15.578886 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-bb6130a4-425e-4715-b26d-6fadcae13406 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:15.585029 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bb6130a4-425e-4715-b26d-6fadcae13406 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:15.585476 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bb6130a4-425e-4715-b26d-6fadcae13406 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:15.586253 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bb6130a4-425e-4715-b26d-6fadcae13406 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:15.586691 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bb6130a4-425e-4715-b26d-6fadcae13406 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:15.711075 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-bb6130a4-425e-4715-b26d-6fadcae13406 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:24:15.718303 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-bb6130a4-425e-4715-b26d-6fadcae13406 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.143762 Jan 11 15:24:15.718868 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 840/1508] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:24:15 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:24:16.734989 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-346a4f2f-619e-40df-917d-7c4d2d1ba2a7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:16.735747 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-346a4f2f-619e-40df-917d-7c4d2d1ba2a7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:16.742093 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-346a4f2f-619e-40df-917d-7c4d2d1ba2a7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:16.742544 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-346a4f2f-619e-40df-917d-7c4d2d1ba2a7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:16.743343 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-346a4f2f-619e-40df-917d-7c4d2d1ba2a7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:16.743786 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-346a4f2f-619e-40df-917d-7c4d2d1ba2a7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:16.873958 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-346a4f2f-619e-40df-917d-7c4d2d1ba2a7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:24:16.881212 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-346a4f2f-619e-40df-917d-7c4d2d1ba2a7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.149989 Jan 11 15:24:16.881766 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 841/1509] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:24:16 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:24:17.898260 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b1d08a7e-cf3f-40b6-aaba-baa062d282d0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:17.898946 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b1d08a7e-cf3f-40b6-aaba-baa062d282d0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:17.905745 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b1d08a7e-cf3f-40b6-aaba-baa062d282d0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:17.906188 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b1d08a7e-cf3f-40b6-aaba-baa062d282d0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:17.906957 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b1d08a7e-cf3f-40b6-aaba-baa062d282d0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:17.907419 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b1d08a7e-cf3f-40b6-aaba-baa062d282d0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:18.032593 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b1d08a7e-cf3f-40b6-aaba-baa062d282d0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:24:18.039806 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b1d08a7e-cf3f-40b6-aaba-baa062d282d0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.145198 Jan 11 15:24:18.040372 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 842/1510] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:24:17 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:24:19.055704 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6d174bbe-477d-400f-a203-ad56cb0c224d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:19.056337 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6d174bbe-477d-400f-a203-ad56cb0c224d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:19.063041 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6d174bbe-477d-400f-a203-ad56cb0c224d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:19.063528 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6d174bbe-477d-400f-a203-ad56cb0c224d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:19.064305 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6d174bbe-477d-400f-a203-ad56cb0c224d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:19.064747 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6d174bbe-477d-400f-a203-ad56cb0c224d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:19.191852 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6d174bbe-477d-400f-a203-ad56cb0c224d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:24:19.199378 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6d174bbe-477d-400f-a203-ad56cb0c224d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.147365 Jan 11 15:24:19.200121 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 843/1511] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:24:19 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:24:20.216810 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ae83d5d9-9074-4217-93d9-3c9529f02063 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:20.217549 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ae83d5d9-9074-4217-93d9-3c9529f02063 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:20.223766 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ae83d5d9-9074-4217-93d9-3c9529f02063 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:20.224217 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ae83d5d9-9074-4217-93d9-3c9529f02063 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:20.225000 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ae83d5d9-9074-4217-93d9-3c9529f02063 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:20.225431 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ae83d5d9-9074-4217-93d9-3c9529f02063 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:20.358960 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ae83d5d9-9074-4217-93d9-3c9529f02063 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:24:20.366274 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ae83d5d9-9074-4217-93d9-3c9529f02063 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.153144 Jan 11 15:24:20.366834 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 844/1512] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:24:20 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:24:21.383676 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-09787b79-bf53-4438-a268-f851b5fedfe7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:21.384358 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-09787b79-bf53-4438-a268-f851b5fedfe7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:21.390936 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-09787b79-bf53-4438-a268-f851b5fedfe7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:21.391413 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-09787b79-bf53-4438-a268-f851b5fedfe7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:21.392225 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-09787b79-bf53-4438-a268-f851b5fedfe7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:21.392660 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-09787b79-bf53-4438-a268-f851b5fedfe7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:21.518328 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-09787b79-bf53-4438-a268-f851b5fedfe7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:24:21.525517 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-09787b79-bf53-4438-a268-f851b5fedfe7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.145683 Jan 11 15:24:21.526080 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 845/1513] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:24:21 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:24:22.542371 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7ee8406f-7ba7-4c54-8d17-ffd92ae12141 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:22.543012 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-7ee8406f-7ba7-4c54-8d17-ffd92ae12141 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:22.548798 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7ee8406f-7ba7-4c54-8d17-ffd92ae12141 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:22.549247 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7ee8406f-7ba7-4c54-8d17-ffd92ae12141 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:22.550019 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7ee8406f-7ba7-4c54-8d17-ffd92ae12141 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:22.550472 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7ee8406f-7ba7-4c54-8d17-ffd92ae12141 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:22.685023 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-7ee8406f-7ba7-4c54-8d17-ffd92ae12141 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:24:22.694252 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7ee8406f-7ba7-4c54-8d17-ffd92ae12141 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.155678 Jan 11 15:24:22.695341 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 846/1514] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:24:22 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:24:23.711084 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0973cb8c-0f4c-41a3-a281-9956ee176902 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:23.711828 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0973cb8c-0f4c-41a3-a281-9956ee176902 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:23.717952 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0973cb8c-0f4c-41a3-a281-9956ee176902 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:23.718397 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0973cb8c-0f4c-41a3-a281-9956ee176902 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:23.719168 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0973cb8c-0f4c-41a3-a281-9956ee176902 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:23.719633 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0973cb8c-0f4c-41a3-a281-9956ee176902 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:23.848640 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0973cb8c-0f4c-41a3-a281-9956ee176902 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:24:23.855981 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0973cb8c-0f4c-41a3-a281-9956ee176902 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.148595 Jan 11 15:24:23.856549 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 847/1515] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:24:23 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:24:24.872417 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-378f800f-dafa-4ada-9780-a0597ad633f9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:24.873057 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-378f800f-dafa-4ada-9780-a0597ad633f9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:24.879122 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-378f800f-dafa-4ada-9780-a0597ad633f9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:24.879602 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-378f800f-dafa-4ada-9780-a0597ad633f9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:24.880371 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-378f800f-dafa-4ada-9780-a0597ad633f9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:24.880807 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-378f800f-dafa-4ada-9780-a0597ad633f9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:25.010955 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-378f800f-dafa-4ada-9780-a0597ad633f9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:24:25.019042 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-378f800f-dafa-4ada-9780-a0597ad633f9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.150349 Jan 11 15:24:25.019670 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 848/1516] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:24:24 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:24:25.190813 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:24:25.191008 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: Tue Jan 11 15:24:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:24:25.292809 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:24:25.293270 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: Tue Jan 11 15:24:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6/os-volume_attachments/f79b82a3-79b6-4d9c-a42d-e8c32d182e55 (ip 10.222.0.52) !!! Jan 11 15:24:26.035555 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-eac1b2b4-eee9-4991-883d-db41e3843190 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:26.036169 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-eac1b2b4-eee9-4991-883d-db41e3843190 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:26.042483 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-eac1b2b4-eee9-4991-883d-db41e3843190 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:26.042938 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-eac1b2b4-eee9-4991-883d-db41e3843190 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:26.043742 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-eac1b2b4-eee9-4991-883d-db41e3843190 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:26.044179 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-eac1b2b4-eee9-4991-883d-db41e3843190 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:26.169277 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-eac1b2b4-eee9-4991-883d-db41e3843190 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:24:26.177123 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-eac1b2b4-eee9-4991-883d-db41e3843190 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.145177 Jan 11 15:24:26.177695 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 849/1517] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:24:26 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:24:27.194337 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d2df7d8b-26c8-49d8-9951-5470c080fe24 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:27.195249 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d2df7d8b-26c8-49d8-9951-5470c080fe24 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:27.201957 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d2df7d8b-26c8-49d8-9951-5470c080fe24 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:27.202404 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d2df7d8b-26c8-49d8-9951-5470c080fe24 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:27.203170 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d2df7d8b-26c8-49d8-9951-5470c080fe24 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:27.203631 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d2df7d8b-26c8-49d8-9951-5470c080fe24 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:27.330846 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d2df7d8b-26c8-49d8-9951-5470c080fe24 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:24:27.338908 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d2df7d8b-26c8-49d8-9951-5470c080fe24 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.148313 Jan 11 15:24:27.339497 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 850/1518] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:24:27 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:24:28.357576 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d330eddf-dfcf-4bdb-9172-247b3b694cb5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:28.358207 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d330eddf-dfcf-4bdb-9172-247b3b694cb5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:28.367072 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d330eddf-dfcf-4bdb-9172-247b3b694cb5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:28.367562 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d330eddf-dfcf-4bdb-9172-247b3b694cb5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:28.368364 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d330eddf-dfcf-4bdb-9172-247b3b694cb5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:28.368814 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d330eddf-dfcf-4bdb-9172-247b3b694cb5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:28.496575 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d330eddf-dfcf-4bdb-9172-247b3b694cb5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:24:28.503821 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d330eddf-dfcf-4bdb-9172-247b3b694cb5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.150012 Jan 11 15:24:28.504394 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 851/1519] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:24:28 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:24:29.598996 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2e08398c-04e2-44dd-bf85-8902998a573a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:29.599603 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2e08398c-04e2-44dd-bf85-8902998a573a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:29.605926 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2e08398c-04e2-44dd-bf85-8902998a573a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:29.606492 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2e08398c-04e2-44dd-bf85-8902998a573a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:29.607881 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2e08398c-04e2-44dd-bf85-8902998a573a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:29.608315 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2e08398c-04e2-44dd-bf85-8902998a573a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:29.632340 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2e08398c-04e2-44dd-bf85-8902998a573a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Going to try to terminate instance {{(pid=116902) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 15:24:29.856918 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2e08398c-04e2-44dd-bf85-8902998a573a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "DELETE /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 204 len: 0 microversion: 2.1 time: 0.261552 Jan 11 15:24:29.857433 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 852/1520] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jan 11 15:24:29 2022] DELETE /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 11 15:24:29.862426 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-e63d7806-f356-4d2c-854e-3a86ecae9776 req-196bc1b9-d93d-47a5-a546-99f87190f784 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "347a0a52-47fa-4799-97ca-551bc356aca0", "tag": "8250fb01-566c-404c-940f-8347fdacb6b4"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:24:29.864479 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:24:29.864479 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:24:29.873063 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-e63d7806-f356-4d2c-854e-3a86ecae9776 req-196bc1b9-d93d-47a5-a546-99f87190f784 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:29.873517 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-e63d7806-f356-4d2c-854e-3a86ecae9776 req-196bc1b9-d93d-47a5-a546-99f87190f784 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:29.884501 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-e63d7806-f356-4d2c-854e-3a86ecae9776 req-196bc1b9-d93d-47a5-a546-99f87190f784 service nova] Creating event network-changed:8250fb01-566c-404c-940f-8347fdacb6b4 for instance 347a0a52-47fa-4799-97ca-551bc356aca0 on hv-cinder-82418 Jan 11 15:24:29.889761 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [req-e63d7806-f356-4d2c-854e-3a86ecae9776 req-196bc1b9-d93d-47a5-a546-99f87190f784 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031079 Jan 11 15:24:29.890357 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 853/1521] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:24:29.895098 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c32ddbbe-6a59-4601-9826-ca83dbef403d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:29.895820 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c32ddbbe-6a59-4601-9826-ca83dbef403d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:29.902022 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c32ddbbe-6a59-4601-9826-ca83dbef403d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:29.902475 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c32ddbbe-6a59-4601-9826-ca83dbef403d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:29.903266 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c32ddbbe-6a59-4601-9826-ca83dbef403d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:29.903739 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c32ddbbe-6a59-4601-9826-ca83dbef403d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:30.096521 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c32ddbbe-6a59-4601-9826-ca83dbef403d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:24:30.104010 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c32ddbbe-6a59-4601-9826-ca83dbef403d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1570 microversion: 2.1 time: 0.212543 Jan 11 15:24:30.104786 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 854/1522] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:24:29 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1570 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:24:31.120978 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f7028fbf-bf90-4fb2-bfad-57cc6630326e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:31.121597 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f7028fbf-bf90-4fb2-bfad-57cc6630326e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:31.128384 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f7028fbf-bf90-4fb2-bfad-57cc6630326e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:31.128833 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f7028fbf-bf90-4fb2-bfad-57cc6630326e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:31.129630 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f7028fbf-bf90-4fb2-bfad-57cc6630326e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:31.130048 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f7028fbf-bf90-4fb2-bfad-57cc6630326e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:31.261188 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f7028fbf-bf90-4fb2-bfad-57cc6630326e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:24:31.269099 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f7028fbf-bf90-4fb2-bfad-57cc6630326e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.151777 Jan 11 15:24:31.269664 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 855/1523] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:24:31 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:24:32.286325 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-90780a19-a255-47d2-8e0e-3a1f8e00c86c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:32.286938 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-90780a19-a255-47d2-8e0e-3a1f8e00c86c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:32.293239 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-90780a19-a255-47d2-8e0e-3a1f8e00c86c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:32.293692 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-90780a19-a255-47d2-8e0e-3a1f8e00c86c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:32.294469 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-90780a19-a255-47d2-8e0e-3a1f8e00c86c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:32.294909 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-90780a19-a255-47d2-8e0e-3a1f8e00c86c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:32.420677 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-90780a19-a255-47d2-8e0e-3a1f8e00c86c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:24:32.428186 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-90780a19-a255-47d2-8e0e-3a1f8e00c86c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.145514 Jan 11 15:24:32.428778 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 856/1524] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:24:32 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:24:33.445669 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5312d1ea-3c10-4a0a-94eb-0e7a0ad48c7c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:33.446346 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5312d1ea-3c10-4a0a-94eb-0e7a0ad48c7c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:33.452726 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5312d1ea-3c10-4a0a-94eb-0e7a0ad48c7c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:33.453175 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5312d1ea-3c10-4a0a-94eb-0e7a0ad48c7c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:33.453952 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5312d1ea-3c10-4a0a-94eb-0e7a0ad48c7c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:33.454395 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5312d1ea-3c10-4a0a-94eb-0e7a0ad48c7c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:33.586687 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-5312d1ea-3c10-4a0a-94eb-0e7a0ad48c7c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:24:33.594593 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5312d1ea-3c10-4a0a-94eb-0e7a0ad48c7c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.152826 Jan 11 15:24:33.595152 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 857/1525] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:24:33 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:24:34.610214 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4c6686d5-d108-42f0-82ba-cb062466d330 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:34.610894 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-4c6686d5-d108-42f0-82ba-cb062466d330 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:34.616992 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4c6686d5-d108-42f0-82ba-cb062466d330 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:34.617440 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4c6686d5-d108-42f0-82ba-cb062466d330 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:34.618214 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4c6686d5-d108-42f0-82ba-cb062466d330 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:34.618651 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4c6686d5-d108-42f0-82ba-cb062466d330 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:34.745926 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-4c6686d5-d108-42f0-82ba-cb062466d330 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:24:34.753758 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4c6686d5-d108-42f0-82ba-cb062466d330 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.147223 Jan 11 15:24:34.754332 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 858/1526] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:24:34 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:24:35.770500 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5295d9bc-717d-42ee-9f9d-35628f78b6cd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:35.771149 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5295d9bc-717d-42ee-9f9d-35628f78b6cd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:35.777295 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5295d9bc-717d-42ee-9f9d-35628f78b6cd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:35.777743 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5295d9bc-717d-42ee-9f9d-35628f78b6cd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:35.778508 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5295d9bc-717d-42ee-9f9d-35628f78b6cd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:35.778946 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5295d9bc-717d-42ee-9f9d-35628f78b6cd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:35.904813 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-5295d9bc-717d-42ee-9f9d-35628f78b6cd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:24:35.912604 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5295d9bc-717d-42ee-9f9d-35628f78b6cd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.145680 Jan 11 15:24:35.913163 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 859/1527] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:24:35 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:24:36.929036 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-294e1f68-4fd6-4f20-846c-1058d263e459 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:36.929790 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-294e1f68-4fd6-4f20-846c-1058d263e459 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:36.935899 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-294e1f68-4fd6-4f20-846c-1058d263e459 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:36.936410 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-294e1f68-4fd6-4f20-846c-1058d263e459 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:36.937245 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-294e1f68-4fd6-4f20-846c-1058d263e459 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:36.937684 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-294e1f68-4fd6-4f20-846c-1058d263e459 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:37.066989 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-294e1f68-4fd6-4f20-846c-1058d263e459 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:24:37.074421 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-294e1f68-4fd6-4f20-846c-1058d263e459 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.148999 Jan 11 15:24:37.074983 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 860/1528] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:24:36 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:24:38.090735 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-015209ce-d1e7-4900-80c8-1bd3b8ed6d09 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:38.091436 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-015209ce-d1e7-4900-80c8-1bd3b8ed6d09 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:38.097583 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-015209ce-d1e7-4900-80c8-1bd3b8ed6d09 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:38.098034 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-015209ce-d1e7-4900-80c8-1bd3b8ed6d09 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:38.098809 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-015209ce-d1e7-4900-80c8-1bd3b8ed6d09 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:38.099246 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-015209ce-d1e7-4900-80c8-1bd3b8ed6d09 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:38.242682 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-015209ce-d1e7-4900-80c8-1bd3b8ed6d09 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:24:38.250596 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-015209ce-d1e7-4900-80c8-1bd3b8ed6d09 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.163498 Jan 11 15:24:38.251166 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 861/1529] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:24:38 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:24:39.269232 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3cb16a67-496f-4644-afa7-2c93d2883b65 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:39.269819 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3cb16a67-496f-4644-afa7-2c93d2883b65 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:39.276046 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3cb16a67-496f-4644-afa7-2c93d2883b65 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:39.276499 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3cb16a67-496f-4644-afa7-2c93d2883b65 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:39.277275 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3cb16a67-496f-4644-afa7-2c93d2883b65 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:39.277713 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3cb16a67-496f-4644-afa7-2c93d2883b65 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:39.409315 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3cb16a67-496f-4644-afa7-2c93d2883b65 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:24:39.422446 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3cb16a67-496f-4644-afa7-2c93d2883b65 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.151040 Jan 11 15:24:39.422446 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 862/1530] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:24:39 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:24:40.223793 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-98daefba-967a-46f3-9324-9ab4a43ff903 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:24:40.224292 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-98daefba-967a-46f3-9324-9ab4a43ff903 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:24:40.230160 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-98daefba-967a-46f3-9324-9ab4a43ff903 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:40.230617 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-98daefba-967a-46f3-9324-9ab4a43ff903 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:40.231425 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-98daefba-967a-46f3-9324-9ab4a43ff903 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:24:40.231862 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-98daefba-967a-46f3-9324-9ab4a43ff903 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:24:47.831089 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.objects.instance [None req-a985bab7-f3e5-4cf0-a1fa-8a1c71fb6700 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lazy-loading 'services' on Instance uuid 92cb3dbf-b655-497a-9d23-6036c8b622f6 {{(pid=116903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 15:24:48.007489 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.objects.instance [None req-98daefba-967a-46f3-9324-9ab4a43ff903 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lazy-loading 'services' on Instance uuid 92cb3dbf-b655-497a-9d23-6036c8b622f6 {{(pid=116902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 15:25:41.658647 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.wsgi [None req-a985bab7-f3e5-4cf0-a1fa-8a1c71fb6700 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bb982978-ebca-48ba-b9a9-5085514eb459) Jan 11 15:25:41.659358 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a985bab7-f3e5-4cf0-a1fa-8a1c71fb6700 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bb982978-ebca-48ba-b9a9-5085514eb459) {{(pid=116903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:25:41.660386 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a985bab7-f3e5-4cf0-a1fa-8a1c71fb6700 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "DELETE /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6/os-volume_attachments/f79b82a3-79b6-4d9c-a42d-e8c32d182e55" status: 400 len: 269 microversion: 2.1 time: 120.391516 Jan 11 15:25:41.661150 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 669/1531] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jan 11 15:23:41 2022] DELETE /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6/os-volume_attachments/f79b82a3-79b6-4d9c-a42d-e8c32d182e55 => generated 269 bytes in 120393 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 11 15:25:41.666851 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-52cd791c-366c-44b2-9ed3-7e6efecdd1aa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:25:41.667591 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-52cd791c-366c-44b2-9ed3-7e6efecdd1aa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:25:41.673613 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-52cd791c-366c-44b2-9ed3-7e6efecdd1aa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:41.674149 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-52cd791c-366c-44b2-9ed3-7e6efecdd1aa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:41.675014 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-52cd791c-366c-44b2-9ed3-7e6efecdd1aa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:41.675691 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-52cd791c-366c-44b2-9ed3-7e6efecdd1aa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:41.733550 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.wsgi [None req-98daefba-967a-46f3-9324-9ab4a43ff903 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f8cfdb87-37e9-4504-9460-8d308e34ae01) Jan 11 15:25:41.735071 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-98daefba-967a-46f3-9324-9ab4a43ff903 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f8cfdb87-37e9-4504-9460-8d308e34ae01) {{(pid=116902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:25:41.736689 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-98daefba-967a-46f3-9324-9ab4a43ff903 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "DELETE /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6/os-volume_attachments/f79b82a3-79b6-4d9c-a42d-e8c32d182e55" status: 400 len: 269 microversion: 2.1 time: 61.516506 Jan 11 15:25:41.737674 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 863/1532] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jan 11 15:24:40 2022] DELETE /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6/os-volume_attachments/f79b82a3-79b6-4d9c-a42d-e8c32d182e55 => generated 269 bytes in 61518 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 11 15:25:41.745897 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-bca374f6-5061-426a-9ac6-10bff3808792 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:25:41.746442 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-bca374f6-5061-426a-9ac6-10bff3808792 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:25:41.754641 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bca374f6-5061-426a-9ac6-10bff3808792 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:41.755365 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bca374f6-5061-426a-9ac6-10bff3808792 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:41.756342 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bca374f6-5061-426a-9ac6-10bff3808792 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:41.756783 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bca374f6-5061-426a-9ac6-10bff3808792 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:41.826796 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-52cd791c-366c-44b2-9ed3-7e6efecdd1aa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:25:41.834415 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-52cd791c-366c-44b2-9ed3-7e6efecdd1aa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.172215 Jan 11 15:25:41.835353 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 670/1533] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:25:41 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:25:41.839900 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-af1711ab-16cc-4a1a-8a56-0beb5cad3db3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:25:41.840507 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-af1711ab-16cc-4a1a-8a56-0beb5cad3db3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:25:41.846227 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-af1711ab-16cc-4a1a-8a56-0beb5cad3db3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:41.846694 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-af1711ab-16cc-4a1a-8a56-0beb5cad3db3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:41.847524 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-af1711ab-16cc-4a1a-8a56-0beb5cad3db3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:41.847973 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-af1711ab-16cc-4a1a-8a56-0beb5cad3db3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:41.948449 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.objects.instance [None req-bca374f6-5061-426a-9ac6-10bff3808792 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lazy-loading 'services' on Instance uuid 92cb3dbf-b655-497a-9d23-6036c8b622f6 {{(pid=116902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 15:25:41.982417 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-af1711ab-16cc-4a1a-8a56-0beb5cad3db3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:25:41.989717 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-af1711ab-16cc-4a1a-8a56-0beb5cad3db3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.153219 Jan 11 15:25:41.990284 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 671/1534] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:25:41 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:25:42.000543 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.wsgi [None req-bca374f6-5061-426a-9ac6-10bff3808792 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-49a0ee63-7eeb-49a4-b6d7-58588098daad) Jan 11 15:25:42.005614 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-bca374f6-5061-426a-9ac6-10bff3808792 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-49a0ee63-7eeb-49a4-b6d7-58588098daad) {{(pid=116902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:25:42.005614 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-bca374f6-5061-426a-9ac6-10bff3808792 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "DELETE /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6/os-volume_attachments/f79b82a3-79b6-4d9c-a42d-e8c32d182e55" status: 400 len: 269 microversion: 2.1 time: 0.262865 Jan 11 15:25:42.005614 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 864/1535] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jan 11 15:25:41 2022] DELETE /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6/os-volume_attachments/f79b82a3-79b6-4d9c-a42d-e8c32d182e55 => generated 269 bytes in 264 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 11 15:25:43.006755 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d6662928-2eee-4073-b62d-e68bae68a9fa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:25:43.007473 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d6662928-2eee-4073-b62d-e68bae68a9fa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:25:43.014355 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d6662928-2eee-4073-b62d-e68bae68a9fa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:43.014810 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d6662928-2eee-4073-b62d-e68bae68a9fa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:43.015625 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d6662928-2eee-4073-b62d-e68bae68a9fa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:43.016063 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d6662928-2eee-4073-b62d-e68bae68a9fa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:43.147876 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-d6662928-2eee-4073-b62d-e68bae68a9fa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:25:43.155126 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d6662928-2eee-4073-b62d-e68bae68a9fa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.152123 Jan 11 15:25:43.155733 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 672/1536] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:25:43 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:25:44.172716 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8176e9a4-334c-4470-b6f6-e7ef5c7fe57b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:25:44.173328 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8176e9a4-334c-4470-b6f6-e7ef5c7fe57b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:25:44.180128 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8176e9a4-334c-4470-b6f6-e7ef5c7fe57b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:44.180586 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8176e9a4-334c-4470-b6f6-e7ef5c7fe57b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:44.181375 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8176e9a4-334c-4470-b6f6-e7ef5c7fe57b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:44.181817 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8176e9a4-334c-4470-b6f6-e7ef5c7fe57b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:44.311018 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-8176e9a4-334c-4470-b6f6-e7ef5c7fe57b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:25:44.322757 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8176e9a4-334c-4470-b6f6-e7ef5c7fe57b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.154289 Jan 11 15:25:44.323255 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 865/1537] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:25:44 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:25:45.339793 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-86c19922-48e4-4c81-9e9b-c43f01992d21 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:25:45.340434 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-86c19922-48e4-4c81-9e9b-c43f01992d21 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:25:45.347551 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-86c19922-48e4-4c81-9e9b-c43f01992d21 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:45.348015 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-86c19922-48e4-4c81-9e9b-c43f01992d21 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:45.348811 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-86c19922-48e4-4c81-9e9b-c43f01992d21 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:45.349256 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-86c19922-48e4-4c81-9e9b-c43f01992d21 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:45.484975 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-86c19922-48e4-4c81-9e9b-c43f01992d21 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:25:45.492501 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-86c19922-48e4-4c81-9e9b-c43f01992d21 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.156384 Jan 11 15:25:45.493070 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 673/1538] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:25:45 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:25:46.509145 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-17efc80d-c578-4382-9c5d-27b97f371e20 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:25:46.509713 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-17efc80d-c578-4382-9c5d-27b97f371e20 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:25:46.515934 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-17efc80d-c578-4382-9c5d-27b97f371e20 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:46.516380 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-17efc80d-c578-4382-9c5d-27b97f371e20 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:46.517183 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-17efc80d-c578-4382-9c5d-27b97f371e20 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:46.517620 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-17efc80d-c578-4382-9c5d-27b97f371e20 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:46.642789 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-17efc80d-c578-4382-9c5d-27b97f371e20 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:25:46.650072 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-17efc80d-c578-4382-9c5d-27b97f371e20 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.144696 Jan 11 15:25:46.650637 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 866/1539] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:25:46 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:25:47.667313 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-371526ea-f403-4020-9031-20c79daff0af tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:25:47.667867 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-371526ea-f403-4020-9031-20c79daff0af tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:25:47.674643 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-371526ea-f403-4020-9031-20c79daff0af tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:47.675085 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-371526ea-f403-4020-9031-20c79daff0af tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:47.675884 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-371526ea-f403-4020-9031-20c79daff0af tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:47.676320 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-371526ea-f403-4020-9031-20c79daff0af tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:47.801369 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-371526ea-f403-4020-9031-20c79daff0af tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:25:47.808821 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-371526ea-f403-4020-9031-20c79daff0af tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.145351 Jan 11 15:25:47.809447 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 674/1540] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:25:47 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:25:48.824848 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-774353a0-4056-4b9b-a66a-9033874eeb85 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:25:48.825582 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-774353a0-4056-4b9b-a66a-9033874eeb85 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:25:48.831952 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-774353a0-4056-4b9b-a66a-9033874eeb85 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:48.832403 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-774353a0-4056-4b9b-a66a-9033874eeb85 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:48.833186 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-774353a0-4056-4b9b-a66a-9033874eeb85 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:48.833619 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-774353a0-4056-4b9b-a66a-9033874eeb85 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:48.962744 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-774353a0-4056-4b9b-a66a-9033874eeb85 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:25:48.970606 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-774353a0-4056-4b9b-a66a-9033874eeb85 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.149475 Jan 11 15:25:48.971164 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 867/1541] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:25:48 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:25:49.986724 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d15c2717-d488-411d-a1a6-4be728a541e2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:25:49.987408 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d15c2717-d488-411d-a1a6-4be728a541e2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:25:49.994052 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d15c2717-d488-411d-a1a6-4be728a541e2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:49.994496 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d15c2717-d488-411d-a1a6-4be728a541e2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:49.995257 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d15c2717-d488-411d-a1a6-4be728a541e2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:49.995714 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d15c2717-d488-411d-a1a6-4be728a541e2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:50.285439 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-d15c2717-d488-411d-a1a6-4be728a541e2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:25:50.293783 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d15c2717-d488-411d-a1a6-4be728a541e2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.310719 Jan 11 15:25:50.294487 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 675/1542] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:25:49 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:25:51.311071 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0cfb2f0a-894f-42a7-9bb7-afeba6d51659 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:25:51.311717 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0cfb2f0a-894f-42a7-9bb7-afeba6d51659 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:25:51.318205 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0cfb2f0a-894f-42a7-9bb7-afeba6d51659 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:51.318648 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0cfb2f0a-894f-42a7-9bb7-afeba6d51659 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:51.319451 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0cfb2f0a-894f-42a7-9bb7-afeba6d51659 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:51.319915 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0cfb2f0a-894f-42a7-9bb7-afeba6d51659 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:51.450393 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0cfb2f0a-894f-42a7-9bb7-afeba6d51659 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:25:51.458096 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0cfb2f0a-894f-42a7-9bb7-afeba6d51659 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.150715 Jan 11 15:25:51.458660 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 868/1543] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:25:51 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:25:52.480022 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-880c064d-9abd-4b23-9713-829d95f0c56c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:25:52.480663 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-880c064d-9abd-4b23-9713-829d95f0c56c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:25:52.490291 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-880c064d-9abd-4b23-9713-829d95f0c56c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:52.490747 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-880c064d-9abd-4b23-9713-829d95f0c56c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:52.491571 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-880c064d-9abd-4b23-9713-829d95f0c56c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:52.492095 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-880c064d-9abd-4b23-9713-829d95f0c56c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:52.617044 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-880c064d-9abd-4b23-9713-829d95f0c56c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:25:52.624291 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-880c064d-9abd-4b23-9713-829d95f0c56c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.147941 Jan 11 15:25:52.624846 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 676/1544] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:25:52 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:25:53.640852 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8a94ac5d-cc99-4137-a5e4-57299645a6e8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:25:53.641517 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8a94ac5d-cc99-4137-a5e4-57299645a6e8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:25:53.647378 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8a94ac5d-cc99-4137-a5e4-57299645a6e8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:53.647828 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8a94ac5d-cc99-4137-a5e4-57299645a6e8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:53.648601 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8a94ac5d-cc99-4137-a5e4-57299645a6e8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:53.649036 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8a94ac5d-cc99-4137-a5e4-57299645a6e8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:53.777450 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-8a94ac5d-cc99-4137-a5e4-57299645a6e8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:25:53.785381 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8a94ac5d-cc99-4137-a5e4-57299645a6e8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.148395 Jan 11 15:25:53.785941 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 869/1545] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:25:53 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:25:54.801788 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2b5f792b-04e5-4f1e-8119-7c74cc82fc87 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:25:54.802338 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2b5f792b-04e5-4f1e-8119-7c74cc82fc87 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:25:54.808248 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2b5f792b-04e5-4f1e-8119-7c74cc82fc87 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:54.808696 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2b5f792b-04e5-4f1e-8119-7c74cc82fc87 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:54.809462 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2b5f792b-04e5-4f1e-8119-7c74cc82fc87 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:54.809936 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2b5f792b-04e5-4f1e-8119-7c74cc82fc87 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:54.935125 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-2b5f792b-04e5-4f1e-8119-7c74cc82fc87 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:25:54.943085 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2b5f792b-04e5-4f1e-8119-7c74cc82fc87 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.145043 Jan 11 15:25:54.943666 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 677/1546] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:25:54 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:25:55.960005 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0dc8fca6-215c-4b66-ac5a-5481f39c230b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:25:55.960621 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0dc8fca6-215c-4b66-ac5a-5481f39c230b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:25:55.966805 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0dc8fca6-215c-4b66-ac5a-5481f39c230b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:55.967903 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0dc8fca6-215c-4b66-ac5a-5481f39c230b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:55.968685 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0dc8fca6-215c-4b66-ac5a-5481f39c230b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:55.969125 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0dc8fca6-215c-4b66-ac5a-5481f39c230b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:56.098299 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0dc8fca6-215c-4b66-ac5a-5481f39c230b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:25:56.105548 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0dc8fca6-215c-4b66-ac5a-5481f39c230b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.149199 Jan 11 15:25:56.106108 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 870/1547] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:25:55 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:25:57.121085 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-548f8a4d-7a1d-4ab1-b937-11e14643f931 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:25:57.121684 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-548f8a4d-7a1d-4ab1-b937-11e14643f931 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:25:57.127842 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-548f8a4d-7a1d-4ab1-b937-11e14643f931 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:57.128288 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-548f8a4d-7a1d-4ab1-b937-11e14643f931 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:57.129050 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-548f8a4d-7a1d-4ab1-b937-11e14643f931 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:57.129482 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-548f8a4d-7a1d-4ab1-b937-11e14643f931 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:57.257839 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-548f8a4d-7a1d-4ab1-b937-11e14643f931 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:25:57.265144 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-548f8a4d-7a1d-4ab1-b937-11e14643f931 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.147705 Jan 11 15:25:57.265705 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 678/1548] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:25:57 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:25:58.291060 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-868220a0-166d-499c-9edf-0a727219ab52 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:25:58.291701 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-868220a0-166d-499c-9edf-0a727219ab52 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:25:58.298652 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-868220a0-166d-499c-9edf-0a727219ab52 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:58.299107 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-868220a0-166d-499c-9edf-0a727219ab52 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:58.299923 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-868220a0-166d-499c-9edf-0a727219ab52 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:58.300369 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-868220a0-166d-499c-9edf-0a727219ab52 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:58.428627 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-868220a0-166d-499c-9edf-0a727219ab52 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:25:58.436765 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-868220a0-166d-499c-9edf-0a727219ab52 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.148790 Jan 11 15:25:58.437333 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 871/1549] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:25:58 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:25:59.453420 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c0a76b2c-dc38-40c0-837f-ff83923eeb38 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:25:59.454020 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c0a76b2c-dc38-40c0-837f-ff83923eeb38 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:25:59.460180 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c0a76b2c-dc38-40c0-837f-ff83923eeb38 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:59.460629 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c0a76b2c-dc38-40c0-837f-ff83923eeb38 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:59.461396 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c0a76b2c-dc38-40c0-837f-ff83923eeb38 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:25:59.461832 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c0a76b2c-dc38-40c0-837f-ff83923eeb38 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:25:59.590053 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-c0a76b2c-dc38-40c0-837f-ff83923eeb38 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:25:59.597345 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c0a76b2c-dc38-40c0-837f-ff83923eeb38 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.148174 Jan 11 15:25:59.597904 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 679/1550] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:25:59 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:00.614431 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-cf9e5713-39ba-4ead-bf47-9e87c729fee0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:00.615021 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-cf9e5713-39ba-4ead-bf47-9e87c729fee0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:00.621224 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cf9e5713-39ba-4ead-bf47-9e87c729fee0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:00.621677 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cf9e5713-39ba-4ead-bf47-9e87c729fee0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:00.622455 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cf9e5713-39ba-4ead-bf47-9e87c729fee0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:00.622897 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cf9e5713-39ba-4ead-bf47-9e87c729fee0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:00.753134 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-cf9e5713-39ba-4ead-bf47-9e87c729fee0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:00.760464 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-cf9e5713-39ba-4ead-bf47-9e87c729fee0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.149817 Jan 11 15:26:00.761027 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 872/1551] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:00 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:01.776947 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c68343b4-2e43-4f48-9b32-e00ceda27161 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:01.777558 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c68343b4-2e43-4f48-9b32-e00ceda27161 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:01.784336 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c68343b4-2e43-4f48-9b32-e00ceda27161 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:01.784788 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c68343b4-2e43-4f48-9b32-e00ceda27161 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:01.785562 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c68343b4-2e43-4f48-9b32-e00ceda27161 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:01.786003 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c68343b4-2e43-4f48-9b32-e00ceda27161 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:01.912116 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-c68343b4-2e43-4f48-9b32-e00ceda27161 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:01.919344 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c68343b4-2e43-4f48-9b32-e00ceda27161 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.146100 Jan 11 15:26:01.919914 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 680/1552] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:01 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:02.937842 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b3cb7ad7-5485-4820-b645-c7085a8115ee tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:02.938446 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b3cb7ad7-5485-4820-b645-c7085a8115ee tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:02.944919 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b3cb7ad7-5485-4820-b645-c7085a8115ee tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:02.945369 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b3cb7ad7-5485-4820-b645-c7085a8115ee tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:02.946133 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b3cb7ad7-5485-4820-b645-c7085a8115ee tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:02.946565 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b3cb7ad7-5485-4820-b645-c7085a8115ee tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:03.073731 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b3cb7ad7-5485-4820-b645-c7085a8115ee tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:03.080924 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b3cb7ad7-5485-4820-b645-c7085a8115ee tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.147382 Jan 11 15:26:03.081546 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 873/1553] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:02 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:04.097560 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-bd4fac34-a0d2-4837-bdb6-21ce9dc33d8b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:04.098414 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-bd4fac34-a0d2-4837-bdb6-21ce9dc33d8b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:04.104935 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bd4fac34-a0d2-4837-bdb6-21ce9dc33d8b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:04.105379 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bd4fac34-a0d2-4837-bdb6-21ce9dc33d8b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:04.106151 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bd4fac34-a0d2-4837-bdb6-21ce9dc33d8b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:04.106583 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bd4fac34-a0d2-4837-bdb6-21ce9dc33d8b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:04.231373 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-bd4fac34-a0d2-4837-bdb6-21ce9dc33d8b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:04.239232 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-bd4fac34-a0d2-4837-bdb6-21ce9dc33d8b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.145585 Jan 11 15:26:04.239827 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 681/1554] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:04 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:05.256052 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e6b6444f-fd81-4dce-97bc-94a32ab4adb4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:05.256659 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e6b6444f-fd81-4dce-97bc-94a32ab4adb4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:05.263096 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e6b6444f-fd81-4dce-97bc-94a32ab4adb4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:05.264081 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e6b6444f-fd81-4dce-97bc-94a32ab4adb4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:05.264853 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e6b6444f-fd81-4dce-97bc-94a32ab4adb4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:05.265286 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e6b6444f-fd81-4dce-97bc-94a32ab4adb4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:05.393896 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e6b6444f-fd81-4dce-97bc-94a32ab4adb4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:05.401013 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e6b6444f-fd81-4dce-97bc-94a32ab4adb4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.148639 Jan 11 15:26:05.401580 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 874/1555] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:05 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:26:06.417551 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-266741fc-3e8d-4ce9-ab38-0cb9e44a9641 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:06.418165 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-266741fc-3e8d-4ce9-ab38-0cb9e44a9641 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:06.425092 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-266741fc-3e8d-4ce9-ab38-0cb9e44a9641 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:06.425539 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-266741fc-3e8d-4ce9-ab38-0cb9e44a9641 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:06.426312 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-266741fc-3e8d-4ce9-ab38-0cb9e44a9641 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:06.426746 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-266741fc-3e8d-4ce9-ab38-0cb9e44a9641 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:06.552558 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-266741fc-3e8d-4ce9-ab38-0cb9e44a9641 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:06.559967 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-266741fc-3e8d-4ce9-ab38-0cb9e44a9641 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.146038 Jan 11 15:26:06.561092 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 682/1556] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:06 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:07.577252 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-82a5e074-fd25-4492-8ac6-5f772801c7c6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:07.577803 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-82a5e074-fd25-4492-8ac6-5f772801c7c6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:07.584040 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-82a5e074-fd25-4492-8ac6-5f772801c7c6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:07.584489 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-82a5e074-fd25-4492-8ac6-5f772801c7c6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:07.585254 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-82a5e074-fd25-4492-8ac6-5f772801c7c6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:07.585689 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-82a5e074-fd25-4492-8ac6-5f772801c7c6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:07.716146 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-82a5e074-fd25-4492-8ac6-5f772801c7c6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:07.724002 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-82a5e074-fd25-4492-8ac6-5f772801c7c6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.150499 Jan 11 15:26:07.724570 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 875/1557] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:07 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:08.741305 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-5ff7a3af-62dc-4f31-a9ed-b235dae1c89b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:08.741843 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-5ff7a3af-62dc-4f31-a9ed-b235dae1c89b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:08.747966 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5ff7a3af-62dc-4f31-a9ed-b235dae1c89b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:08.748428 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5ff7a3af-62dc-4f31-a9ed-b235dae1c89b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:08.749178 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5ff7a3af-62dc-4f31-a9ed-b235dae1c89b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:08.749609 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5ff7a3af-62dc-4f31-a9ed-b235dae1c89b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:08.875703 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-5ff7a3af-62dc-4f31-a9ed-b235dae1c89b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:08.883098 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-5ff7a3af-62dc-4f31-a9ed-b235dae1c89b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.145533 Jan 11 15:26:08.883809 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 683/1558] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:08 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:09.900137 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b0cc7421-b67c-437f-82e4-a5a9f0ba4017 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:09.900747 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b0cc7421-b67c-437f-82e4-a5a9f0ba4017 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:09.907534 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b0cc7421-b67c-437f-82e4-a5a9f0ba4017 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:09.907983 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b0cc7421-b67c-437f-82e4-a5a9f0ba4017 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:09.908760 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b0cc7421-b67c-437f-82e4-a5a9f0ba4017 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:09.909196 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b0cc7421-b67c-437f-82e4-a5a9f0ba4017 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:10.033173 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b0cc7421-b67c-437f-82e4-a5a9f0ba4017 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:10.040495 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b0cc7421-b67c-437f-82e4-a5a9f0ba4017 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.143984 Jan 11 15:26:10.041063 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 876/1559] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:09 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:11.057595 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d7185b9f-83ef-4a9a-8929-cb79746ece0a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:11.058152 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d7185b9f-83ef-4a9a-8929-cb79746ece0a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:11.064647 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d7185b9f-83ef-4a9a-8929-cb79746ece0a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:11.065101 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d7185b9f-83ef-4a9a-8929-cb79746ece0a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:11.065916 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d7185b9f-83ef-4a9a-8929-cb79746ece0a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:11.066652 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d7185b9f-83ef-4a9a-8929-cb79746ece0a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:11.302784 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-d7185b9f-83ef-4a9a-8929-cb79746ece0a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:11.310000 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d7185b9f-83ef-4a9a-8929-cb79746ece0a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.256135 Jan 11 15:26:11.310992 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 684/1560] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:11 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:12.327742 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ebf6df54-b247-4e95-b55e-a215e7c38795 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:12.328355 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ebf6df54-b247-4e95-b55e-a215e7c38795 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:12.334513 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ebf6df54-b247-4e95-b55e-a215e7c38795 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:12.334975 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ebf6df54-b247-4e95-b55e-a215e7c38795 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:12.335785 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ebf6df54-b247-4e95-b55e-a215e7c38795 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:12.336226 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ebf6df54-b247-4e95-b55e-a215e7c38795 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:12.461446 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ebf6df54-b247-4e95-b55e-a215e7c38795 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:12.468745 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ebf6df54-b247-4e95-b55e-a215e7c38795 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.145260 Jan 11 15:26:12.469312 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 877/1561] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:12 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:13.485177 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-16013044-6de9-41e5-a35c-9cbec25b1eb0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:13.485767 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-16013044-6de9-41e5-a35c-9cbec25b1eb0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:13.492235 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-16013044-6de9-41e5-a35c-9cbec25b1eb0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:13.492685 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-16013044-6de9-41e5-a35c-9cbec25b1eb0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:13.493488 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-16013044-6de9-41e5-a35c-9cbec25b1eb0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:13.493928 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-16013044-6de9-41e5-a35c-9cbec25b1eb0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:13.622411 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-16013044-6de9-41e5-a35c-9cbec25b1eb0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:13.630195 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-16013044-6de9-41e5-a35c-9cbec25b1eb0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.148752 Jan 11 15:26:13.630756 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 685/1562] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:13 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:14.647575 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d1dcc076-08d1-44c3-a902-ca43806fd46b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:14.648144 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d1dcc076-08d1-44c3-a902-ca43806fd46b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:14.654860 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d1dcc076-08d1-44c3-a902-ca43806fd46b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:14.655308 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d1dcc076-08d1-44c3-a902-ca43806fd46b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:14.656093 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d1dcc076-08d1-44c3-a902-ca43806fd46b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:14.656527 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d1dcc076-08d1-44c3-a902-ca43806fd46b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:14.782036 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d1dcc076-08d1-44c3-a902-ca43806fd46b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:14.789224 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d1dcc076-08d1-44c3-a902-ca43806fd46b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.145438 Jan 11 15:26:14.789791 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 878/1563] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:14 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:15.805779 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-607f7b8e-34da-4cb9-b659-2c18be5733f3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:15.806370 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-607f7b8e-34da-4cb9-b659-2c18be5733f3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:15.813149 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-607f7b8e-34da-4cb9-b659-2c18be5733f3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:15.813596 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-607f7b8e-34da-4cb9-b659-2c18be5733f3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:15.814362 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-607f7b8e-34da-4cb9-b659-2c18be5733f3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:15.814797 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-607f7b8e-34da-4cb9-b659-2c18be5733f3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:15.942525 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-607f7b8e-34da-4cb9-b659-2c18be5733f3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:15.949779 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-607f7b8e-34da-4cb9-b659-2c18be5733f3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.147631 Jan 11 15:26:15.950334 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 686/1564] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:15 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:16.965771 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-95064d50-d567-4367-8230-6edf95b9a073 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:16.966367 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-95064d50-d567-4367-8230-6edf95b9a073 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:16.972709 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-95064d50-d567-4367-8230-6edf95b9a073 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:16.973201 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-95064d50-d567-4367-8230-6edf95b9a073 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:16.973981 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-95064d50-d567-4367-8230-6edf95b9a073 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:16.974424 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-95064d50-d567-4367-8230-6edf95b9a073 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:17.102460 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-95064d50-d567-4367-8230-6edf95b9a073 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:17.109793 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-95064d50-d567-4367-8230-6edf95b9a073 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.147724 Jan 11 15:26:17.110364 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 879/1565] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:16 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:18.125624 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3f2edecd-3019-444a-ad4a-433203b738bc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:18.126237 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3f2edecd-3019-444a-ad4a-433203b738bc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:18.132574 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3f2edecd-3019-444a-ad4a-433203b738bc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:18.133029 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3f2edecd-3019-444a-ad4a-433203b738bc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:18.133810 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3f2edecd-3019-444a-ad4a-433203b738bc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:18.134249 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3f2edecd-3019-444a-ad4a-433203b738bc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:18.264988 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-3f2edecd-3019-444a-ad4a-433203b738bc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:18.272334 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3f2edecd-3019-444a-ad4a-433203b738bc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.150368 Jan 11 15:26:18.272888 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 687/1566] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:18 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:19.289503 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-71168fd3-ef7a-4279-82a5-87074e48e7ba tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:19.290094 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-71168fd3-ef7a-4279-82a5-87074e48e7ba tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:19.296964 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-71168fd3-ef7a-4279-82a5-87074e48e7ba tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:19.297418 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-71168fd3-ef7a-4279-82a5-87074e48e7ba tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:19.298191 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-71168fd3-ef7a-4279-82a5-87074e48e7ba tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:19.298623 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-71168fd3-ef7a-4279-82a5-87074e48e7ba tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:19.424273 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-71168fd3-ef7a-4279-82a5-87074e48e7ba tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:19.431574 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-71168fd3-ef7a-4279-82a5-87074e48e7ba tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.145753 Jan 11 15:26:19.432154 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 880/1567] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:19 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:20.448873 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-6ee554b2-f5e9-4f12-b622-3b502f583f66 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:20.449490 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-6ee554b2-f5e9-4f12-b622-3b502f583f66 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:20.456394 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6ee554b2-f5e9-4f12-b622-3b502f583f66 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:20.456840 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6ee554b2-f5e9-4f12-b622-3b502f583f66 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:20.457621 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6ee554b2-f5e9-4f12-b622-3b502f583f66 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:20.458061 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6ee554b2-f5e9-4f12-b622-3b502f583f66 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:20.592626 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-6ee554b2-f5e9-4f12-b622-3b502f583f66 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:20.600101 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-6ee554b2-f5e9-4f12-b622-3b502f583f66 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.154949 Jan 11 15:26:20.601151 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 688/1568] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:20 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:21.617427 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-25234f19-c7ac-4485-8819-9f95bc7a48f7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:21.618006 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-25234f19-c7ac-4485-8819-9f95bc7a48f7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:21.624973 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-25234f19-c7ac-4485-8819-9f95bc7a48f7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:21.625421 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-25234f19-c7ac-4485-8819-9f95bc7a48f7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:21.626197 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-25234f19-c7ac-4485-8819-9f95bc7a48f7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:21.626634 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-25234f19-c7ac-4485-8819-9f95bc7a48f7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:21.757729 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-25234f19-c7ac-4485-8819-9f95bc7a48f7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:21.765516 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-25234f19-c7ac-4485-8819-9f95bc7a48f7 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.152089 Jan 11 15:26:21.766085 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 881/1569] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:21 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:22.781691 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a0206e56-8c25-4af1-9d80-f5098189ca43 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:22.782299 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a0206e56-8c25-4af1-9d80-f5098189ca43 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:22.788685 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a0206e56-8c25-4af1-9d80-f5098189ca43 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:22.789132 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a0206e56-8c25-4af1-9d80-f5098189ca43 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:22.789905 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a0206e56-8c25-4af1-9d80-f5098189ca43 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:22.790337 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a0206e56-8c25-4af1-9d80-f5098189ca43 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:22.914902 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-a0206e56-8c25-4af1-9d80-f5098189ca43 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:22.922771 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a0206e56-8c25-4af1-9d80-f5098189ca43 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.144767 Jan 11 15:26:22.923337 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 689/1570] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:22 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:23.939575 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ce5baa2d-6020-4dea-9255-49a1e648df85 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:23.940217 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ce5baa2d-6020-4dea-9255-49a1e648df85 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:23.946705 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ce5baa2d-6020-4dea-9255-49a1e648df85 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:23.947157 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ce5baa2d-6020-4dea-9255-49a1e648df85 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:23.947978 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ce5baa2d-6020-4dea-9255-49a1e648df85 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:23.948427 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ce5baa2d-6020-4dea-9255-49a1e648df85 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:24.079066 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ce5baa2d-6020-4dea-9255-49a1e648df85 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:24.086342 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ce5baa2d-6020-4dea-9255-49a1e648df85 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.151012 Jan 11 15:26:24.086912 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 882/1571] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:23 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:25.101856 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-11482fc1-8f1f-46ef-896b-cde66730955a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:25.102497 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-11482fc1-8f1f-46ef-896b-cde66730955a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:25.109136 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-11482fc1-8f1f-46ef-896b-cde66730955a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:25.109587 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-11482fc1-8f1f-46ef-896b-cde66730955a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:25.110366 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-11482fc1-8f1f-46ef-896b-cde66730955a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:25.110805 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-11482fc1-8f1f-46ef-896b-cde66730955a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:25.246007 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-11482fc1-8f1f-46ef-896b-cde66730955a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:25.253325 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-11482fc1-8f1f-46ef-896b-cde66730955a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.155321 Jan 11 15:26:25.253884 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 690/1572] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:25 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:26.269703 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f6244274-d99d-4788-b524-b4a7178ea4bd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:26.275581 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f6244274-d99d-4788-b524-b4a7178ea4bd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:26.276548 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f6244274-d99d-4788-b524-b4a7178ea4bd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:26.276994 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f6244274-d99d-4788-b524-b4a7178ea4bd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:26.277764 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f6244274-d99d-4788-b524-b4a7178ea4bd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:26.278201 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f6244274-d99d-4788-b524-b4a7178ea4bd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:26.402435 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f6244274-d99d-4788-b524-b4a7178ea4bd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:26.410287 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f6244274-d99d-4788-b524-b4a7178ea4bd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.144292 Jan 11 15:26:26.410840 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 883/1573] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:26 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:27.426450 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-9fc75ada-bbcf-4df3-b1ec-3b43d68866d9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:27.427061 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-9fc75ada-bbcf-4df3-b1ec-3b43d68866d9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:27.433312 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9fc75ada-bbcf-4df3-b1ec-3b43d68866d9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:27.433763 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9fc75ada-bbcf-4df3-b1ec-3b43d68866d9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:27.434536 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9fc75ada-bbcf-4df3-b1ec-3b43d68866d9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:27.434973 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9fc75ada-bbcf-4df3-b1ec-3b43d68866d9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:27.562573 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-9fc75ada-bbcf-4df3-b1ec-3b43d68866d9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:27.570050 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-9fc75ada-bbcf-4df3-b1ec-3b43d68866d9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.147278 Jan 11 15:26:27.570601 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 691/1574] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:27 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:28.587055 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4f5cfd1b-9b05-4d5b-803c-94e63f73dbce tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:28.587660 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-4f5cfd1b-9b05-4d5b-803c-94e63f73dbce tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:28.593936 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4f5cfd1b-9b05-4d5b-803c-94e63f73dbce tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:28.594420 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4f5cfd1b-9b05-4d5b-803c-94e63f73dbce tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:28.595181 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4f5cfd1b-9b05-4d5b-803c-94e63f73dbce tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:28.595647 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4f5cfd1b-9b05-4d5b-803c-94e63f73dbce tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:28.721350 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-4f5cfd1b-9b05-4d5b-803c-94e63f73dbce tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:28.728547 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4f5cfd1b-9b05-4d5b-803c-94e63f73dbce tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.145271 Jan 11 15:26:28.729110 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 884/1575] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:28 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:29.744980 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b12b1bd5-3ce7-4960-ab8b-176244cf41a9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:29.745614 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b12b1bd5-3ce7-4960-ab8b-176244cf41a9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:29.751820 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b12b1bd5-3ce7-4960-ab8b-176244cf41a9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:29.752266 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b12b1bd5-3ce7-4960-ab8b-176244cf41a9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:29.753029 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b12b1bd5-3ce7-4960-ab8b-176244cf41a9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:29.753465 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b12b1bd5-3ce7-4960-ab8b-176244cf41a9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:29.880966 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-b12b1bd5-3ce7-4960-ab8b-176244cf41a9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:29.888640 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b12b1bd5-3ce7-4960-ab8b-176244cf41a9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.146849 Jan 11 15:26:29.889204 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 692/1576] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:29 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:30.905712 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-99fbf83d-bee0-44e0-bd99-bb41bebe7875 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:30.906334 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-99fbf83d-bee0-44e0-bd99-bb41bebe7875 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:30.913016 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-99fbf83d-bee0-44e0-bd99-bb41bebe7875 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:30.913475 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-99fbf83d-bee0-44e0-bd99-bb41bebe7875 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:30.914269 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-99fbf83d-bee0-44e0-bd99-bb41bebe7875 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:30.914718 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-99fbf83d-bee0-44e0-bd99-bb41bebe7875 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:31.041045 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-99fbf83d-bee0-44e0-bd99-bb41bebe7875 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:31.048894 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-99fbf83d-bee0-44e0-bd99-bb41bebe7875 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.147508 Jan 11 15:26:31.049459 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 885/1577] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:30 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:32.066119 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-45ec2f0f-a574-49a8-ad3c-136d8480f2c9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:32.066753 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-45ec2f0f-a574-49a8-ad3c-136d8480f2c9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:32.072977 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-45ec2f0f-a574-49a8-ad3c-136d8480f2c9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:32.073426 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-45ec2f0f-a574-49a8-ad3c-136d8480f2c9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:32.074190 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-45ec2f0f-a574-49a8-ad3c-136d8480f2c9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:32.074621 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-45ec2f0f-a574-49a8-ad3c-136d8480f2c9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:32.203096 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-45ec2f0f-a574-49a8-ad3c-136d8480f2c9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:32.210282 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-45ec2f0f-a574-49a8-ad3c-136d8480f2c9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.148014 Jan 11 15:26:32.210845 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 693/1578] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:32 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:33.226078 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e685d465-08cc-4c5b-96f7-be738b8736a3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:33.226685 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e685d465-08cc-4c5b-96f7-be738b8736a3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:33.233020 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e685d465-08cc-4c5b-96f7-be738b8736a3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:33.233475 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e685d465-08cc-4c5b-96f7-be738b8736a3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:33.234270 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e685d465-08cc-4c5b-96f7-be738b8736a3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:33.234713 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e685d465-08cc-4c5b-96f7-be738b8736a3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:33.584939 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e685d465-08cc-4c5b-96f7-be738b8736a3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:33.592247 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e685d465-08cc-4c5b-96f7-be738b8736a3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.369827 Jan 11 15:26:33.592811 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 886/1579] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:33 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:34.608865 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3bbc3abd-271d-4f9f-b366-845522f6fa44 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:34.609399 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3bbc3abd-271d-4f9f-b366-845522f6fa44 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:34.615614 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3bbc3abd-271d-4f9f-b366-845522f6fa44 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:34.616061 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3bbc3abd-271d-4f9f-b366-845522f6fa44 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:34.616827 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3bbc3abd-271d-4f9f-b366-845522f6fa44 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:34.617261 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3bbc3abd-271d-4f9f-b366-845522f6fa44 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:34.648717 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:26:34.648974 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: Tue Jan 11 15:26:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 (ip 10.222.0.52) !!! Jan 11 15:26:34.742734 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-3bbc3abd-271d-4f9f-b366-845522f6fa44 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:34.750369 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3bbc3abd-271d-4f9f-b366-845522f6fa44 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.145450 Jan 11 15:26:34.750961 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 694/1580] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:34 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:35.766867 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8fe2b7be-8304-47ad-ae2f-46b49d7948e6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:35.767511 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8fe2b7be-8304-47ad-ae2f-46b49d7948e6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:35.773707 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8fe2b7be-8304-47ad-ae2f-46b49d7948e6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:35.774163 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8fe2b7be-8304-47ad-ae2f-46b49d7948e6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:35.774941 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8fe2b7be-8304-47ad-ae2f-46b49d7948e6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:35.775414 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8fe2b7be-8304-47ad-ae2f-46b49d7948e6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:35.902497 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-8fe2b7be-8304-47ad-ae2f-46b49d7948e6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:35.909843 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8fe2b7be-8304-47ad-ae2f-46b49d7948e6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.146629 Jan 11 15:26:35.910413 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 887/1581] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:35 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:36.926239 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-53978220-ea81-4c3c-8c99-d0c672259e98 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:36.926848 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-53978220-ea81-4c3c-8c99-d0c672259e98 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:36.933085 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-53978220-ea81-4c3c-8c99-d0c672259e98 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:36.933532 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-53978220-ea81-4c3c-8c99-d0c672259e98 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:36.934296 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-53978220-ea81-4c3c-8c99-d0c672259e98 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:36.935226 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-53978220-ea81-4c3c-8c99-d0c672259e98 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:37.060786 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-53978220-ea81-4c3c-8c99-d0c672259e98 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:37.068354 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-53978220-ea81-4c3c-8c99-d0c672259e98 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.145741 Jan 11 15:26:37.068909 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 695/1582] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:36 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:38.085484 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c4f6273c-06a9-4866-be64-0ba95535d95a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:38.086125 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c4f6273c-06a9-4866-be64-0ba95535d95a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:38.092965 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c4f6273c-06a9-4866-be64-0ba95535d95a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:38.093417 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c4f6273c-06a9-4866-be64-0ba95535d95a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:38.094190 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c4f6273c-06a9-4866-be64-0ba95535d95a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:38.094630 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c4f6273c-06a9-4866-be64-0ba95535d95a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:38.224300 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c4f6273c-06a9-4866-be64-0ba95535d95a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:38.231607 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c4f6273c-06a9-4866-be64-0ba95535d95a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.149832 Jan 11 15:26:38.232179 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 888/1583] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:38 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:39.247999 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-02c0a800-db06-40ea-a423-4ae7fdb4dfe4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:39.248507 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-02c0a800-db06-40ea-a423-4ae7fdb4dfe4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:39.254700 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-02c0a800-db06-40ea-a423-4ae7fdb4dfe4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:39.255144 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-02c0a800-db06-40ea-a423-4ae7fdb4dfe4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:39.255951 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-02c0a800-db06-40ea-a423-4ae7fdb4dfe4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:39.256385 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-02c0a800-db06-40ea-a423-4ae7fdb4dfe4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:39.385726 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-02c0a800-db06-40ea-a423-4ae7fdb4dfe4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:39.393070 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-02c0a800-db06-40ea-a423-4ae7fdb4dfe4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.148741 Jan 11 15:26:39.393627 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 696/1584] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:39 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:40.409817 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-431f1c0a-b2d6-4256-b5ed-4a45566f9404 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:40.410427 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-431f1c0a-b2d6-4256-b5ed-4a45566f9404 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:40.416824 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-431f1c0a-b2d6-4256-b5ed-4a45566f9404 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:40.417276 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-431f1c0a-b2d6-4256-b5ed-4a45566f9404 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:40.418057 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-431f1c0a-b2d6-4256-b5ed-4a45566f9404 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:40.418501 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-431f1c0a-b2d6-4256-b5ed-4a45566f9404 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:40.543709 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-431f1c0a-b2d6-4256-b5ed-4a45566f9404 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:40.551447 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-431f1c0a-b2d6-4256-b5ed-4a45566f9404 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.145231 Jan 11 15:26:40.552020 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 889/1585] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:40 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:41.568298 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-23d16259-56bc-4b43-aff0-5ef945b7f4f6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:41.568822 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-23d16259-56bc-4b43-aff0-5ef945b7f4f6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:41.575051 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-23d16259-56bc-4b43-aff0-5ef945b7f4f6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:41.576209 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-23d16259-56bc-4b43-aff0-5ef945b7f4f6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:41.576990 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-23d16259-56bc-4b43-aff0-5ef945b7f4f6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:41.577431 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-23d16259-56bc-4b43-aff0-5ef945b7f4f6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:41.706176 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-23d16259-56bc-4b43-aff0-5ef945b7f4f6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:41.713353 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-23d16259-56bc-4b43-aff0-5ef945b7f4f6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.149063 Jan 11 15:26:41.713906 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 697/1586] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:41 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:42.729870 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-141726d7-7cc8-4703-8ac6-53ad387e67c4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:42.730413 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-141726d7-7cc8-4703-8ac6-53ad387e67c4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:42.736723 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-141726d7-7cc8-4703-8ac6-53ad387e67c4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:42.737176 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-141726d7-7cc8-4703-8ac6-53ad387e67c4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:42.737953 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-141726d7-7cc8-4703-8ac6-53ad387e67c4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:42.738391 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-141726d7-7cc8-4703-8ac6-53ad387e67c4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:42.863798 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-141726d7-7cc8-4703-8ac6-53ad387e67c4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:42.871065 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-141726d7-7cc8-4703-8ac6-53ad387e67c4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.144964 Jan 11 15:26:42.871677 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 890/1587] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:42 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:43.888358 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-38b9e27d-19aa-48bf-922b-23a76dbd7afa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:43.889001 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-38b9e27d-19aa-48bf-922b-23a76dbd7afa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:43.895254 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-38b9e27d-19aa-48bf-922b-23a76dbd7afa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:43.895741 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-38b9e27d-19aa-48bf-922b-23a76dbd7afa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:43.896522 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-38b9e27d-19aa-48bf-922b-23a76dbd7afa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:43.896967 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-38b9e27d-19aa-48bf-922b-23a76dbd7afa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:44.027653 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-38b9e27d-19aa-48bf-922b-23a76dbd7afa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:44.035556 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-38b9e27d-19aa-48bf-922b-23a76dbd7afa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.150863 Jan 11 15:26:44.036110 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 698/1588] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:43 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:45.051978 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6f3b1af4-7fee-4450-8ccd-74f5a842cf0b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:45.053254 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6f3b1af4-7fee-4450-8ccd-74f5a842cf0b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:45.059618 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6f3b1af4-7fee-4450-8ccd-74f5a842cf0b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:45.060068 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6f3b1af4-7fee-4450-8ccd-74f5a842cf0b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:45.060846 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6f3b1af4-7fee-4450-8ccd-74f5a842cf0b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:45.061279 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6f3b1af4-7fee-4450-8ccd-74f5a842cf0b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:45.193855 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6f3b1af4-7fee-4450-8ccd-74f5a842cf0b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:45.201149 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6f3b1af4-7fee-4450-8ccd-74f5a842cf0b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.152830 Jan 11 15:26:45.201705 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 891/1589] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:45 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:46.217869 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4d2a4de1-a849-4e32-9dbd-1ca76165e6bb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:46.218531 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4d2a4de1-a849-4e32-9dbd-1ca76165e6bb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:46.224542 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4d2a4de1-a849-4e32-9dbd-1ca76165e6bb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:46.224989 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4d2a4de1-a849-4e32-9dbd-1ca76165e6bb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:46.225758 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4d2a4de1-a849-4e32-9dbd-1ca76165e6bb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:46.226190 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4d2a4de1-a849-4e32-9dbd-1ca76165e6bb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:46.412526 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-4d2a4de1-a849-4e32-9dbd-1ca76165e6bb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:46.419839 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4d2a4de1-a849-4e32-9dbd-1ca76165e6bb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.206100 Jan 11 15:26:46.421081 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 699/1590] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:46 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:47.435993 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2dd29cf3-0f62-4116-952a-cff730ad9684 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:47.436539 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2dd29cf3-0f62-4116-952a-cff730ad9684 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:47.443141 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2dd29cf3-0f62-4116-952a-cff730ad9684 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:47.443627 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2dd29cf3-0f62-4116-952a-cff730ad9684 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:47.444407 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2dd29cf3-0f62-4116-952a-cff730ad9684 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:47.444841 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2dd29cf3-0f62-4116-952a-cff730ad9684 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:47.574308 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-2dd29cf3-0f62-4116-952a-cff730ad9684 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:47.581665 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2dd29cf3-0f62-4116-952a-cff730ad9684 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.149610 Jan 11 15:26:47.582234 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 892/1591] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:47 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:48.599139 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-1d843fdc-0020-4a68-9bc9-b6023898c790 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:48.600464 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-1d843fdc-0020-4a68-9bc9-b6023898c790 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:48.606821 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1d843fdc-0020-4a68-9bc9-b6023898c790 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:48.607279 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1d843fdc-0020-4a68-9bc9-b6023898c790 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:48.608663 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1d843fdc-0020-4a68-9bc9-b6023898c790 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:48.609110 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1d843fdc-0020-4a68-9bc9-b6023898c790 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:48.749236 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-1d843fdc-0020-4a68-9bc9-b6023898c790 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:48.757008 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-1d843fdc-0020-4a68-9bc9-b6023898c790 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.161718 Jan 11 15:26:48.757640 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 700/1592] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:48 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:49.773588 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8da6fa71-8e5d-4d37-b213-4171e99b52ca tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:49.774200 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8da6fa71-8e5d-4d37-b213-4171e99b52ca tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:49.781088 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8da6fa71-8e5d-4d37-b213-4171e99b52ca tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:49.781540 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8da6fa71-8e5d-4d37-b213-4171e99b52ca tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:49.782318 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8da6fa71-8e5d-4d37-b213-4171e99b52ca tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:49.782758 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8da6fa71-8e5d-4d37-b213-4171e99b52ca tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:49.908836 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-8da6fa71-8e5d-4d37-b213-4171e99b52ca tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:49.916113 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8da6fa71-8e5d-4d37-b213-4171e99b52ca tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.146185 Jan 11 15:26:49.916674 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 893/1593] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:49 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:50.932463 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-43ddffff-3c97-48a4-84de-5525d83e0560 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:50.933013 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-43ddffff-3c97-48a4-84de-5525d83e0560 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:50.939828 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-43ddffff-3c97-48a4-84de-5525d83e0560 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:50.940529 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-43ddffff-3c97-48a4-84de-5525d83e0560 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:50.941294 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-43ddffff-3c97-48a4-84de-5525d83e0560 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:50.941725 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-43ddffff-3c97-48a4-84de-5525d83e0560 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:51.073220 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-43ddffff-3c97-48a4-84de-5525d83e0560 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:51.080502 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-43ddffff-3c97-48a4-84de-5525d83e0560 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.151751 Jan 11 15:26:51.081060 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 701/1594] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:50 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:52.097473 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e877c9f1-269e-4eb5-9490-86060f6ff4e1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:52.098091 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e877c9f1-269e-4eb5-9490-86060f6ff4e1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:52.104096 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e877c9f1-269e-4eb5-9490-86060f6ff4e1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:52.104559 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e877c9f1-269e-4eb5-9490-86060f6ff4e1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:52.105359 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e877c9f1-269e-4eb5-9490-86060f6ff4e1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:52.105780 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e877c9f1-269e-4eb5-9490-86060f6ff4e1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:52.233932 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e877c9f1-269e-4eb5-9490-86060f6ff4e1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:52.241138 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e877c9f1-269e-4eb5-9490-86060f6ff4e1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.147421 Jan 11 15:26:52.241696 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 894/1595] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:52 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:53.257945 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-bdb74da6-bdd3-41a8-8be1-a6b97852ed20 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:53.258400 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-bdb74da6-bdd3-41a8-8be1-a6b97852ed20 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:53.264699 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bdb74da6-bdd3-41a8-8be1-a6b97852ed20 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:53.265155 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bdb74da6-bdd3-41a8-8be1-a6b97852ed20 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:53.265933 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bdb74da6-bdd3-41a8-8be1-a6b97852ed20 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:53.266374 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bdb74da6-bdd3-41a8-8be1-a6b97852ed20 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:53.392614 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-bdb74da6-bdd3-41a8-8be1-a6b97852ed20 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:53.399997 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-bdb74da6-bdd3-41a8-8be1-a6b97852ed20 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.145928 Jan 11 15:26:53.400593 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 702/1596] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:53 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:54.417100 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5a43cb0d-a948-4b0c-a187-6e14e2ed0276 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:54.417706 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5a43cb0d-a948-4b0c-a187-6e14e2ed0276 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:54.424462 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5a43cb0d-a948-4b0c-a187-6e14e2ed0276 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:54.424917 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5a43cb0d-a948-4b0c-a187-6e14e2ed0276 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:54.425688 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5a43cb0d-a948-4b0c-a187-6e14e2ed0276 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:54.426129 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5a43cb0d-a948-4b0c-a187-6e14e2ed0276 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:54.557076 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-5a43cb0d-a948-4b0c-a187-6e14e2ed0276 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:54.565302 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5a43cb0d-a948-4b0c-a187-6e14e2ed0276 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.151548 Jan 11 15:26:54.565870 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 895/1597] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:54 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:55.582001 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b7c42aee-ed9a-4620-9081-d1e830732046 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:55.582627 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b7c42aee-ed9a-4620-9081-d1e830732046 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:55.588344 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b7c42aee-ed9a-4620-9081-d1e830732046 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:55.588796 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b7c42aee-ed9a-4620-9081-d1e830732046 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:55.589566 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b7c42aee-ed9a-4620-9081-d1e830732046 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:55.590004 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b7c42aee-ed9a-4620-9081-d1e830732046 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:55.716001 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-b7c42aee-ed9a-4620-9081-d1e830732046 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:55.723741 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b7c42aee-ed9a-4620-9081-d1e830732046 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.145691 Jan 11 15:26:55.724294 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 703/1598] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:55 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:56.740677 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d92930dd-7967-4df6-9e05-c641bd27e1c0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:56.741285 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d92930dd-7967-4df6-9e05-c641bd27e1c0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:56.747570 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d92930dd-7967-4df6-9e05-c641bd27e1c0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:56.748009 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d92930dd-7967-4df6-9e05-c641bd27e1c0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:56.748790 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d92930dd-7967-4df6-9e05-c641bd27e1c0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:56.749232 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d92930dd-7967-4df6-9e05-c641bd27e1c0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:56.881412 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d92930dd-7967-4df6-9e05-c641bd27e1c0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:56.889150 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d92930dd-7967-4df6-9e05-c641bd27e1c0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.151675 Jan 11 15:26:56.889728 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 896/1599] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:56 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:57.906199 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-cf40ebe2-40b9-4399-a867-5bba23cd98c6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:57.906805 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-cf40ebe2-40b9-4399-a867-5bba23cd98c6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:57.913013 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cf40ebe2-40b9-4399-a867-5bba23cd98c6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:57.913458 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cf40ebe2-40b9-4399-a867-5bba23cd98c6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:57.914230 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cf40ebe2-40b9-4399-a867-5bba23cd98c6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:57.914664 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cf40ebe2-40b9-4399-a867-5bba23cd98c6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:58.040087 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-cf40ebe2-40b9-4399-a867-5bba23cd98c6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:58.047857 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-cf40ebe2-40b9-4399-a867-5bba23cd98c6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.145899 Jan 11 15:26:58.048408 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 704/1600] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:57 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:26:59.064297 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e242dc49-6c88-4c17-adc5-a50330d93c40 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:26:59.065161 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e242dc49-6c88-4c17-adc5-a50330d93c40 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:26:59.071637 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e242dc49-6c88-4c17-adc5-a50330d93c40 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:59.072127 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e242dc49-6c88-4c17-adc5-a50330d93c40 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:59.072912 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e242dc49-6c88-4c17-adc5-a50330d93c40 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:26:59.073361 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e242dc49-6c88-4c17-adc5-a50330d93c40 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:26:59.199018 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e242dc49-6c88-4c17-adc5-a50330d93c40 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:26:59.206714 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e242dc49-6c88-4c17-adc5-a50330d93c40 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.146104 Jan 11 15:26:59.207296 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 897/1601] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:26:59 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:00.223165 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-0594dd30-fe6a-421e-a332-0cd30862d38f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:00.223866 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-0594dd30-fe6a-421e-a332-0cd30862d38f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:00.230108 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0594dd30-fe6a-421e-a332-0cd30862d38f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:00.230553 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0594dd30-fe6a-421e-a332-0cd30862d38f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:00.231350 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0594dd30-fe6a-421e-a332-0cd30862d38f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:00.231786 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0594dd30-fe6a-421e-a332-0cd30862d38f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:00.364210 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-0594dd30-fe6a-421e-a332-0cd30862d38f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:00.371341 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-0594dd30-fe6a-421e-a332-0cd30862d38f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.151861 Jan 11 15:27:00.371900 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 705/1602] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:00 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:01.387701 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8aa16f9c-6f92-4cfb-b752-477b3556eb3f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:01.388315 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8aa16f9c-6f92-4cfb-b752-477b3556eb3f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:01.394529 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8aa16f9c-6f92-4cfb-b752-477b3556eb3f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:01.394982 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8aa16f9c-6f92-4cfb-b752-477b3556eb3f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:01.395788 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8aa16f9c-6f92-4cfb-b752-477b3556eb3f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:01.396226 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8aa16f9c-6f92-4cfb-b752-477b3556eb3f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:01.524392 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-8aa16f9c-6f92-4cfb-b752-477b3556eb3f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:01.532212 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8aa16f9c-6f92-4cfb-b752-477b3556eb3f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.148153 Jan 11 15:27:01.532775 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 898/1603] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:01 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:02.548887 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-032b556b-8dfd-4c2f-b935-b9423f159ad2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:02.549442 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-032b556b-8dfd-4c2f-b935-b9423f159ad2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:02.555572 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-032b556b-8dfd-4c2f-b935-b9423f159ad2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:02.556028 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-032b556b-8dfd-4c2f-b935-b9423f159ad2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:02.556793 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-032b556b-8dfd-4c2f-b935-b9423f159ad2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:02.557227 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-032b556b-8dfd-4c2f-b935-b9423f159ad2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:02.685951 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-032b556b-8dfd-4c2f-b935-b9423f159ad2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:02.693440 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-032b556b-8dfd-4c2f-b935-b9423f159ad2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.148316 Jan 11 15:27:02.693991 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 706/1604] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:02 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:03.709823 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-17a68d3a-93db-4cc5-8f28-1e8aa5d7de17 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:03.710373 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-17a68d3a-93db-4cc5-8f28-1e8aa5d7de17 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:03.717264 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-17a68d3a-93db-4cc5-8f28-1e8aa5d7de17 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:03.717718 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-17a68d3a-93db-4cc5-8f28-1e8aa5d7de17 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:03.718495 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-17a68d3a-93db-4cc5-8f28-1e8aa5d7de17 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:03.718937 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-17a68d3a-93db-4cc5-8f28-1e8aa5d7de17 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:03.843795 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-17a68d3a-93db-4cc5-8f28-1e8aa5d7de17 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:03.851042 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-17a68d3a-93db-4cc5-8f28-1e8aa5d7de17 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.144957 Jan 11 15:27:03.851643 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 899/1605] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:03 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:04.867639 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-bb2e3866-ad10-4fea-8f20-394232a756ba tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:04.868278 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-bb2e3866-ad10-4fea-8f20-394232a756ba tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:04.875035 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bb2e3866-ad10-4fea-8f20-394232a756ba tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:04.875524 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bb2e3866-ad10-4fea-8f20-394232a756ba tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:04.876301 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bb2e3866-ad10-4fea-8f20-394232a756ba tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:04.876740 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bb2e3866-ad10-4fea-8f20-394232a756ba tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:05.009945 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-bb2e3866-ad10-4fea-8f20-394232a756ba tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:05.017224 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-bb2e3866-ad10-4fea-8f20-394232a756ba tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.153334 Jan 11 15:27:05.017780 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 707/1606] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:04 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:06.034159 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3c22fd4b-e597-42f8-b20a-d2f292648701 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:06.034771 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3c22fd4b-e597-42f8-b20a-d2f292648701 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:06.040997 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c22fd4b-e597-42f8-b20a-d2f292648701 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:06.041446 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c22fd4b-e597-42f8-b20a-d2f292648701 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:06.042217 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c22fd4b-e597-42f8-b20a-d2f292648701 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:06.042650 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c22fd4b-e597-42f8-b20a-d2f292648701 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:06.168457 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3c22fd4b-e597-42f8-b20a-d2f292648701 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:06.176316 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3c22fd4b-e597-42f8-b20a-d2f292648701 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.145977 Jan 11 15:27:06.176908 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 900/1607] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:06 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:07.193051 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d588f40d-8d32-403d-bde7-76d970268b11 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:07.193673 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d588f40d-8d32-403d-bde7-76d970268b11 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:07.199819 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d588f40d-8d32-403d-bde7-76d970268b11 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:07.200262 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d588f40d-8d32-403d-bde7-76d970268b11 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:07.201534 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d588f40d-8d32-403d-bde7-76d970268b11 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:07.201965 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d588f40d-8d32-403d-bde7-76d970268b11 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:07.329859 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-d588f40d-8d32-403d-bde7-76d970268b11 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:07.337050 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d588f40d-8d32-403d-bde7-76d970268b11 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.147935 Jan 11 15:27:07.337612 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 708/1608] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:07 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:08.353773 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2913dc02-70c0-4ffd-a91a-79335353d75e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:08.354392 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2913dc02-70c0-4ffd-a91a-79335353d75e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:08.361245 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2913dc02-70c0-4ffd-a91a-79335353d75e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:08.361696 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2913dc02-70c0-4ffd-a91a-79335353d75e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:08.362474 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2913dc02-70c0-4ffd-a91a-79335353d75e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:08.362923 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2913dc02-70c0-4ffd-a91a-79335353d75e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:08.492758 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-2913dc02-70c0-4ffd-a91a-79335353d75e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:08.500164 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2913dc02-70c0-4ffd-a91a-79335353d75e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.150121 Jan 11 15:27:08.500728 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 901/1609] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:08 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:09.516790 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2cbb9fe7-6d12-4876-b4c9-c792b4bc707c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:09.517341 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2cbb9fe7-6d12-4876-b4c9-c792b4bc707c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:09.523570 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2cbb9fe7-6d12-4876-b4c9-c792b4bc707c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:09.524028 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2cbb9fe7-6d12-4876-b4c9-c792b4bc707c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:09.524801 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2cbb9fe7-6d12-4876-b4c9-c792b4bc707c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:09.525243 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2cbb9fe7-6d12-4876-b4c9-c792b4bc707c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:09.649699 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-2cbb9fe7-6d12-4876-b4c9-c792b4bc707c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:09.656894 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2cbb9fe7-6d12-4876-b4c9-c792b4bc707c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.143840 Jan 11 15:27:09.657457 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 709/1610] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:09 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:10.673407 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-40a5e080-3568-4bfc-b422-ff53a535e1c4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:10.673955 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-40a5e080-3568-4bfc-b422-ff53a535e1c4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:10.680210 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-40a5e080-3568-4bfc-b422-ff53a535e1c4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:10.680665 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-40a5e080-3568-4bfc-b422-ff53a535e1c4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:10.681450 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-40a5e080-3568-4bfc-b422-ff53a535e1c4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:10.681894 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-40a5e080-3568-4bfc-b422-ff53a535e1c4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:10.816852 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-40a5e080-3568-4bfc-b422-ff53a535e1c4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:10.824223 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-40a5e080-3568-4bfc-b422-ff53a535e1c4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.154632 Jan 11 15:27:10.824800 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 902/1611] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:10 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:11.842192 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-5525ec35-60f6-4324-bc71-f4de7350b181 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:11.842945 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-5525ec35-60f6-4324-bc71-f4de7350b181 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:11.850224 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5525ec35-60f6-4324-bc71-f4de7350b181 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:11.850669 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5525ec35-60f6-4324-bc71-f4de7350b181 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:11.851482 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5525ec35-60f6-4324-bc71-f4de7350b181 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:11.851915 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5525ec35-60f6-4324-bc71-f4de7350b181 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:11.978128 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-5525ec35-60f6-4324-bc71-f4de7350b181 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:11.985945 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-5525ec35-60f6-4324-bc71-f4de7350b181 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.148190 Jan 11 15:27:11.986496 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 710/1612] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:11 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:13.001854 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d6f90561-2751-43f3-bf3c-62709a5ece4c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:13.002416 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d6f90561-2751-43f3-bf3c-62709a5ece4c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:13.008580 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d6f90561-2751-43f3-bf3c-62709a5ece4c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:13.009035 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d6f90561-2751-43f3-bf3c-62709a5ece4c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:13.009919 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d6f90561-2751-43f3-bf3c-62709a5ece4c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:13.010244 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d6f90561-2751-43f3-bf3c-62709a5ece4c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:13.230285 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d6f90561-2751-43f3-bf3c-62709a5ece4c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:13.238296 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d6f90561-2751-43f3-bf3c-62709a5ece4c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.240215 Jan 11 15:27:13.239004 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 903/1613] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:12 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:14.255012 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-896d7d2b-8f5e-4d08-9373-9416195f597d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:14.255579 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-896d7d2b-8f5e-4d08-9373-9416195f597d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:14.261872 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-896d7d2b-8f5e-4d08-9373-9416195f597d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:14.262322 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-896d7d2b-8f5e-4d08-9373-9416195f597d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:14.263094 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-896d7d2b-8f5e-4d08-9373-9416195f597d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:14.263568 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-896d7d2b-8f5e-4d08-9373-9416195f597d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:14.390461 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-896d7d2b-8f5e-4d08-9373-9416195f597d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:14.397686 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-896d7d2b-8f5e-4d08-9373-9416195f597d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.146514 Jan 11 15:27:14.398248 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 711/1614] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:14 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:15.413718 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-594dfc5c-6669-4c85-8670-5dcc07f79e9c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:15.414247 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-594dfc5c-6669-4c85-8670-5dcc07f79e9c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:15.421050 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-594dfc5c-6669-4c85-8670-5dcc07f79e9c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:15.421502 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-594dfc5c-6669-4c85-8670-5dcc07f79e9c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:15.422274 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-594dfc5c-6669-4c85-8670-5dcc07f79e9c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:15.422715 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-594dfc5c-6669-4c85-8670-5dcc07f79e9c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:15.550699 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-594dfc5c-6669-4c85-8670-5dcc07f79e9c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:15.558033 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-594dfc5c-6669-4c85-8670-5dcc07f79e9c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.148015 Jan 11 15:27:15.558597 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 904/1615] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:15 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:16.583182 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-338d08aa-998e-44d7-b315-b7c029560124 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:16.583745 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-338d08aa-998e-44d7-b315-b7c029560124 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:16.590331 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-338d08aa-998e-44d7-b315-b7c029560124 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:16.590783 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-338d08aa-998e-44d7-b315-b7c029560124 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:16.591597 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-338d08aa-998e-44d7-b315-b7c029560124 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:16.592041 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-338d08aa-998e-44d7-b315-b7c029560124 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:16.717137 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-338d08aa-998e-44d7-b315-b7c029560124 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:16.724261 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-338d08aa-998e-44d7-b315-b7c029560124 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.144874 Jan 11 15:27:16.724818 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 712/1616] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:16 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:17.740938 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-638bab78-39cd-4144-b335-e2eae89a7bfa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:17.741563 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-638bab78-39cd-4144-b335-e2eae89a7bfa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:17.747852 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-638bab78-39cd-4144-b335-e2eae89a7bfa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:17.748304 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-638bab78-39cd-4144-b335-e2eae89a7bfa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:17.749081 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-638bab78-39cd-4144-b335-e2eae89a7bfa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:17.749522 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-638bab78-39cd-4144-b335-e2eae89a7bfa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:17.878530 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-638bab78-39cd-4144-b335-e2eae89a7bfa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:17.885849 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-638bab78-39cd-4144-b335-e2eae89a7bfa tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.148561 Jan 11 15:27:17.886408 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 905/1617] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:17 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:18.902840 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-313f7126-3d44-4f68-abfd-981a3a9f1468 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:18.903484 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-313f7126-3d44-4f68-abfd-981a3a9f1468 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:18.910197 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-313f7126-3d44-4f68-abfd-981a3a9f1468 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:18.910650 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-313f7126-3d44-4f68-abfd-981a3a9f1468 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:18.911459 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-313f7126-3d44-4f68-abfd-981a3a9f1468 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:18.911904 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-313f7126-3d44-4f68-abfd-981a3a9f1468 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:19.041189 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-313f7126-3d44-4f68-abfd-981a3a9f1468 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:19.049086 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-313f7126-3d44-4f68-abfd-981a3a9f1468 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.149889 Jan 11 15:27:19.049636 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 713/1618] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:18 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:20.065593 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ee6ca19a-35dc-4576-a3d0-dbf4b2d5f97f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:20.066200 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ee6ca19a-35dc-4576-a3d0-dbf4b2d5f97f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:20.072478 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ee6ca19a-35dc-4576-a3d0-dbf4b2d5f97f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:20.072924 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ee6ca19a-35dc-4576-a3d0-dbf4b2d5f97f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:20.073701 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ee6ca19a-35dc-4576-a3d0-dbf4b2d5f97f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:20.074136 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ee6ca19a-35dc-4576-a3d0-dbf4b2d5f97f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:20.199828 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ee6ca19a-35dc-4576-a3d0-dbf4b2d5f97f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:20.207525 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ee6ca19a-35dc-4576-a3d0-dbf4b2d5f97f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.145764 Jan 11 15:27:20.208087 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 906/1619] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:20 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:21.224297 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-23c13d35-c3a2-47b7-9e4b-612d1387dc6a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:21.224935 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-23c13d35-c3a2-47b7-9e4b-612d1387dc6a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:21.231078 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-23c13d35-c3a2-47b7-9e4b-612d1387dc6a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:21.231562 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-23c13d35-c3a2-47b7-9e4b-612d1387dc6a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:21.232330 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-23c13d35-c3a2-47b7-9e4b-612d1387dc6a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:21.232763 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-23c13d35-c3a2-47b7-9e4b-612d1387dc6a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:21.363816 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-23c13d35-c3a2-47b7-9e4b-612d1387dc6a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:21.370992 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-23c13d35-c3a2-47b7-9e4b-612d1387dc6a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.150328 Jan 11 15:27:21.371598 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 714/1620] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:21 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:22.387629 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c06bc8cc-a888-4677-b01d-534648e8bcef tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:22.388228 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c06bc8cc-a888-4677-b01d-534648e8bcef tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:22.394621 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c06bc8cc-a888-4677-b01d-534648e8bcef tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:22.395096 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c06bc8cc-a888-4677-b01d-534648e8bcef tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:22.395884 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c06bc8cc-a888-4677-b01d-534648e8bcef tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:22.396320 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c06bc8cc-a888-4677-b01d-534648e8bcef tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:22.521679 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c06bc8cc-a888-4677-b01d-534648e8bcef tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:22.530125 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c06bc8cc-a888-4677-b01d-534648e8bcef tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.146256 Jan 11 15:27:22.530693 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 907/1621] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:22 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:23.547333 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-cdb5f946-04a5-492b-b02c-1cf8118bdc70 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:23.547940 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-cdb5f946-04a5-492b-b02c-1cf8118bdc70 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:23.553778 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cdb5f946-04a5-492b-b02c-1cf8118bdc70 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:23.554220 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cdb5f946-04a5-492b-b02c-1cf8118bdc70 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:23.554984 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cdb5f946-04a5-492b-b02c-1cf8118bdc70 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:23.555443 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cdb5f946-04a5-492b-b02c-1cf8118bdc70 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:23.679160 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-cdb5f946-04a5-492b-b02c-1cf8118bdc70 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:23.686433 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-cdb5f946-04a5-492b-b02c-1cf8118bdc70 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.143488 Jan 11 15:27:23.686984 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 715/1622] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:23 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:24.703063 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-256cfc52-adca-4d23-b048-381c79c6900b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:24.703759 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-256cfc52-adca-4d23-b048-381c79c6900b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:24.710049 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-256cfc52-adca-4d23-b048-381c79c6900b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:24.710502 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-256cfc52-adca-4d23-b048-381c79c6900b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:24.711285 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-256cfc52-adca-4d23-b048-381c79c6900b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:24.711747 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-256cfc52-adca-4d23-b048-381c79c6900b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:24.844827 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-256cfc52-adca-4d23-b048-381c79c6900b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:24.852059 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-256cfc52-adca-4d23-b048-381c79c6900b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.152621 Jan 11 15:27:24.852632 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 908/1623] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:24 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:25.869284 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2bfd1dea-01d8-4aeb-bc17-4872b4da4851 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:25.869899 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2bfd1dea-01d8-4aeb-bc17-4872b4da4851 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:25.876976 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2bfd1dea-01d8-4aeb-bc17-4872b4da4851 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:25.877426 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2bfd1dea-01d8-4aeb-bc17-4872b4da4851 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:25.878202 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2bfd1dea-01d8-4aeb-bc17-4872b4da4851 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:25.878667 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2bfd1dea-01d8-4aeb-bc17-4872b4da4851 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:26.003462 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-2bfd1dea-01d8-4aeb-bc17-4872b4da4851 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:26.010596 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2bfd1dea-01d8-4aeb-bc17-4872b4da4851 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.145000 Jan 11 15:27:26.011152 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 716/1624] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:25 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:27.027168 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2040f92b-8c8d-4c72-ab23-4d1bf9a1782e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:27.027810 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2040f92b-8c8d-4c72-ab23-4d1bf9a1782e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:27.034449 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2040f92b-8c8d-4c72-ab23-4d1bf9a1782e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:27.034897 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2040f92b-8c8d-4c72-ab23-4d1bf9a1782e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:27.035700 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2040f92b-8c8d-4c72-ab23-4d1bf9a1782e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:27.036133 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2040f92b-8c8d-4c72-ab23-4d1bf9a1782e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:27.165111 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-2040f92b-8c8d-4c72-ab23-4d1bf9a1782e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:27.173011 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2040f92b-8c8d-4c72-ab23-4d1bf9a1782e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.149515 Jan 11 15:27:27.173585 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 909/1625] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:27 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:28.190221 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-18f0c82d-dcd9-484a-b6b2-8b04e0623018 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:28.190823 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-18f0c82d-dcd9-484a-b6b2-8b04e0623018 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:28.197103 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-18f0c82d-dcd9-484a-b6b2-8b04e0623018 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:28.197548 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-18f0c82d-dcd9-484a-b6b2-8b04e0623018 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:28.198307 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-18f0c82d-dcd9-484a-b6b2-8b04e0623018 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:28.198737 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-18f0c82d-dcd9-484a-b6b2-8b04e0623018 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:28.326782 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-18f0c82d-dcd9-484a-b6b2-8b04e0623018 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:28.334017 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-18f0c82d-dcd9-484a-b6b2-8b04e0623018 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.148249 Jan 11 15:27:28.334573 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 717/1626] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:28 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:29.349853 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b60b6cea-565a-4df0-b6f5-56db7a8e9a5f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:29.350387 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b60b6cea-565a-4df0-b6f5-56db7a8e9a5f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:29.356657 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b60b6cea-565a-4df0-b6f5-56db7a8e9a5f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:29.357103 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b60b6cea-565a-4df0-b6f5-56db7a8e9a5f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:29.358473 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b60b6cea-565a-4df0-b6f5-56db7a8e9a5f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:29.358911 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b60b6cea-565a-4df0-b6f5-56db7a8e9a5f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:29.488324 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b60b6cea-565a-4df0-b6f5-56db7a8e9a5f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:29.495578 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b60b6cea-565a-4df0-b6f5-56db7a8e9a5f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.149452 Jan 11 15:27:29.496150 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 910/1627] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:29 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:30.512252 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f1b3cd5c-3d3c-4c59-b5b5-f5bd9af1c162 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:30.512787 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f1b3cd5c-3d3c-4c59-b5b5-f5bd9af1c162 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:30.519018 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f1b3cd5c-3d3c-4c59-b5b5-f5bd9af1c162 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:30.519498 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f1b3cd5c-3d3c-4c59-b5b5-f5bd9af1c162 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:30.520269 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f1b3cd5c-3d3c-4c59-b5b5-f5bd9af1c162 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:30.520698 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f1b3cd5c-3d3c-4c59-b5b5-f5bd9af1c162 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:30.646507 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-f1b3cd5c-3d3c-4c59-b5b5-f5bd9af1c162 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:30.653687 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f1b3cd5c-3d3c-4c59-b5b5-f5bd9af1c162 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.145200 Jan 11 15:27:30.654242 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 718/1628] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:30 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:31.669710 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-37efcba1-a18b-48cc-a2c1-d31f70cf383b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:31.670962 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-37efcba1-a18b-48cc-a2c1-d31f70cf383b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:31.677203 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-37efcba1-a18b-48cc-a2c1-d31f70cf383b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:31.677652 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-37efcba1-a18b-48cc-a2c1-d31f70cf383b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:31.678431 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-37efcba1-a18b-48cc-a2c1-d31f70cf383b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:31.678867 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-37efcba1-a18b-48cc-a2c1-d31f70cf383b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:31.803951 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-37efcba1-a18b-48cc-a2c1-d31f70cf383b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:31.811251 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-37efcba1-a18b-48cc-a2c1-d31f70cf383b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.145227 Jan 11 15:27:31.811852 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 911/1629] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:31 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:32.828261 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-550d61ad-a318-4720-be3e-85d0ffc11ea8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:32.828918 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-550d61ad-a318-4720-be3e-85d0ffc11ea8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:32.835167 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-550d61ad-a318-4720-be3e-85d0ffc11ea8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:32.835656 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-550d61ad-a318-4720-be3e-85d0ffc11ea8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:32.836463 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-550d61ad-a318-4720-be3e-85d0ffc11ea8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:32.836908 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-550d61ad-a318-4720-be3e-85d0ffc11ea8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:32.969599 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-550d61ad-a318-4720-be3e-85d0ffc11ea8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:32.976820 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-550d61ad-a318-4720-be3e-85d0ffc11ea8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.152307 Jan 11 15:27:32.977385 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 719/1630] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:32 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:33.993637 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-337e39a4-f647-4667-b741-3fb4e0f47ee6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:33.994199 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-337e39a4-f647-4667-b741-3fb4e0f47ee6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:34.000888 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-337e39a4-f647-4667-b741-3fb4e0f47ee6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:34.001340 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-337e39a4-f647-4667-b741-3fb4e0f47ee6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:34.002118 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-337e39a4-f647-4667-b741-3fb4e0f47ee6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:34.002560 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-337e39a4-f647-4667-b741-3fb4e0f47ee6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:34.128446 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-337e39a4-f647-4667-b741-3fb4e0f47ee6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:34.135665 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-337e39a4-f647-4667-b741-3fb4e0f47ee6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.145727 Jan 11 15:27:34.136226 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 912/1631] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:33 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:35.152230 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-868d67f8-3035-4017-bae2-2dff67a3738c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:35.152832 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-868d67f8-3035-4017-bae2-2dff67a3738c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:35.160433 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-868d67f8-3035-4017-bae2-2dff67a3738c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:35.160910 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-868d67f8-3035-4017-bae2-2dff67a3738c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:35.162128 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-868d67f8-3035-4017-bae2-2dff67a3738c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:35.162871 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-868d67f8-3035-4017-bae2-2dff67a3738c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:35.295977 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-868d67f8-3035-4017-bae2-2dff67a3738c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:35.303315 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-868d67f8-3035-4017-bae2-2dff67a3738c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.154718 Jan 11 15:27:35.303947 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 720/1632] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:35 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:36.321075 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-547d0774-c1cf-4d8a-9c5f-b26ee572b27a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:36.321689 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-547d0774-c1cf-4d8a-9c5f-b26ee572b27a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:36.328505 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-547d0774-c1cf-4d8a-9c5f-b26ee572b27a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:36.328957 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-547d0774-c1cf-4d8a-9c5f-b26ee572b27a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:36.329734 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-547d0774-c1cf-4d8a-9c5f-b26ee572b27a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:36.330177 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-547d0774-c1cf-4d8a-9c5f-b26ee572b27a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:36.454448 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-547d0774-c1cf-4d8a-9c5f-b26ee572b27a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:36.461815 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-547d0774-c1cf-4d8a-9c5f-b26ee572b27a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.144441 Jan 11 15:27:36.462383 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 913/1633] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:36 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:37.478377 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-16aec033-7f80-4b2c-901a-ce4de9dec3cd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:37.478917 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-16aec033-7f80-4b2c-901a-ce4de9dec3cd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:37.485177 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-16aec033-7f80-4b2c-901a-ce4de9dec3cd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:37.485628 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-16aec033-7f80-4b2c-901a-ce4de9dec3cd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:37.486429 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-16aec033-7f80-4b2c-901a-ce4de9dec3cd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:37.486867 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-16aec033-7f80-4b2c-901a-ce4de9dec3cd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:37.611213 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-16aec033-7f80-4b2c-901a-ce4de9dec3cd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:37.618407 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-16aec033-7f80-4b2c-901a-ce4de9dec3cd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.143783 Jan 11 15:27:37.619005 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 721/1634] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:37 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:38.634919 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-730fbf9e-0417-4ef5-838f-b1cf02e14b86 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:38.635563 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-730fbf9e-0417-4ef5-838f-b1cf02e14b86 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:38.642307 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-730fbf9e-0417-4ef5-838f-b1cf02e14b86 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:38.642759 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-730fbf9e-0417-4ef5-838f-b1cf02e14b86 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:38.643564 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-730fbf9e-0417-4ef5-838f-b1cf02e14b86 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:38.644003 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-730fbf9e-0417-4ef5-838f-b1cf02e14b86 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:38.773378 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-730fbf9e-0417-4ef5-838f-b1cf02e14b86 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:38.781227 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-730fbf9e-0417-4ef5-838f-b1cf02e14b86 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.149975 Jan 11 15:27:38.781789 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 914/1635] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:38 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:39.797657 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7f0267db-914c-446f-b42d-80aeb4a42893 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:39.798264 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7f0267db-914c-446f-b42d-80aeb4a42893 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:39.804513 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7f0267db-914c-446f-b42d-80aeb4a42893 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:39.804959 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7f0267db-914c-446f-b42d-80aeb4a42893 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:39.805724 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7f0267db-914c-446f-b42d-80aeb4a42893 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:39.806156 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7f0267db-914c-446f-b42d-80aeb4a42893 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:39.930858 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-7f0267db-914c-446f-b42d-80aeb4a42893 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:39.938485 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7f0267db-914c-446f-b42d-80aeb4a42893 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.144793 Jan 11 15:27:39.939048 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 722/1636] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:39 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:40.954747 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b9149996-c6c6-493b-9c2f-0a123b66acdf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:40.955377 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b9149996-c6c6-493b-9c2f-0a123b66acdf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:40.961634 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b9149996-c6c6-493b-9c2f-0a123b66acdf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:40.962083 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b9149996-c6c6-493b-9c2f-0a123b66acdf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:40.962852 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b9149996-c6c6-493b-9c2f-0a123b66acdf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:40.963297 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b9149996-c6c6-493b-9c2f-0a123b66acdf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:41.092776 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b9149996-c6c6-493b-9c2f-0a123b66acdf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:41.099985 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b9149996-c6c6-493b-9c2f-0a123b66acdf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.149353 Jan 11 15:27:41.100554 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 915/1637] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:40 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:42.116366 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-73dcc340-f4d2-4dc9-be1a-e51980ec3154 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:42.116976 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-73dcc340-f4d2-4dc9-be1a-e51980ec3154 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:42.123241 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-73dcc340-f4d2-4dc9-be1a-e51980ec3154 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:42.123724 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-73dcc340-f4d2-4dc9-be1a-e51980ec3154 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:42.124502 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-73dcc340-f4d2-4dc9-be1a-e51980ec3154 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:42.124941 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-73dcc340-f4d2-4dc9-be1a-e51980ec3154 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:42.249386 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-73dcc340-f4d2-4dc9-be1a-e51980ec3154 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:42.256683 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-73dcc340-f4d2-4dc9-be1a-e51980ec3154 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.143965 Jan 11 15:27:42.257705 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 723/1638] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:42 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:43.278709 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-dade8e48-fefd-4ddc-baa9-08a687a38a22 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:43.278709 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-dade8e48-fefd-4ddc-baa9-08a687a38a22 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:43.280533 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dade8e48-fefd-4ddc-baa9-08a687a38a22 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:43.280993 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dade8e48-fefd-4ddc-baa9-08a687a38a22 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:43.281774 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dade8e48-fefd-4ddc-baa9-08a687a38a22 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:43.282220 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dade8e48-fefd-4ddc-baa9-08a687a38a22 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:43.411676 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-dade8e48-fefd-4ddc-baa9-08a687a38a22 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:43.418978 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-dade8e48-fefd-4ddc-baa9-08a687a38a22 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.149879 Jan 11 15:27:43.419580 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 916/1639] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:43 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:44.436424 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-bd8bd9ab-dc00-44a0-9a68-0842e0e28303 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:44.437013 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-bd8bd9ab-dc00-44a0-9a68-0842e0e28303 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:44.443459 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bd8bd9ab-dc00-44a0-9a68-0842e0e28303 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:44.443907 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bd8bd9ab-dc00-44a0-9a68-0842e0e28303 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:44.444704 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bd8bd9ab-dc00-44a0-9a68-0842e0e28303 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:44.445133 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bd8bd9ab-dc00-44a0-9a68-0842e0e28303 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:44.570085 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-bd8bd9ab-dc00-44a0-9a68-0842e0e28303 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:44.577909 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-bd8bd9ab-dc00-44a0-9a68-0842e0e28303 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.145668 Jan 11 15:27:44.578464 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 724/1640] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:44 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:45.199354 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:27:45.199885 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: Tue Jan 11 15:27:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:27:45.301091 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:27:45.301259 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: Tue Jan 11 15:27:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:27:45.594160 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-120a0745-7172-4852-9884-7a95947569f1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:45.594694 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-120a0745-7172-4852-9884-7a95947569f1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:45.600928 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-120a0745-7172-4852-9884-7a95947569f1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:45.601378 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-120a0745-7172-4852-9884-7a95947569f1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:45.602148 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-120a0745-7172-4852-9884-7a95947569f1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:45.602591 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-120a0745-7172-4852-9884-7a95947569f1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:45.728512 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-120a0745-7172-4852-9884-7a95947569f1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:45.736271 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-120a0745-7172-4852-9884-7a95947569f1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.145831 Jan 11 15:27:45.736835 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 917/1641] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:45 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:46.753294 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f94834ff-f793-492d-9e7a-dff635be2a7a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:46.753896 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f94834ff-f793-492d-9e7a-dff635be2a7a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:46.760166 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f94834ff-f793-492d-9e7a-dff635be2a7a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:46.760611 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f94834ff-f793-492d-9e7a-dff635be2a7a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:46.761376 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f94834ff-f793-492d-9e7a-dff635be2a7a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:46.761810 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f94834ff-f793-492d-9e7a-dff635be2a7a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:46.890955 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-f94834ff-f793-492d-9e7a-dff635be2a7a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:46.901428 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f94834ff-f793-492d-9e7a-dff635be2a7a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.151527 Jan 11 15:27:46.902460 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 725/1642] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:46 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:47.918297 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-293f9a2a-8db3-4184-8428-f2d18eeb20e6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:47.918912 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-293f9a2a-8db3-4184-8428-f2d18eeb20e6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:47.925670 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-293f9a2a-8db3-4184-8428-f2d18eeb20e6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:47.926123 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-293f9a2a-8db3-4184-8428-f2d18eeb20e6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:47.926900 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-293f9a2a-8db3-4184-8428-f2d18eeb20e6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:47.927371 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-293f9a2a-8db3-4184-8428-f2d18eeb20e6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:48.056677 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-293f9a2a-8db3-4184-8428-f2d18eeb20e6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:48.064193 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-293f9a2a-8db3-4184-8428-f2d18eeb20e6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.149598 Jan 11 15:27:48.064751 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 918/1643] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:47 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:49.081283 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3024fdae-b9bb-4623-b68e-7830f6e3b6f2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:49.082002 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3024fdae-b9bb-4623-b68e-7830f6e3b6f2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:49.088369 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3024fdae-b9bb-4623-b68e-7830f6e3b6f2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:49.088821 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3024fdae-b9bb-4623-b68e-7830f6e3b6f2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:49.089594 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3024fdae-b9bb-4623-b68e-7830f6e3b6f2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:49.090032 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3024fdae-b9bb-4623-b68e-7830f6e3b6f2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:49.219280 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-3024fdae-b9bb-4623-b68e-7830f6e3b6f2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:49.226502 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3024fdae-b9bb-4623-b68e-7830f6e3b6f2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.148841 Jan 11 15:27:49.227052 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 726/1644] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:49 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:50.243588 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-62e0dba8-a9d8-4fa7-ae94-7bdc3a42cdc3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:50.244198 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-62e0dba8-a9d8-4fa7-ae94-7bdc3a42cdc3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:50.250973 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-62e0dba8-a9d8-4fa7-ae94-7bdc3a42cdc3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:50.251457 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-62e0dba8-a9d8-4fa7-ae94-7bdc3a42cdc3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:50.252236 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-62e0dba8-a9d8-4fa7-ae94-7bdc3a42cdc3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:50.252674 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-62e0dba8-a9d8-4fa7-ae94-7bdc3a42cdc3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:50.384100 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-62e0dba8-a9d8-4fa7-ae94-7bdc3a42cdc3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:50.391856 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-62e0dba8-a9d8-4fa7-ae94-7bdc3a42cdc3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.151850 Jan 11 15:27:50.392424 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 919/1645] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:50 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:51.408469 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2ec5a957-e418-4c6f-9f3d-b734ef511cc3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:51.408999 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2ec5a957-e418-4c6f-9f3d-b734ef511cc3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:51.415216 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2ec5a957-e418-4c6f-9f3d-b734ef511cc3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:51.415700 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2ec5a957-e418-4c6f-9f3d-b734ef511cc3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:51.416475 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2ec5a957-e418-4c6f-9f3d-b734ef511cc3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:51.416912 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2ec5a957-e418-4c6f-9f3d-b734ef511cc3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:51.541568 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-2ec5a957-e418-4c6f-9f3d-b734ef511cc3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:51.549345 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2ec5a957-e418-4c6f-9f3d-b734ef511cc3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.144572 Jan 11 15:27:51.549897 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 727/1646] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:51 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:52.566187 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-37a9cc97-e684-41a2-b6a7-4ccb8939c0b6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:52.566762 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-37a9cc97-e684-41a2-b6a7-4ccb8939c0b6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:52.572720 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-37a9cc97-e684-41a2-b6a7-4ccb8939c0b6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:52.573172 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-37a9cc97-e684-41a2-b6a7-4ccb8939c0b6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:52.573953 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-37a9cc97-e684-41a2-b6a7-4ccb8939c0b6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:52.574392 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-37a9cc97-e684-41a2-b6a7-4ccb8939c0b6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:52.702796 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-37a9cc97-e684-41a2-b6a7-4ccb8939c0b6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:52.710290 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-37a9cc97-e684-41a2-b6a7-4ccb8939c0b6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.148134 Jan 11 15:27:52.711058 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 920/1647] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:52 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:53.727788 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-eb220524-79f8-4528-b874-667ae051d832 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:53.728373 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-eb220524-79f8-4528-b874-667ae051d832 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:53.734169 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-eb220524-79f8-4528-b874-667ae051d832 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:53.734628 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-eb220524-79f8-4528-b874-667ae051d832 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:53.735438 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-eb220524-79f8-4528-b874-667ae051d832 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:53.735880 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-eb220524-79f8-4528-b874-667ae051d832 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:53.863061 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-eb220524-79f8-4528-b874-667ae051d832 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:53.870196 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-eb220524-79f8-4528-b874-667ae051d832 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.146387 Jan 11 15:27:53.870753 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 728/1648] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:53 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:54.887285 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1a89fe22-d357-4055-b270-2b0a6755af69 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:54.887875 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1a89fe22-d357-4055-b270-2b0a6755af69 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:54.894606 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1a89fe22-d357-4055-b270-2b0a6755af69 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:54.895054 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1a89fe22-d357-4055-b270-2b0a6755af69 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:54.895849 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1a89fe22-d357-4055-b270-2b0a6755af69 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:54.896286 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1a89fe22-d357-4055-b270-2b0a6755af69 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:55.032948 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1a89fe22-d357-4055-b270-2b0a6755af69 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:55.041312 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1a89fe22-d357-4055-b270-2b0a6755af69 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.157791 Jan 11 15:27:55.046598 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 921/1649] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:54 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:56.057920 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3851d6ca-b89a-4b99-93b8-4f659cdf56f2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:56.058527 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3851d6ca-b89a-4b99-93b8-4f659cdf56f2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:56.065075 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3851d6ca-b89a-4b99-93b8-4f659cdf56f2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:56.065525 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3851d6ca-b89a-4b99-93b8-4f659cdf56f2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:56.066295 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3851d6ca-b89a-4b99-93b8-4f659cdf56f2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:56.066728 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3851d6ca-b89a-4b99-93b8-4f659cdf56f2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:56.191335 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-3851d6ca-b89a-4b99-93b8-4f659cdf56f2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:56.198738 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3851d6ca-b89a-4b99-93b8-4f659cdf56f2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.144395 Jan 11 15:27:56.199331 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 729/1650] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:56 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:57.215601 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ff687d20-2265-40ca-95d8-83ed026ee049 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:57.216748 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ff687d20-2265-40ca-95d8-83ed026ee049 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:57.223010 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ff687d20-2265-40ca-95d8-83ed026ee049 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:57.223499 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ff687d20-2265-40ca-95d8-83ed026ee049 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:57.224279 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ff687d20-2265-40ca-95d8-83ed026ee049 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:57.224725 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ff687d20-2265-40ca-95d8-83ed026ee049 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:57.358166 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ff687d20-2265-40ca-95d8-83ed026ee049 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:57.365501 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ff687d20-2265-40ca-95d8-83ed026ee049 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.153544 Jan 11 15:27:57.366059 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 922/1651] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:57 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:58.382088 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a3591d50-fe42-4a82-a02b-2ea178061ade tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:58.382796 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a3591d50-fe42-4a82-a02b-2ea178061ade tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:58.389535 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a3591d50-fe42-4a82-a02b-2ea178061ade tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:58.390016 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a3591d50-fe42-4a82-a02b-2ea178061ade tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:58.390791 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a3591d50-fe42-4a82-a02b-2ea178061ade tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:58.391228 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a3591d50-fe42-4a82-a02b-2ea178061ade tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:58.518230 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-a3591d50-fe42-4a82-a02b-2ea178061ade tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:58.525640 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a3591d50-fe42-4a82-a02b-2ea178061ade tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.147252 Jan 11 15:27:58.531375 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 730/1652] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:58 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:27:59.542065 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e5bd7e73-7190-47b1-9b15-0491ca6709d9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:27:59.542675 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e5bd7e73-7190-47b1-9b15-0491ca6709d9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:27:59.549630 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e5bd7e73-7190-47b1-9b15-0491ca6709d9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:59.550108 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e5bd7e73-7190-47b1-9b15-0491ca6709d9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:59.550885 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e5bd7e73-7190-47b1-9b15-0491ca6709d9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:27:59.551346 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e5bd7e73-7190-47b1-9b15-0491ca6709d9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:27:59.676838 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e5bd7e73-7190-47b1-9b15-0491ca6709d9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:27:59.683984 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e5bd7e73-7190-47b1-9b15-0491ca6709d9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.145559 Jan 11 15:27:59.684548 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 923/1653] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:27:59 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:00.700944 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-33155353-8d19-495b-a4d7-841a05beb2b0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:00.701486 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-33155353-8d19-495b-a4d7-841a05beb2b0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:00.707706 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-33155353-8d19-495b-a4d7-841a05beb2b0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:00.708158 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-33155353-8d19-495b-a4d7-841a05beb2b0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:00.708935 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-33155353-8d19-495b-a4d7-841a05beb2b0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:00.709372 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-33155353-8d19-495b-a4d7-841a05beb2b0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:00.839760 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-33155353-8d19-495b-a4d7-841a05beb2b0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:00.847548 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-33155353-8d19-495b-a4d7-841a05beb2b0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.150310 Jan 11 15:28:00.853111 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 731/1654] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:00 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:01.864609 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c8fcfaa5-f85d-4a0e-a571-4a54cc2945cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:01.865250 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c8fcfaa5-f85d-4a0e-a571-4a54cc2945cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:01.871569 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c8fcfaa5-f85d-4a0e-a571-4a54cc2945cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:01.872060 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c8fcfaa5-f85d-4a0e-a571-4a54cc2945cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:01.872842 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c8fcfaa5-f85d-4a0e-a571-4a54cc2945cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:01.873290 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c8fcfaa5-f85d-4a0e-a571-4a54cc2945cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:01.997482 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c8fcfaa5-f85d-4a0e-a571-4a54cc2945cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:02.004701 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c8fcfaa5-f85d-4a0e-a571-4a54cc2945cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.143725 Jan 11 15:28:02.005272 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 924/1655] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:01 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:03.021654 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-854486ae-540e-4532-88af-fa7fc6eed461 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:03.022268 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-854486ae-540e-4532-88af-fa7fc6eed461 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:03.029097 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-854486ae-540e-4532-88af-fa7fc6eed461 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:03.029550 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-854486ae-540e-4532-88af-fa7fc6eed461 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:03.030328 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-854486ae-540e-4532-88af-fa7fc6eed461 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:03.030762 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-854486ae-540e-4532-88af-fa7fc6eed461 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:03.157429 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-854486ae-540e-4532-88af-fa7fc6eed461 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:03.164657 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-854486ae-540e-4532-88af-fa7fc6eed461 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.146644 Jan 11 15:28:03.165226 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 732/1656] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:03 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:04.181919 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e56d20f7-626e-4224-8472-1625107080fe tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:04.182530 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e56d20f7-626e-4224-8472-1625107080fe tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:04.189012 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e56d20f7-626e-4224-8472-1625107080fe tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:04.189457 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e56d20f7-626e-4224-8472-1625107080fe tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:04.190224 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e56d20f7-626e-4224-8472-1625107080fe tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:04.190656 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e56d20f7-626e-4224-8472-1625107080fe tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:04.317837 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e56d20f7-626e-4224-8472-1625107080fe tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:04.325618 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e56d20f7-626e-4224-8472-1625107080fe tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.146876 Jan 11 15:28:04.326720 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 925/1657] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:04 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:05.342455 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-474c3fd9-b1ca-430b-99ca-d70e43dc6590 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:05.343043 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-474c3fd9-b1ca-430b-99ca-d70e43dc6590 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:05.349231 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-474c3fd9-b1ca-430b-99ca-d70e43dc6590 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:05.349677 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-474c3fd9-b1ca-430b-99ca-d70e43dc6590 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:05.350442 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-474c3fd9-b1ca-430b-99ca-d70e43dc6590 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:05.350872 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-474c3fd9-b1ca-430b-99ca-d70e43dc6590 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:05.476498 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-474c3fd9-b1ca-430b-99ca-d70e43dc6590 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:05.484278 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-474c3fd9-b1ca-430b-99ca-d70e43dc6590 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.146126 Jan 11 15:28:05.484835 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 733/1658] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:05 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:06.501478 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f70a75a9-adcc-40aa-9e0d-b3860813eb77 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:06.502087 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f70a75a9-adcc-40aa-9e0d-b3860813eb77 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:06.508414 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f70a75a9-adcc-40aa-9e0d-b3860813eb77 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:06.508822 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f70a75a9-adcc-40aa-9e0d-b3860813eb77 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:06.509592 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f70a75a9-adcc-40aa-9e0d-b3860813eb77 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:06.510029 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f70a75a9-adcc-40aa-9e0d-b3860813eb77 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:06.638346 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f70a75a9-adcc-40aa-9e0d-b3860813eb77 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:06.645583 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f70a75a9-adcc-40aa-9e0d-b3860813eb77 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.148426 Jan 11 15:28:06.646164 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 926/1659] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:06 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:07.662085 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f8ea034c-f998-4592-98a9-73e838babb5d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:07.662694 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f8ea034c-f998-4592-98a9-73e838babb5d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:07.669588 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f8ea034c-f998-4592-98a9-73e838babb5d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:07.670037 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f8ea034c-f998-4592-98a9-73e838babb5d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:07.670809 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f8ea034c-f998-4592-98a9-73e838babb5d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:07.671245 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f8ea034c-f998-4592-98a9-73e838babb5d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:07.796217 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-f8ea034c-f998-4592-98a9-73e838babb5d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:07.803348 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f8ea034c-f998-4592-98a9-73e838babb5d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.144888 Jan 11 15:28:07.803902 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 734/1660] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:07 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:08.820005 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7c3ed65f-e078-4aac-8a8c-62ca5a1400b9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:08.820655 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-7c3ed65f-e078-4aac-8a8c-62ca5a1400b9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:08.826881 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7c3ed65f-e078-4aac-8a8c-62ca5a1400b9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:08.827363 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7c3ed65f-e078-4aac-8a8c-62ca5a1400b9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:08.828134 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7c3ed65f-e078-4aac-8a8c-62ca5a1400b9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:08.828574 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7c3ed65f-e078-4aac-8a8c-62ca5a1400b9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:08.955596 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-7c3ed65f-e078-4aac-8a8c-62ca5a1400b9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:08.962708 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7c3ed65f-e078-4aac-8a8c-62ca5a1400b9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.146361 Jan 11 15:28:08.963275 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 927/1661] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:08 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:09.979538 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ed193e3b-210d-40d3-be83-5248c62a6526 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:09.980146 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-ed193e3b-210d-40d3-be83-5248c62a6526 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:09.986273 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ed193e3b-210d-40d3-be83-5248c62a6526 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:09.986714 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ed193e3b-210d-40d3-be83-5248c62a6526 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:09.987506 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ed193e3b-210d-40d3-be83-5248c62a6526 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:09.987942 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ed193e3b-210d-40d3-be83-5248c62a6526 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:10.112443 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-ed193e3b-210d-40d3-be83-5248c62a6526 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:10.119645 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-ed193e3b-210d-40d3-be83-5248c62a6526 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.143652 Jan 11 15:28:10.120195 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 735/1662] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:09 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:11.136650 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ac427fde-d71f-4bd8-b735-bc5d1e8dda4c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:11.137269 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ac427fde-d71f-4bd8-b735-bc5d1e8dda4c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:11.144000 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ac427fde-d71f-4bd8-b735-bc5d1e8dda4c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:11.144454 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ac427fde-d71f-4bd8-b735-bc5d1e8dda4c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:11.145235 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ac427fde-d71f-4bd8-b735-bc5d1e8dda4c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:11.145674 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ac427fde-d71f-4bd8-b735-bc5d1e8dda4c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:11.276118 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ac427fde-d71f-4bd8-b735-bc5d1e8dda4c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:11.283494 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ac427fde-d71f-4bd8-b735-bc5d1e8dda4c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.150484 Jan 11 15:28:11.284071 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 928/1663] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:11 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:12.300800 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-10f7b943-e71f-4b91-a9f4-4650335d3e01 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:12.301410 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-10f7b943-e71f-4b91-a9f4-4650335d3e01 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:12.307678 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-10f7b943-e71f-4b91-a9f4-4650335d3e01 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:12.308128 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-10f7b943-e71f-4b91-a9f4-4650335d3e01 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:12.308900 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-10f7b943-e71f-4b91-a9f4-4650335d3e01 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:12.309341 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-10f7b943-e71f-4b91-a9f4-4650335d3e01 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:12.434124 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-10f7b943-e71f-4b91-a9f4-4650335d3e01 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:12.441640 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-10f7b943-e71f-4b91-a9f4-4650335d3e01 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.144550 Jan 11 15:28:12.442189 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 736/1664] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:12 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:13.459075 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f43c6ae4-e20b-477b-a3ff-3321c1e83577 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:13.459658 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f43c6ae4-e20b-477b-a3ff-3321c1e83577 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:13.465885 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f43c6ae4-e20b-477b-a3ff-3321c1e83577 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:13.467215 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f43c6ae4-e20b-477b-a3ff-3321c1e83577 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:13.467639 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f43c6ae4-e20b-477b-a3ff-3321c1e83577 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:13.468078 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f43c6ae4-e20b-477b-a3ff-3321c1e83577 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:13.593344 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f43c6ae4-e20b-477b-a3ff-3321c1e83577 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:13.600538 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f43c6ae4-e20b-477b-a3ff-3321c1e83577 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.145179 Jan 11 15:28:13.601099 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 929/1665] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:13 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:14.617689 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-49c8ad7b-67de-40fe-9360-b856561ae52e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:14.618222 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-49c8ad7b-67de-40fe-9360-b856561ae52e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:14.625242 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-49c8ad7b-67de-40fe-9360-b856561ae52e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:14.625690 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-49c8ad7b-67de-40fe-9360-b856561ae52e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:14.626455 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-49c8ad7b-67de-40fe-9360-b856561ae52e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:14.626886 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-49c8ad7b-67de-40fe-9360-b856561ae52e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:15.027206 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-49c8ad7b-67de-40fe-9360-b856561ae52e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:15.036758 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-49c8ad7b-67de-40fe-9360-b856561ae52e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.422709 Jan 11 15:28:15.045329 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 737/1666] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:14 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:16.053637 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7cac3446-0182-48cf-a65d-f908472b7f2e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:16.054248 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-7cac3446-0182-48cf-a65d-f908472b7f2e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:16.061096 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7cac3446-0182-48cf-a65d-f908472b7f2e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:16.070056 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7cac3446-0182-48cf-a65d-f908472b7f2e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:16.070056 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7cac3446-0182-48cf-a65d-f908472b7f2e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:16.070056 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7cac3446-0182-48cf-a65d-f908472b7f2e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:16.188243 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-7cac3446-0182-48cf-a65d-f908472b7f2e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:16.195622 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7cac3446-0182-48cf-a65d-f908472b7f2e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.145591 Jan 11 15:28:16.196192 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 930/1667] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:16 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:17.211982 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-05b577f3-f460-47db-9708-9f646d3e349f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:17.212596 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-05b577f3-f460-47db-9708-9f646d3e349f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:17.219455 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-05b577f3-f460-47db-9708-9f646d3e349f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:17.219911 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-05b577f3-f460-47db-9708-9f646d3e349f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:17.220689 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-05b577f3-f460-47db-9708-9f646d3e349f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:17.221133 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-05b577f3-f460-47db-9708-9f646d3e349f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:17.350963 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-05b577f3-f460-47db-9708-9f646d3e349f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:17.358810 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-05b577f3-f460-47db-9708-9f646d3e349f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.150476 Jan 11 15:28:17.359384 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 738/1668] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:17 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:18.375614 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-87908b39-887f-483c-bb8a-9a3e82afd11b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:18.376236 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-87908b39-887f-483c-bb8a-9a3e82afd11b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:18.382643 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-87908b39-887f-483c-bb8a-9a3e82afd11b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:18.383409 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-87908b39-887f-483c-bb8a-9a3e82afd11b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:18.383987 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-87908b39-887f-483c-bb8a-9a3e82afd11b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:18.384464 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-87908b39-887f-483c-bb8a-9a3e82afd11b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:18.510229 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-87908b39-887f-483c-bb8a-9a3e82afd11b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:18.517701 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-87908b39-887f-483c-bb8a-9a3e82afd11b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.146468 Jan 11 15:28:18.518496 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 931/1669] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:18 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:19.534231 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c9d9359c-db36-41e2-8ec8-c417d74fe603 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:19.534840 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c9d9359c-db36-41e2-8ec8-c417d74fe603 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:19.541010 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c9d9359c-db36-41e2-8ec8-c417d74fe603 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:19.541456 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c9d9359c-db36-41e2-8ec8-c417d74fe603 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:19.542218 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c9d9359c-db36-41e2-8ec8-c417d74fe603 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:19.542650 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c9d9359c-db36-41e2-8ec8-c417d74fe603 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:19.667534 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-c9d9359c-db36-41e2-8ec8-c417d74fe603 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:19.675213 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c9d9359c-db36-41e2-8ec8-c417d74fe603 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.144692 Jan 11 15:28:19.675794 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 739/1670] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:19 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:20.692150 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c9691b99-6e5c-43d8-82c6-741781a5ba66 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:20.692761 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c9691b99-6e5c-43d8-82c6-741781a5ba66 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:20.699002 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c9691b99-6e5c-43d8-82c6-741781a5ba66 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:20.699490 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c9691b99-6e5c-43d8-82c6-741781a5ba66 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:20.700265 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c9691b99-6e5c-43d8-82c6-741781a5ba66 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:20.700781 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c9691b99-6e5c-43d8-82c6-741781a5ba66 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:20.831228 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c9691b99-6e5c-43d8-82c6-741781a5ba66 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:20.838625 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c9691b99-6e5c-43d8-82c6-741781a5ba66 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.150245 Jan 11 15:28:20.839194 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 932/1671] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:20 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:21.854656 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d5ec15df-5570-4780-ae2b-ca3edd231362 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:21.855267 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d5ec15df-5570-4780-ae2b-ca3edd231362 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:21.862215 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d5ec15df-5570-4780-ae2b-ca3edd231362 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:21.862667 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d5ec15df-5570-4780-ae2b-ca3edd231362 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:21.863477 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d5ec15df-5570-4780-ae2b-ca3edd231362 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:21.863914 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d5ec15df-5570-4780-ae2b-ca3edd231362 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:21.990422 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-d5ec15df-5570-4780-ae2b-ca3edd231362 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:21.997684 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d5ec15df-5570-4780-ae2b-ca3edd231362 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.146710 Jan 11 15:28:21.998245 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 740/1672] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:21 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:28:23.014542 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-14e15a6a-c352-4675-b174-02f6fdb650cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:23.015158 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-14e15a6a-c352-4675-b174-02f6fdb650cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:23.021142 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-14e15a6a-c352-4675-b174-02f6fdb650cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:23.021597 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-14e15a6a-c352-4675-b174-02f6fdb650cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:23.022382 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-14e15a6a-c352-4675-b174-02f6fdb650cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:23.022898 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-14e15a6a-c352-4675-b174-02f6fdb650cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:23.153379 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-14e15a6a-c352-4675-b174-02f6fdb650cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:23.161084 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-14e15a6a-c352-4675-b174-02f6fdb650cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.150375 Jan 11 15:28:23.161646 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 933/1673] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:23 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:24.178736 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-fe04df4c-3a34-438c-a85f-265b2ddf0391 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:24.180673 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-fe04df4c-3a34-438c-a85f-265b2ddf0391 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:24.189849 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fe04df4c-3a34-438c-a85f-265b2ddf0391 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:24.190296 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fe04df4c-3a34-438c-a85f-265b2ddf0391 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:24.191070 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fe04df4c-3a34-438c-a85f-265b2ddf0391 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:24.191528 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fe04df4c-3a34-438c-a85f-265b2ddf0391 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:24.333615 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-fe04df4c-3a34-438c-a85f-265b2ddf0391 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:24.341289 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-fe04df4c-3a34-438c-a85f-265b2ddf0391 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.167295 Jan 11 15:28:24.341844 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 741/1674] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:24 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:25.357750 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d5bccbed-85f0-42ce-8e23-1ce3f9338b7b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:25.358318 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d5bccbed-85f0-42ce-8e23-1ce3f9338b7b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:25.364499 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d5bccbed-85f0-42ce-8e23-1ce3f9338b7b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:25.364947 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d5bccbed-85f0-42ce-8e23-1ce3f9338b7b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:25.365713 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d5bccbed-85f0-42ce-8e23-1ce3f9338b7b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:25.366147 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d5bccbed-85f0-42ce-8e23-1ce3f9338b7b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:25.496893 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d5bccbed-85f0-42ce-8e23-1ce3f9338b7b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:25.504660 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d5bccbed-85f0-42ce-8e23-1ce3f9338b7b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.150619 Jan 11 15:28:25.505218 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 934/1675] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:25 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:26.521514 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7407a109-330f-4f2c-98eb-b2acd691141a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:26.522042 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7407a109-330f-4f2c-98eb-b2acd691141a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:26.528233 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7407a109-330f-4f2c-98eb-b2acd691141a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:26.528680 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7407a109-330f-4f2c-98eb-b2acd691141a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:26.529446 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7407a109-330f-4f2c-98eb-b2acd691141a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:26.530475 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7407a109-330f-4f2c-98eb-b2acd691141a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:26.656381 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-7407a109-330f-4f2c-98eb-b2acd691141a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:26.663802 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7407a109-330f-4f2c-98eb-b2acd691141a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.146394 Jan 11 15:28:26.664365 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 742/1676] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:26 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:27.680354 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-872a1516-86e1-4413-871e-d1241000306c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:27.680975 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-872a1516-86e1-4413-871e-d1241000306c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:27.687675 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-872a1516-86e1-4413-871e-d1241000306c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:27.688132 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-872a1516-86e1-4413-871e-d1241000306c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:27.688917 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-872a1516-86e1-4413-871e-d1241000306c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:27.689361 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-872a1516-86e1-4413-871e-d1241000306c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:27.816498 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-872a1516-86e1-4413-871e-d1241000306c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:27.823798 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-872a1516-86e1-4413-871e-d1241000306c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.147184 Jan 11 15:28:27.824367 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 935/1677] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:27 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:28.839836 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-af127195-3df2-4a02-ad3b-7bc5b0d412b6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:28.840475 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-af127195-3df2-4a02-ad3b-7bc5b0d412b6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:28.847274 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-af127195-3df2-4a02-ad3b-7bc5b0d412b6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:28.847754 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-af127195-3df2-4a02-ad3b-7bc5b0d412b6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:28.848528 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-af127195-3df2-4a02-ad3b-7bc5b0d412b6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:28.848966 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-af127195-3df2-4a02-ad3b-7bc5b0d412b6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:28.978039 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-af127195-3df2-4a02-ad3b-7bc5b0d412b6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:28.985227 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-af127195-3df2-4a02-ad3b-7bc5b0d412b6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.149065 Jan 11 15:28:28.985783 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 743/1678] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:28 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:30.001686 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-49ad9b6b-ed16-480d-9948-0ad6883c5e8f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:30.002311 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-49ad9b6b-ed16-480d-9948-0ad6883c5e8f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:30.008489 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-49ad9b6b-ed16-480d-9948-0ad6883c5e8f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:30.008939 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-49ad9b6b-ed16-480d-9948-0ad6883c5e8f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:30.009706 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-49ad9b6b-ed16-480d-9948-0ad6883c5e8f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:30.010140 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-49ad9b6b-ed16-480d-9948-0ad6883c5e8f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:30.145854 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-49ad9b6b-ed16-480d-9948-0ad6883c5e8f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:30.152999 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-49ad9b6b-ed16-480d-9948-0ad6883c5e8f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.154938 Jan 11 15:28:30.153572 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 936/1679] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:29 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:31.169219 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2f7e948c-2197-4744-b987-cba8a5433841 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:31.169820 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2f7e948c-2197-4744-b987-cba8a5433841 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:31.176944 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2f7e948c-2197-4744-b987-cba8a5433841 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:31.177387 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2f7e948c-2197-4744-b987-cba8a5433841 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:31.178152 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2f7e948c-2197-4744-b987-cba8a5433841 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:31.178737 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2f7e948c-2197-4744-b987-cba8a5433841 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:31.309879 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-2f7e948c-2197-4744-b987-cba8a5433841 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:31.318008 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2f7e948c-2197-4744-b987-cba8a5433841 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.152575 Jan 11 15:28:31.318686 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 744/1680] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:31 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:32.335069 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9186d612-3f49-456c-bb9f-381118828029 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:32.335728 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9186d612-3f49-456c-bb9f-381118828029 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:32.341980 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9186d612-3f49-456c-bb9f-381118828029 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:32.342435 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9186d612-3f49-456c-bb9f-381118828029 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:32.343216 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9186d612-3f49-456c-bb9f-381118828029 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:32.343691 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9186d612-3f49-456c-bb9f-381118828029 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:32.469043 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-9186d612-3f49-456c-bb9f-381118828029 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:32.481145 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9186d612-3f49-456c-bb9f-381118828029 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.149683 Jan 11 15:28:32.481722 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 937/1681] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:32 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:33.497854 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b7ac96ad-f5b8-4db1-90a9-34315aedd6c8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:33.498444 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b7ac96ad-f5b8-4db1-90a9-34315aedd6c8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:33.504722 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b7ac96ad-f5b8-4db1-90a9-34315aedd6c8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:33.505168 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b7ac96ad-f5b8-4db1-90a9-34315aedd6c8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:33.505934 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b7ac96ad-f5b8-4db1-90a9-34315aedd6c8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:33.506366 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b7ac96ad-f5b8-4db1-90a9-34315aedd6c8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:33.632553 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-b7ac96ad-f5b8-4db1-90a9-34315aedd6c8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:33.640321 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b7ac96ad-f5b8-4db1-90a9-34315aedd6c8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.146263 Jan 11 15:28:33.640946 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 745/1682] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:33 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:34.657040 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8cc7cfc3-8c11-4b5e-885b-07a65fe54d71 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:34.657592 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8cc7cfc3-8c11-4b5e-885b-07a65fe54d71 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:34.663868 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8cc7cfc3-8c11-4b5e-885b-07a65fe54d71 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:34.664324 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8cc7cfc3-8c11-4b5e-885b-07a65fe54d71 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:34.665104 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8cc7cfc3-8c11-4b5e-885b-07a65fe54d71 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:34.665542 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8cc7cfc3-8c11-4b5e-885b-07a65fe54d71 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:34.807014 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-8cc7cfc3-8c11-4b5e-885b-07a65fe54d71 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:34.815195 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8cc7cfc3-8c11-4b5e-885b-07a65fe54d71 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.161925 Jan 11 15:28:34.815803 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 938/1683] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:34 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:35.832111 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-549a24d4-11d0-4097-b4ff-85924b8d7203 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:35.832709 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-549a24d4-11d0-4097-b4ff-85924b8d7203 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:35.839143 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-549a24d4-11d0-4097-b4ff-85924b8d7203 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:35.839625 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-549a24d4-11d0-4097-b4ff-85924b8d7203 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:35.840429 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-549a24d4-11d0-4097-b4ff-85924b8d7203 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:35.840906 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-549a24d4-11d0-4097-b4ff-85924b8d7203 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:35.966353 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-549a24d4-11d0-4097-b4ff-85924b8d7203 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:35.973547 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-549a24d4-11d0-4097-b4ff-85924b8d7203 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.145091 Jan 11 15:28:35.974106 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 746/1684] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:35 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:28:36.989857 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f0a83ad2-9c3a-4a18-93e5-1986793cdfe0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:36.990468 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f0a83ad2-9c3a-4a18-93e5-1986793cdfe0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:36.996821 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f0a83ad2-9c3a-4a18-93e5-1986793cdfe0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:36.997273 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f0a83ad2-9c3a-4a18-93e5-1986793cdfe0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:36.998558 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f0a83ad2-9c3a-4a18-93e5-1986793cdfe0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:36.998999 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f0a83ad2-9c3a-4a18-93e5-1986793cdfe0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:37.129481 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f0a83ad2-9c3a-4a18-93e5-1986793cdfe0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:37.141323 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f0a83ad2-9c3a-4a18-93e5-1986793cdfe0 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.155012 Jan 11 15:28:37.141927 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 939/1685] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:36 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:38.158287 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c69b863f-cd11-4df7-9634-5e1561b35b55 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:38.158886 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c69b863f-cd11-4df7-9634-5e1561b35b55 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:38.165134 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c69b863f-cd11-4df7-9634-5e1561b35b55 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:38.165590 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c69b863f-cd11-4df7-9634-5e1561b35b55 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:38.166365 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c69b863f-cd11-4df7-9634-5e1561b35b55 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:38.166815 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c69b863f-cd11-4df7-9634-5e1561b35b55 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:38.293331 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-c69b863f-cd11-4df7-9634-5e1561b35b55 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:38.301457 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c69b863f-cd11-4df7-9634-5e1561b35b55 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.147351 Jan 11 15:28:38.302021 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 747/1686] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:38 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:39.318075 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-68fc7140-bf8b-4463-9b14-4d1dbfdcb367 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:39.318613 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-68fc7140-bf8b-4463-9b14-4d1dbfdcb367 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:39.324886 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-68fc7140-bf8b-4463-9b14-4d1dbfdcb367 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:39.325338 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-68fc7140-bf8b-4463-9b14-4d1dbfdcb367 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:39.326614 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-68fc7140-bf8b-4463-9b14-4d1dbfdcb367 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:39.327053 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-68fc7140-bf8b-4463-9b14-4d1dbfdcb367 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:39.459975 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-68fc7140-bf8b-4463-9b14-4d1dbfdcb367 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:39.468020 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-68fc7140-bf8b-4463-9b14-4d1dbfdcb367 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.153779 Jan 11 15:28:39.468588 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 940/1687] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:39 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:40.485199 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b9e8a8ee-14ad-4fa4-93c4-2c8ec676ba4a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:40.485812 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b9e8a8ee-14ad-4fa4-93c4-2c8ec676ba4a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:40.492115 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b9e8a8ee-14ad-4fa4-93c4-2c8ec676ba4a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:40.492569 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b9e8a8ee-14ad-4fa4-93c4-2c8ec676ba4a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:40.493347 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b9e8a8ee-14ad-4fa4-93c4-2c8ec676ba4a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:40.493786 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b9e8a8ee-14ad-4fa4-93c4-2c8ec676ba4a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:40.619976 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-b9e8a8ee-14ad-4fa4-93c4-2c8ec676ba4a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:40.627240 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b9e8a8ee-14ad-4fa4-93c4-2c8ec676ba4a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.146305 Jan 11 15:28:40.627829 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 748/1688] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:40 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:41.642872 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-273ab37c-4381-4adc-bda9-1f9bb99d561b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:41.643545 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-273ab37c-4381-4adc-bda9-1f9bb99d561b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:41.649784 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-273ab37c-4381-4adc-bda9-1f9bb99d561b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:41.650232 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-273ab37c-4381-4adc-bda9-1f9bb99d561b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:41.651006 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-273ab37c-4381-4adc-bda9-1f9bb99d561b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:41.651475 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-273ab37c-4381-4adc-bda9-1f9bb99d561b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:41.907596 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-273ab37c-4381-4adc-bda9-1f9bb99d561b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:41.914879 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-273ab37c-4381-4adc-bda9-1f9bb99d561b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.275833 Jan 11 15:28:41.915481 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 941/1689] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:41 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:42.931810 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-0fec7add-7267-4f8e-a431-fcb6330621bf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:42.932427 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-0fec7add-7267-4f8e-a431-fcb6330621bf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:42.938910 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0fec7add-7267-4f8e-a431-fcb6330621bf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:42.939381 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0fec7add-7267-4f8e-a431-fcb6330621bf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:42.940156 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0fec7add-7267-4f8e-a431-fcb6330621bf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:42.940594 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0fec7add-7267-4f8e-a431-fcb6330621bf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:43.070192 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-0fec7add-7267-4f8e-a431-fcb6330621bf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:43.078068 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-0fec7add-7267-4f8e-a431-fcb6330621bf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.149963 Jan 11 15:28:43.078631 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 749/1690] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:42 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:44.094605 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-644a5b30-e759-4b51-8d3c-f9476fb73a8f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:44.095283 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-644a5b30-e759-4b51-8d3c-f9476fb73a8f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:44.101437 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-644a5b30-e759-4b51-8d3c-f9476fb73a8f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:44.101888 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-644a5b30-e759-4b51-8d3c-f9476fb73a8f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:44.102658 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-644a5b30-e759-4b51-8d3c-f9476fb73a8f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:44.103090 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-644a5b30-e759-4b51-8d3c-f9476fb73a8f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:44.230471 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-644a5b30-e759-4b51-8d3c-f9476fb73a8f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:44.238748 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-644a5b30-e759-4b51-8d3c-f9476fb73a8f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.147735 Jan 11 15:28:44.239350 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 942/1691] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:44 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:28:45.254417 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c0bd74ac-dfba-44a9-9ff8-1741f0da4185 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:45.255027 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c0bd74ac-dfba-44a9-9ff8-1741f0da4185 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:45.261278 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c0bd74ac-dfba-44a9-9ff8-1741f0da4185 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:45.261725 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c0bd74ac-dfba-44a9-9ff8-1741f0da4185 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:45.262507 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c0bd74ac-dfba-44a9-9ff8-1741f0da4185 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:45.262946 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c0bd74ac-dfba-44a9-9ff8-1741f0da4185 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:45.392058 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-c0bd74ac-dfba-44a9-9ff8-1741f0da4185 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:45.399278 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c0bd74ac-dfba-44a9-9ff8-1741f0da4185 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.148630 Jan 11 15:28:45.399855 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 750/1692] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:45 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:46.416297 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-515b6b3d-829e-4059-82b9-32b1cd180e1e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:46.416913 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-515b6b3d-829e-4059-82b9-32b1cd180e1e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:46.423858 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-515b6b3d-829e-4059-82b9-32b1cd180e1e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:46.424314 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-515b6b3d-829e-4059-82b9-32b1cd180e1e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:46.425090 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-515b6b3d-829e-4059-82b9-32b1cd180e1e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:46.425532 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-515b6b3d-829e-4059-82b9-32b1cd180e1e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:46.550326 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-515b6b3d-829e-4059-82b9-32b1cd180e1e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:46.557608 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-515b6b3d-829e-4059-82b9-32b1cd180e1e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.144989 Jan 11 15:28:46.558171 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 943/1693] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:46 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:47.574388 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-5161aaae-7de5-4119-b8c0-2a494c60aa84 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:47.574998 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-5161aaae-7de5-4119-b8c0-2a494c60aa84 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:47.581254 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5161aaae-7de5-4119-b8c0-2a494c60aa84 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:47.581706 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5161aaae-7de5-4119-b8c0-2a494c60aa84 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:47.582478 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5161aaae-7de5-4119-b8c0-2a494c60aa84 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:47.582915 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5161aaae-7de5-4119-b8c0-2a494c60aa84 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:47.708720 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-5161aaae-7de5-4119-b8c0-2a494c60aa84 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:47.715885 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-5161aaae-7de5-4119-b8c0-2a494c60aa84 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.145152 Jan 11 15:28:47.716449 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 751/1694] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:47 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:48.732253 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-73ad2016-a054-4d59-8675-9c99ad8f8d8e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:48.733484 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-73ad2016-a054-4d59-8675-9c99ad8f8d8e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:48.739721 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-73ad2016-a054-4d59-8675-9c99ad8f8d8e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:48.740174 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-73ad2016-a054-4d59-8675-9c99ad8f8d8e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:48.740956 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-73ad2016-a054-4d59-8675-9c99ad8f8d8e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:48.741400 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-73ad2016-a054-4d59-8675-9c99ad8f8d8e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:48.870853 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-73ad2016-a054-4d59-8675-9c99ad8f8d8e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:48.878088 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-73ad2016-a054-4d59-8675-9c99ad8f8d8e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1451 microversion: 2.1 time: 0.149519 Jan 11 15:28:48.878658 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 944/1695] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:48 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:49.894406 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-5464dc52-5b3c-4adc-b8bd-4951c3d189b5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:49.895648 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-5464dc52-5b3c-4adc-b8bd-4951c3d189b5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:49.903914 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5464dc52-5b3c-4adc-b8bd-4951c3d189b5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:49.904777 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5464dc52-5b3c-4adc-b8bd-4951c3d189b5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:49.905587 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5464dc52-5b3c-4adc-b8bd-4951c3d189b5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:49.906037 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5464dc52-5b3c-4adc-b8bd-4951c3d189b5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:50.028447 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-5464dc52-5b3c-4adc-b8bd-4951c3d189b5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:50.037062 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-5464dc52-5b3c-4adc-b8bd-4951c3d189b5 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1377 microversion: 2.1 time: 0.146149 Jan 11 15:28:50.037647 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 752/1696] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:49 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1377 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:50.090091 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-ff8f5b5d-172d-4ac6-bf7c-91821a00e49d req-0394a769-f029-439d-92ae-518aca1ffabd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "347a0a52-47fa-4799-97ca-551bc356aca0", "name": "network-vif-deleted", "tag": "8250fb01-566c-404c-940f-8347fdacb6b4"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:28:50.091797 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:28:50.091797 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:28:50.099320 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-ff8f5b5d-172d-4ac6-bf7c-91821a00e49d req-0394a769-f029-439d-92ae-518aca1ffabd service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:50.099782 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-ff8f5b5d-172d-4ac6-bf7c-91821a00e49d req-0394a769-f029-439d-92ae-518aca1ffabd service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:50.127355 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-ff8f5b5d-172d-4ac6-bf7c-91821a00e49d req-0394a769-f029-439d-92ae-518aca1ffabd service nova] Creating event network-vif-deleted:8250fb01-566c-404c-940f-8347fdacb6b4 for instance 347a0a52-47fa-4799-97ca-551bc356aca0 on hv-cinder-82418 Jan 11 15:28:50.133149 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [req-ff8f5b5d-172d-4ac6-bf7c-91821a00e49d req-0394a769-f029-439d-92ae-518aca1ffabd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111472 Jan 11 15:28:50.137333 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 945/1697] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:28:51.055362 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f5152102-8633-44f1-8fa8-fcf099903b0e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:51.055984 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f5152102-8633-44f1-8fa8-fcf099903b0e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:51.062827 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f5152102-8633-44f1-8fa8-fcf099903b0e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:51.063283 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f5152102-8633-44f1-8fa8-fcf099903b0e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:51.064086 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f5152102-8633-44f1-8fa8-fcf099903b0e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:51.064525 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f5152102-8633-44f1-8fa8-fcf099903b0e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:51.122807 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-f5152102-8633-44f1-8fa8-fcf099903b0e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:51.130490 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f5152102-8633-44f1-8fa8-fcf099903b0e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.078829 Jan 11 15:28:51.131043 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 753/1698] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:51 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:52.148209 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ddce8f14-5fac-4528-ad25-36445e598e7e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:52.148908 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ddce8f14-5fac-4528-ad25-36445e598e7e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:52.155529 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ddce8f14-5fac-4528-ad25-36445e598e7e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:52.155981 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ddce8f14-5fac-4528-ad25-36445e598e7e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:52.156769 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ddce8f14-5fac-4528-ad25-36445e598e7e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:52.157208 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ddce8f14-5fac-4528-ad25-36445e598e7e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:52.214680 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ddce8f14-5fac-4528-ad25-36445e598e7e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:52.222553 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ddce8f14-5fac-4528-ad25-36445e598e7e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.078909 Jan 11 15:28:52.223119 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 946/1699] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:52 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:53.239020 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-0b6cd8ab-d0d1-4a5e-b595-9e46a8d40dfc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:53.239683 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-0b6cd8ab-d0d1-4a5e-b595-9e46a8d40dfc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:53.246161 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0b6cd8ab-d0d1-4a5e-b595-9e46a8d40dfc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:53.246612 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0b6cd8ab-d0d1-4a5e-b595-9e46a8d40dfc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:53.247429 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0b6cd8ab-d0d1-4a5e-b595-9e46a8d40dfc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:53.247875 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0b6cd8ab-d0d1-4a5e-b595-9e46a8d40dfc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:53.306890 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-0b6cd8ab-d0d1-4a5e-b595-9e46a8d40dfc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:53.314851 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-0b6cd8ab-d0d1-4a5e-b595-9e46a8d40dfc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.079609 Jan 11 15:28:53.315448 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 754/1700] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:53 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:54.425174 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-28cb60f9-c551-4e7b-97f5-ac73ea5cc961 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:54.425783 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-28cb60f9-c551-4e7b-97f5-ac73ea5cc961 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:54.431467 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-28cb60f9-c551-4e7b-97f5-ac73ea5cc961 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:54.431918 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-28cb60f9-c551-4e7b-97f5-ac73ea5cc961 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:54.432690 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-28cb60f9-c551-4e7b-97f5-ac73ea5cc961 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:54.433125 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-28cb60f9-c551-4e7b-97f5-ac73ea5cc961 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:54.490202 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-28cb60f9-c551-4e7b-97f5-ac73ea5cc961 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:54.497655 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-28cb60f9-c551-4e7b-97f5-ac73ea5cc961 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.170281 Jan 11 15:28:54.498928 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 947/1701] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:54 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:55.515447 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-09e5e6dc-a3c2-4152-bee2-9139e4923bb9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:55.516041 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-09e5e6dc-a3c2-4152-bee2-9139e4923bb9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:55.522068 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-09e5e6dc-a3c2-4152-bee2-9139e4923bb9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:55.522518 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-09e5e6dc-a3c2-4152-bee2-9139e4923bb9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:55.523341 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-09e5e6dc-a3c2-4152-bee2-9139e4923bb9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:55.523778 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-09e5e6dc-a3c2-4152-bee2-9139e4923bb9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:55.583967 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-09e5e6dc-a3c2-4152-bee2-9139e4923bb9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:55.591190 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-09e5e6dc-a3c2-4152-bee2-9139e4923bb9 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.080203 Jan 11 15:28:55.591780 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 755/1702] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:55 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:56.607055 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b4327566-f4b3-4b06-bfc2-4989b9f8714f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:56.608155 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b4327566-f4b3-4b06-bfc2-4989b9f8714f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:56.614448 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b4327566-f4b3-4b06-bfc2-4989b9f8714f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:56.614898 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b4327566-f4b3-4b06-bfc2-4989b9f8714f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:56.615714 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b4327566-f4b3-4b06-bfc2-4989b9f8714f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:56.616148 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b4327566-f4b3-4b06-bfc2-4989b9f8714f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:56.672885 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b4327566-f4b3-4b06-bfc2-4989b9f8714f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:56.680158 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b4327566-f4b3-4b06-bfc2-4989b9f8714f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.076846 Jan 11 15:28:56.680724 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 948/1703] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:56 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:57.697063 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3b552b38-178b-4712-a561-1b367105b93a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:57.697645 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3b552b38-178b-4712-a561-1b367105b93a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:57.703937 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3b552b38-178b-4712-a561-1b367105b93a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:57.704409 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3b552b38-178b-4712-a561-1b367105b93a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:57.705169 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3b552b38-178b-4712-a561-1b367105b93a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:57.705602 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3b552b38-178b-4712-a561-1b367105b93a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:57.761859 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-3b552b38-178b-4712-a561-1b367105b93a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:57.768875 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3b552b38-178b-4712-a561-1b367105b93a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.075447 Jan 11 15:28:57.769427 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 756/1704] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:57 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:58.785648 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3285a340-5c17-4e3d-bbc6-75e2baea2881 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:58.786255 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3285a340-5c17-4e3d-bbc6-75e2baea2881 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:58.792670 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3285a340-5c17-4e3d-bbc6-75e2baea2881 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:58.793118 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3285a340-5c17-4e3d-bbc6-75e2baea2881 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:58.793890 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3285a340-5c17-4e3d-bbc6-75e2baea2881 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:58.794327 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3285a340-5c17-4e3d-bbc6-75e2baea2881 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:58.850968 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3285a340-5c17-4e3d-bbc6-75e2baea2881 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:58.858098 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3285a340-5c17-4e3d-bbc6-75e2baea2881 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.076143 Jan 11 15:28:58.858653 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 949/1705] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:58 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:28:59.875081 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-041d7993-09b5-4130-b7a3-869bf13e3c7d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:28:59.875706 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-041d7993-09b5-4130-b7a3-869bf13e3c7d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:28:59.881944 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-041d7993-09b5-4130-b7a3-869bf13e3c7d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:59.882398 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-041d7993-09b5-4130-b7a3-869bf13e3c7d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:59.883174 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-041d7993-09b5-4130-b7a3-869bf13e3c7d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:28:59.883655 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-041d7993-09b5-4130-b7a3-869bf13e3c7d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:28:59.940236 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-041d7993-09b5-4130-b7a3-869bf13e3c7d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:28:59.947408 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-041d7993-09b5-4130-b7a3-869bf13e3c7d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.076577 Jan 11 15:28:59.947969 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 757/1706] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:28:59 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:00.963792 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2f8166ad-c420-467e-a99a-33848f1bb274 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:00.964397 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2f8166ad-c420-467e-a99a-33848f1bb274 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:00.971071 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2f8166ad-c420-467e-a99a-33848f1bb274 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:00.971545 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2f8166ad-c420-467e-a99a-33848f1bb274 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:00.972320 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2f8166ad-c420-467e-a99a-33848f1bb274 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:00.972861 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2f8166ad-c420-467e-a99a-33848f1bb274 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:01.029767 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-2f8166ad-c420-467e-a99a-33848f1bb274 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:01.038367 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2f8166ad-c420-467e-a99a-33848f1bb274 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.077808 Jan 11 15:29:01.038733 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 950/1707] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:00 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:02.055521 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-be5eaa5d-dbc1-4ad0-be67-1f7fad1d36bc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:02.056133 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-be5eaa5d-dbc1-4ad0-be67-1f7fad1d36bc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:02.063202 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-be5eaa5d-dbc1-4ad0-be67-1f7fad1d36bc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:02.063682 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-be5eaa5d-dbc1-4ad0-be67-1f7fad1d36bc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:02.064462 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-be5eaa5d-dbc1-4ad0-be67-1f7fad1d36bc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:02.064902 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-be5eaa5d-dbc1-4ad0-be67-1f7fad1d36bc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:02.124251 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-be5eaa5d-dbc1-4ad0-be67-1f7fad1d36bc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:02.131382 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-be5eaa5d-dbc1-4ad0-be67-1f7fad1d36bc tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.079473 Jan 11 15:29:02.131941 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 758/1708] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:02 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:03.147007 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-97225faf-ebd1-452a-99b7-dd572b4afdf3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:03.147641 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-97225faf-ebd1-452a-99b7-dd572b4afdf3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:03.153813 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-97225faf-ebd1-452a-99b7-dd572b4afdf3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:03.154263 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-97225faf-ebd1-452a-99b7-dd572b4afdf3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:03.155033 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-97225faf-ebd1-452a-99b7-dd572b4afdf3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:03.155509 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-97225faf-ebd1-452a-99b7-dd572b4afdf3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:03.212026 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-97225faf-ebd1-452a-99b7-dd572b4afdf3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:03.219184 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-97225faf-ebd1-452a-99b7-dd572b4afdf3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.075825 Jan 11 15:29:03.219778 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 951/1709] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:03 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:04.240692 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e4377ec0-b370-42ef-a968-13a6efb17d54 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:04.241297 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e4377ec0-b370-42ef-a968-13a6efb17d54 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:04.247567 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e4377ec0-b370-42ef-a968-13a6efb17d54 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:04.248016 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e4377ec0-b370-42ef-a968-13a6efb17d54 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:04.248829 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e4377ec0-b370-42ef-a968-13a6efb17d54 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:04.249260 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e4377ec0-b370-42ef-a968-13a6efb17d54 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:04.306410 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-e4377ec0-b370-42ef-a968-13a6efb17d54 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:04.314646 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e4377ec0-b370-42ef-a968-13a6efb17d54 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.076890 Jan 11 15:29:04.314646 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 759/1710] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:04 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:05.330347 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-621cd42d-19e4-48aa-96dc-06ab4e9f3d20 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:05.330917 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-621cd42d-19e4-48aa-96dc-06ab4e9f3d20 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:05.337331 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-621cd42d-19e4-48aa-96dc-06ab4e9f3d20 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:05.337778 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-621cd42d-19e4-48aa-96dc-06ab4e9f3d20 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:05.338551 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-621cd42d-19e4-48aa-96dc-06ab4e9f3d20 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:05.338988 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-621cd42d-19e4-48aa-96dc-06ab4e9f3d20 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:05.398227 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-621cd42d-19e4-48aa-96dc-06ab4e9f3d20 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:05.405921 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-621cd42d-19e4-48aa-96dc-06ab4e9f3d20 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.079372 Jan 11 15:29:05.406479 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 952/1711] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:05 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:06.422137 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b3b84ca9-460a-409a-b018-bc875926004a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:06.422747 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b3b84ca9-460a-409a-b018-bc875926004a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:06.429097 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b3b84ca9-460a-409a-b018-bc875926004a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:06.429546 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b3b84ca9-460a-409a-b018-bc875926004a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:06.430320 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b3b84ca9-460a-409a-b018-bc875926004a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:06.430759 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b3b84ca9-460a-409a-b018-bc875926004a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:06.486766 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-b3b84ca9-460a-409a-b018-bc875926004a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:06.493767 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b3b84ca9-460a-409a-b018-bc875926004a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.075790 Jan 11 15:29:06.494326 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 760/1712] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:06 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:07.510609 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-68b41ccb-dfe9-4dad-baec-27386a09049f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:07.511224 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-68b41ccb-dfe9-4dad-baec-27386a09049f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:07.518162 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-68b41ccb-dfe9-4dad-baec-27386a09049f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:07.518612 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-68b41ccb-dfe9-4dad-baec-27386a09049f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:07.519486 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-68b41ccb-dfe9-4dad-baec-27386a09049f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:07.519927 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-68b41ccb-dfe9-4dad-baec-27386a09049f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:07.575463 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-68b41ccb-dfe9-4dad-baec-27386a09049f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:07.583319 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-68b41ccb-dfe9-4dad-baec-27386a09049f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.076325 Jan 11 15:29:07.583889 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 953/1713] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:07 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:08.599638 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d529ff5a-c321-46b2-8aa0-7b1482df125e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:08.600183 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d529ff5a-c321-46b2-8aa0-7b1482df125e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:08.606344 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d529ff5a-c321-46b2-8aa0-7b1482df125e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:08.606800 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d529ff5a-c321-46b2-8aa0-7b1482df125e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:08.608118 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d529ff5a-c321-46b2-8aa0-7b1482df125e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:08.608557 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d529ff5a-c321-46b2-8aa0-7b1482df125e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:08.667843 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-d529ff5a-c321-46b2-8aa0-7b1482df125e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:08.675596 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d529ff5a-c321-46b2-8aa0-7b1482df125e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.079638 Jan 11 15:29:08.676151 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 761/1714] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:08 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:09.692336 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-796443b5-b2b9-4dc2-9b45-7405d68cb208 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:09.692940 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-796443b5-b2b9-4dc2-9b45-7405d68cb208 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:09.699177 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-796443b5-b2b9-4dc2-9b45-7405d68cb208 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:09.699649 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-796443b5-b2b9-4dc2-9b45-7405d68cb208 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:09.700419 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-796443b5-b2b9-4dc2-9b45-7405d68cb208 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:09.700855 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-796443b5-b2b9-4dc2-9b45-7405d68cb208 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:09.757070 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-796443b5-b2b9-4dc2-9b45-7405d68cb208 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:09.764945 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-796443b5-b2b9-4dc2-9b45-7405d68cb208 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.076154 Jan 11 15:29:09.765456 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 954/1715] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:09 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:10.781171 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-46bfd608-ab3c-423c-b031-2edf59d30501 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:10.781790 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-46bfd608-ab3c-423c-b031-2edf59d30501 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:10.787973 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-46bfd608-ab3c-423c-b031-2edf59d30501 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:10.788428 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-46bfd608-ab3c-423c-b031-2edf59d30501 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:10.789204 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-46bfd608-ab3c-423c-b031-2edf59d30501 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:10.789642 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-46bfd608-ab3c-423c-b031-2edf59d30501 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:10.846606 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-46bfd608-ab3c-423c-b031-2edf59d30501 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:10.853987 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-46bfd608-ab3c-423c-b031-2edf59d30501 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.076479 Jan 11 15:29:10.854547 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 762/1716] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:10 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:11.870722 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0d100d60-2203-4483-b386-b5299c556a58 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:11.871392 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0d100d60-2203-4483-b386-b5299c556a58 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:11.878177 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0d100d60-2203-4483-b386-b5299c556a58 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:11.878631 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0d100d60-2203-4483-b386-b5299c556a58 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:11.879447 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0d100d60-2203-4483-b386-b5299c556a58 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:11.879894 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0d100d60-2203-4483-b386-b5299c556a58 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:11.936779 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0d100d60-2203-4483-b386-b5299c556a58 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:11.943845 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0d100d60-2203-4483-b386-b5299c556a58 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.076791 Jan 11 15:29:11.944406 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 955/1717] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:11 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:12.960805 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-cbdf691b-ae9d-4194-9d9f-81b4f08f9786 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:12.961418 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-cbdf691b-ae9d-4194-9d9f-81b4f08f9786 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:12.968218 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cbdf691b-ae9d-4194-9d9f-81b4f08f9786 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:12.968667 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cbdf691b-ae9d-4194-9d9f-81b4f08f9786 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:12.969445 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cbdf691b-ae9d-4194-9d9f-81b4f08f9786 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:12.969887 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cbdf691b-ae9d-4194-9d9f-81b4f08f9786 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:13.026503 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-cbdf691b-ae9d-4194-9d9f-81b4f08f9786 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:13.034393 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-cbdf691b-ae9d-4194-9d9f-81b4f08f9786 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.077217 Jan 11 15:29:13.034951 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 763/1718] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:12 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:14.050888 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a435d8f4-7e94-4b4c-b30c-035f7b665cb1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:14.051466 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a435d8f4-7e94-4b4c-b30c-035f7b665cb1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:14.057673 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a435d8f4-7e94-4b4c-b30c-035f7b665cb1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:14.058122 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a435d8f4-7e94-4b4c-b30c-035f7b665cb1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:14.058897 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a435d8f4-7e94-4b4c-b30c-035f7b665cb1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:14.059363 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a435d8f4-7e94-4b4c-b30c-035f7b665cb1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:14.116363 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a435d8f4-7e94-4b4c-b30c-035f7b665cb1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:14.123564 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a435d8f4-7e94-4b4c-b30c-035f7b665cb1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.076447 Jan 11 15:29:14.124124 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 956/1719] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:14 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:15.140179 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d5cad177-72e4-4722-a87c-c5739750b912 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:15.140811 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d5cad177-72e4-4722-a87c-c5739750b912 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:15.147031 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d5cad177-72e4-4722-a87c-c5739750b912 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:15.147526 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d5cad177-72e4-4722-a87c-c5739750b912 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:15.148404 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d5cad177-72e4-4722-a87c-c5739750b912 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:15.148838 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d5cad177-72e4-4722-a87c-c5739750b912 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:15.240113 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-d5cad177-72e4-4722-a87c-c5739750b912 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:15.247354 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d5cad177-72e4-4722-a87c-c5739750b912 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.110960 Jan 11 15:29:15.248121 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 764/1720] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:15 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:16.264345 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5bfc3af0-8b88-4566-83a4-7a3ed3a14245 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:16.264960 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5bfc3af0-8b88-4566-83a4-7a3ed3a14245 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:16.271186 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5bfc3af0-8b88-4566-83a4-7a3ed3a14245 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:16.271661 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5bfc3af0-8b88-4566-83a4-7a3ed3a14245 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:16.272426 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5bfc3af0-8b88-4566-83a4-7a3ed3a14245 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:16.272862 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5bfc3af0-8b88-4566-83a4-7a3ed3a14245 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:16.330411 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-5bfc3af0-8b88-4566-83a4-7a3ed3a14245 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:16.337692 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5bfc3af0-8b88-4566-83a4-7a3ed3a14245 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.077500 Jan 11 15:29:16.338490 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 957/1721] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:16 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:17.355044 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-33f4f7be-2313-47a3-91ff-19100be82ceb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:17.355631 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-33f4f7be-2313-47a3-91ff-19100be82ceb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:17.362321 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-33f4f7be-2313-47a3-91ff-19100be82ceb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:17.362764 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-33f4f7be-2313-47a3-91ff-19100be82ceb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:17.363556 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-33f4f7be-2313-47a3-91ff-19100be82ceb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:17.363989 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-33f4f7be-2313-47a3-91ff-19100be82ceb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:17.419491 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-33f4f7be-2313-47a3-91ff-19100be82ceb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:17.427108 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-33f4f7be-2313-47a3-91ff-19100be82ceb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.075800 Jan 11 15:29:17.427691 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 765/1722] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:17 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:18.443997 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0880e624-8f63-4cdb-b778-c12a39a5404b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:18.444613 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0880e624-8f63-4cdb-b778-c12a39a5404b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:18.450891 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0880e624-8f63-4cdb-b778-c12a39a5404b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:18.451375 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0880e624-8f63-4cdb-b778-c12a39a5404b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:18.452159 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0880e624-8f63-4cdb-b778-c12a39a5404b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:18.452603 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0880e624-8f63-4cdb-b778-c12a39a5404b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:18.508777 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0880e624-8f63-4cdb-b778-c12a39a5404b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:18.515985 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0880e624-8f63-4cdb-b778-c12a39a5404b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.075689 Jan 11 15:29:18.516549 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 958/1723] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:18 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:19.532661 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-fdbf540e-3d2b-48cd-9ec1-cce9639118ae tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:19.533294 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-fdbf540e-3d2b-48cd-9ec1-cce9639118ae tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:19.540000 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fdbf540e-3d2b-48cd-9ec1-cce9639118ae tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:19.540445 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fdbf540e-3d2b-48cd-9ec1-cce9639118ae tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:19.541214 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fdbf540e-3d2b-48cd-9ec1-cce9639118ae tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:19.541650 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fdbf540e-3d2b-48cd-9ec1-cce9639118ae tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:19.598185 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-fdbf540e-3d2b-48cd-9ec1-cce9639118ae tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:19.605384 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-fdbf540e-3d2b-48cd-9ec1-cce9639118ae tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.076845 Jan 11 15:29:19.605940 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 766/1724] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:19 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:20.621663 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-43536f0a-b1b6-42d3-bcec-35cd47815bff tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:20.622658 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-43536f0a-b1b6-42d3-bcec-35cd47815bff tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:20.628749 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-43536f0a-b1b6-42d3-bcec-35cd47815bff tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:20.629206 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-43536f0a-b1b6-42d3-bcec-35cd47815bff tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:20.629993 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-43536f0a-b1b6-42d3-bcec-35cd47815bff tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:20.630435 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-43536f0a-b1b6-42d3-bcec-35cd47815bff tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:20.690503 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-43536f0a-b1b6-42d3-bcec-35cd47815bff tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:20.697800 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-43536f0a-b1b6-42d3-bcec-35cd47815bff tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.079756 Jan 11 15:29:20.698364 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 959/1725] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:20 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:21.714681 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-11b15753-5666-40c2-9386-5f378816d93e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:21.715333 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-11b15753-5666-40c2-9386-5f378816d93e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:21.722071 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-11b15753-5666-40c2-9386-5f378816d93e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:21.722525 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-11b15753-5666-40c2-9386-5f378816d93e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:21.723309 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-11b15753-5666-40c2-9386-5f378816d93e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:21.723796 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-11b15753-5666-40c2-9386-5f378816d93e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:21.782051 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-11b15753-5666-40c2-9386-5f378816d93e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:21.789518 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-11b15753-5666-40c2-9386-5f378816d93e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.078415 Jan 11 15:29:21.790071 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 767/1726] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:21 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:22.806553 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a2497e5a-0176-4dd8-b3d6-8de652dd191b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:22.807204 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a2497e5a-0176-4dd8-b3d6-8de652dd191b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:22.813791 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a2497e5a-0176-4dd8-b3d6-8de652dd191b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:22.814248 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a2497e5a-0176-4dd8-b3d6-8de652dd191b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:22.815022 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a2497e5a-0176-4dd8-b3d6-8de652dd191b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:22.815495 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a2497e5a-0176-4dd8-b3d6-8de652dd191b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:22.870821 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a2497e5a-0176-4dd8-b3d6-8de652dd191b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:22.878588 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a2497e5a-0176-4dd8-b3d6-8de652dd191b tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.075809 Jan 11 15:29:22.879147 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 960/1727] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:22 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:23.894834 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-36055ad1-297e-4e90-8a80-0049954a612f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:23.895475 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-36055ad1-297e-4e90-8a80-0049954a612f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:23.901819 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-36055ad1-297e-4e90-8a80-0049954a612f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:23.902272 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-36055ad1-297e-4e90-8a80-0049954a612f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:23.903054 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-36055ad1-297e-4e90-8a80-0049954a612f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:23.903534 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-36055ad1-297e-4e90-8a80-0049954a612f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:23.963576 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-36055ad1-297e-4e90-8a80-0049954a612f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:23.971526 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-36055ad1-297e-4e90-8a80-0049954a612f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.080297 Jan 11 15:29:23.972095 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 768/1728] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:23 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:24.988437 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0008c89e-a1dc-487c-8504-a253c4a32cba tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:24.988996 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0008c89e-a1dc-487c-8504-a253c4a32cba tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:24.995134 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0008c89e-a1dc-487c-8504-a253c4a32cba tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:24.995612 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0008c89e-a1dc-487c-8504-a253c4a32cba tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:24.996386 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0008c89e-a1dc-487c-8504-a253c4a32cba tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:24.996823 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0008c89e-a1dc-487c-8504-a253c4a32cba tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:25.053466 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0008c89e-a1dc-487c-8504-a253c4a32cba tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:25.061748 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0008c89e-a1dc-487c-8504-a253c4a32cba tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.076972 Jan 11 15:29:25.062341 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 961/1729] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:24 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:26.078334 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-704d0d59-369f-43b5-906e-747300b360cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:26.079004 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-704d0d59-369f-43b5-906e-747300b360cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:26.085188 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-704d0d59-369f-43b5-906e-747300b360cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:26.085642 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-704d0d59-369f-43b5-906e-747300b360cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:26.086420 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-704d0d59-369f-43b5-906e-747300b360cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:26.086857 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-704d0d59-369f-43b5-906e-747300b360cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:26.144423 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-704d0d59-369f-43b5-906e-747300b360cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:26.151640 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-704d0d59-369f-43b5-906e-747300b360cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.077065 Jan 11 15:29:26.152195 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 769/1730] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:26 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:27.001015 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:29:27.001602 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: Tue Jan 11 15:29:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:29:27.168332 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5d7bf571-1c10-4508-9da8-bf41dab80143 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:27.168946 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5d7bf571-1c10-4508-9da8-bf41dab80143 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:27.175202 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5d7bf571-1c10-4508-9da8-bf41dab80143 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:27.175695 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5d7bf571-1c10-4508-9da8-bf41dab80143 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:27.176475 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5d7bf571-1c10-4508-9da8-bf41dab80143 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:27.176920 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5d7bf571-1c10-4508-9da8-bf41dab80143 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:27.237387 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-5d7bf571-1c10-4508-9da8-bf41dab80143 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:27.244776 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5d7bf571-1c10-4508-9da8-bf41dab80143 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.080124 Jan 11 15:29:27.245335 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 962/1731] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:27 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:28.261676 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e5431329-9311-4b3c-8333-d251bce2a820 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:28.262323 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e5431329-9311-4b3c-8333-d251bce2a820 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:28.269198 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e5431329-9311-4b3c-8333-d251bce2a820 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:28.269652 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e5431329-9311-4b3c-8333-d251bce2a820 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:28.270430 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e5431329-9311-4b3c-8333-d251bce2a820 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:28.270876 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e5431329-9311-4b3c-8333-d251bce2a820 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:28.327954 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-e5431329-9311-4b3c-8333-d251bce2a820 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:28.335139 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e5431329-9311-4b3c-8333-d251bce2a820 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.077086 Jan 11 15:29:28.335732 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 770/1732] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:28 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:29.352352 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e5b860f9-af1e-48d3-9db7-3156b2a93547 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:29.352906 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e5b860f9-af1e-48d3-9db7-3156b2a93547 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:29.359117 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e5b860f9-af1e-48d3-9db7-3156b2a93547 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:29.359598 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e5b860f9-af1e-48d3-9db7-3156b2a93547 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:29.360381 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e5b860f9-af1e-48d3-9db7-3156b2a93547 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:29.360818 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e5b860f9-af1e-48d3-9db7-3156b2a93547 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:29.418614 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e5b860f9-af1e-48d3-9db7-3156b2a93547 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:29.426232 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e5b860f9-af1e-48d3-9db7-3156b2a93547 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.077683 Jan 11 15:29:29.426800 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 963/1733] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:29 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:30.443615 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-552f9dc2-a674-4793-8c0d-84aae792b4c1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:30.445928 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-552f9dc2-a674-4793-8c0d-84aae792b4c1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:30.454739 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-552f9dc2-a674-4793-8c0d-84aae792b4c1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:30.455199 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-552f9dc2-a674-4793-8c0d-84aae792b4c1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:30.456015 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-552f9dc2-a674-4793-8c0d-84aae792b4c1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:30.456462 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-552f9dc2-a674-4793-8c0d-84aae792b4c1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:30.513194 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-552f9dc2-a674-4793-8c0d-84aae792b4c1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:30.520425 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-552f9dc2-a674-4793-8c0d-84aae792b4c1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.080528 Jan 11 15:29:30.520980 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 771/1734] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:30 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:31.536735 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8d977b25-3aa5-48ee-80c3-8bd07ddd0057 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:31.537347 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8d977b25-3aa5-48ee-80c3-8bd07ddd0057 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:31.543613 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8d977b25-3aa5-48ee-80c3-8bd07ddd0057 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:31.544063 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8d977b25-3aa5-48ee-80c3-8bd07ddd0057 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:31.544828 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8d977b25-3aa5-48ee-80c3-8bd07ddd0057 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:31.545261 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8d977b25-3aa5-48ee-80c3-8bd07ddd0057 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:31.602214 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-8d977b25-3aa5-48ee-80c3-8bd07ddd0057 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:31.609394 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8d977b25-3aa5-48ee-80c3-8bd07ddd0057 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.076300 Jan 11 15:29:31.609951 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 964/1735] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:31 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:32.625749 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7dcb4992-ae43-4f29-a4cf-c19876111bac tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:32.626292 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7dcb4992-ae43-4f29-a4cf-c19876111bac tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:32.632630 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7dcb4992-ae43-4f29-a4cf-c19876111bac tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:32.633082 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7dcb4992-ae43-4f29-a4cf-c19876111bac tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:32.633854 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7dcb4992-ae43-4f29-a4cf-c19876111bac tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:32.634291 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7dcb4992-ae43-4f29-a4cf-c19876111bac tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:32.692601 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-7dcb4992-ae43-4f29-a4cf-c19876111bac tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:32.699659 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7dcb4992-ae43-4f29-a4cf-c19876111bac tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.077576 Jan 11 15:29:32.700860 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 772/1736] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:32 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:33.716982 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f7a3264f-8148-4bd8-ae62-5e7d88bf7fcd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:33.717575 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f7a3264f-8148-4bd8-ae62-5e7d88bf7fcd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:33.723832 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f7a3264f-8148-4bd8-ae62-5e7d88bf7fcd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:33.724276 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f7a3264f-8148-4bd8-ae62-5e7d88bf7fcd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:33.725044 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f7a3264f-8148-4bd8-ae62-5e7d88bf7fcd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:33.725477 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f7a3264f-8148-4bd8-ae62-5e7d88bf7fcd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:33.784447 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f7a3264f-8148-4bd8-ae62-5e7d88bf7fcd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:33.791533 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f7a3264f-8148-4bd8-ae62-5e7d88bf7fcd tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.078593 Jan 11 15:29:33.792090 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 965/1737] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:33 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:34.808496 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-8380183c-13f5-40d0-9ea5-271f543beb06 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:34.809650 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-8380183c-13f5-40d0-9ea5-271f543beb06 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:34.816225 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8380183c-13f5-40d0-9ea5-271f543beb06 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:34.816676 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8380183c-13f5-40d0-9ea5-271f543beb06 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:34.817445 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8380183c-13f5-40d0-9ea5-271f543beb06 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:34.817877 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8380183c-13f5-40d0-9ea5-271f543beb06 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:34.874755 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-8380183c-13f5-40d0-9ea5-271f543beb06 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:34.882075 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-8380183c-13f5-40d0-9ea5-271f543beb06 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.077584 Jan 11 15:29:34.882631 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 773/1738] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:34 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:35.898330 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f9c1b178-7969-46cf-8035-2c34aded8e90 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:35.898972 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f9c1b178-7969-46cf-8035-2c34aded8e90 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:35.905739 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f9c1b178-7969-46cf-8035-2c34aded8e90 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:35.906193 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f9c1b178-7969-46cf-8035-2c34aded8e90 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:35.906975 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f9c1b178-7969-46cf-8035-2c34aded8e90 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:35.907451 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f9c1b178-7969-46cf-8035-2c34aded8e90 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:35.963405 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f9c1b178-7969-46cf-8035-2c34aded8e90 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:35.971083 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f9c1b178-7969-46cf-8035-2c34aded8e90 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.076422 Jan 11 15:29:35.971690 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 966/1739] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:35 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:36.987948 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-dc96f068-1879-46de-91dc-96486599dd14 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:36.988529 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-dc96f068-1879-46de-91dc-96486599dd14 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:36.994740 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-dc96f068-1879-46de-91dc-96486599dd14 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:36.995188 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-dc96f068-1879-46de-91dc-96486599dd14 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:36.995982 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-dc96f068-1879-46de-91dc-96486599dd14 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:36.996413 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-dc96f068-1879-46de-91dc-96486599dd14 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:37.052226 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-dc96f068-1879-46de-91dc-96486599dd14 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:37.060185 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-dc96f068-1879-46de-91dc-96486599dd14 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.074949 Jan 11 15:29:37.060738 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 774/1740] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:36 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:38.076790 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8a870e5e-98be-4040-8cbd-00d2348f8a70 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:38.077406 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8a870e5e-98be-4040-8cbd-00d2348f8a70 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:38.083693 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8a870e5e-98be-4040-8cbd-00d2348f8a70 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:38.084147 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8a870e5e-98be-4040-8cbd-00d2348f8a70 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:38.084956 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8a870e5e-98be-4040-8cbd-00d2348f8a70 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:38.085397 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8a870e5e-98be-4040-8cbd-00d2348f8a70 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:38.141994 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-8a870e5e-98be-4040-8cbd-00d2348f8a70 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:38.149190 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8a870e5e-98be-4040-8cbd-00d2348f8a70 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.076621 Jan 11 15:29:38.149751 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 967/1741] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:38 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:39.165759 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f2233536-1c07-42b2-b0f4-0a83fa6c48ee tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:39.166363 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f2233536-1c07-42b2-b0f4-0a83fa6c48ee tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:39.172608 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f2233536-1c07-42b2-b0f4-0a83fa6c48ee tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:39.173055 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f2233536-1c07-42b2-b0f4-0a83fa6c48ee tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:39.173819 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f2233536-1c07-42b2-b0f4-0a83fa6c48ee tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:39.174252 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f2233536-1c07-42b2-b0f4-0a83fa6c48ee tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:39.230661 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-f2233536-1c07-42b2-b0f4-0a83fa6c48ee tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:39.238327 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f2233536-1c07-42b2-b0f4-0a83fa6c48ee tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.076541 Jan 11 15:29:39.238878 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 775/1742] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:39 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:40.254336 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-cdab10ec-d78d-47ff-b8d0-2ab4748cf7d6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:40.254966 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-cdab10ec-d78d-47ff-b8d0-2ab4748cf7d6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:40.261268 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cdab10ec-d78d-47ff-b8d0-2ab4748cf7d6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:40.261714 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cdab10ec-d78d-47ff-b8d0-2ab4748cf7d6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:40.262995 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cdab10ec-d78d-47ff-b8d0-2ab4748cf7d6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:40.263456 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cdab10ec-d78d-47ff-b8d0-2ab4748cf7d6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:40.322885 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-cdab10ec-d78d-47ff-b8d0-2ab4748cf7d6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:40.330735 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-cdab10ec-d78d-47ff-b8d0-2ab4748cf7d6 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.080017 Jan 11 15:29:40.334490 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 968/1743] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:40 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:41.347556 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-05affb58-1f96-4944-9dd1-b6e2a9417144 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:41.348091 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-05affb58-1f96-4944-9dd1-b6e2a9417144 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:41.354553 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-05affb58-1f96-4944-9dd1-b6e2a9417144 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:41.355007 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-05affb58-1f96-4944-9dd1-b6e2a9417144 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:41.355834 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-05affb58-1f96-4944-9dd1-b6e2a9417144 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:41.356944 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-05affb58-1f96-4944-9dd1-b6e2a9417144 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:41.412974 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-05affb58-1f96-4944-9dd1-b6e2a9417144 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:41.420816 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-05affb58-1f96-4944-9dd1-b6e2a9417144 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.077105 Jan 11 15:29:41.421382 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 776/1744] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:41 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:42.437212 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a536e772-0586-4fad-9308-dccee2b6404a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:42.438400 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a536e772-0586-4fad-9308-dccee2b6404a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:42.444711 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a536e772-0586-4fad-9308-dccee2b6404a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:42.445157 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a536e772-0586-4fad-9308-dccee2b6404a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:42.445933 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a536e772-0586-4fad-9308-dccee2b6404a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:42.446374 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a536e772-0586-4fad-9308-dccee2b6404a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:42.504426 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a536e772-0586-4fad-9308-dccee2b6404a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:42.511556 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a536e772-0586-4fad-9308-dccee2b6404a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.078231 Jan 11 15:29:42.512056 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 969/1745] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:42 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:43.527448 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-1f8ca041-7936-45ba-895e-e656c17a20b1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:43.528068 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-1f8ca041-7936-45ba-895e-e656c17a20b1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:43.534359 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1f8ca041-7936-45ba-895e-e656c17a20b1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:43.534821 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1f8ca041-7936-45ba-895e-e656c17a20b1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:43.535628 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1f8ca041-7936-45ba-895e-e656c17a20b1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:43.536074 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1f8ca041-7936-45ba-895e-e656c17a20b1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:43.592997 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-1f8ca041-7936-45ba-895e-e656c17a20b1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:43.600455 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-1f8ca041-7936-45ba-895e-e656c17a20b1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.076631 Jan 11 15:29:43.601027 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 777/1746] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:43 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:44.616999 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-222c00f2-045d-4b95-a4c7-ed0701c85527 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:44.617536 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-222c00f2-045d-4b95-a4c7-ed0701c85527 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:44.624375 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-222c00f2-045d-4b95-a4c7-ed0701c85527 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:44.624818 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-222c00f2-045d-4b95-a4c7-ed0701c85527 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:44.625592 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-222c00f2-045d-4b95-a4c7-ed0701c85527 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:44.626028 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-222c00f2-045d-4b95-a4c7-ed0701c85527 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:44.681628 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-222c00f2-045d-4b95-a4c7-ed0701c85527 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:44.689787 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-222c00f2-045d-4b95-a4c7-ed0701c85527 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.076542 Jan 11 15:29:44.690341 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 970/1747] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:44 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:45.706548 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7b8d023f-7963-4946-86b2-41eedf4274cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:45.707162 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7b8d023f-7963-4946-86b2-41eedf4274cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:45.713403 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7b8d023f-7963-4946-86b2-41eedf4274cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:45.713849 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7b8d023f-7963-4946-86b2-41eedf4274cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:45.714642 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7b8d023f-7963-4946-86b2-41eedf4274cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:45.715106 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7b8d023f-7963-4946-86b2-41eedf4274cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:45.771137 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-7b8d023f-7963-4946-86b2-41eedf4274cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:45.778504 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7b8d023f-7963-4946-86b2-41eedf4274cf tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.075495 Jan 11 15:29:45.779082 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 778/1748] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:45 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:46.795434 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-71315067-2c85-48a0-88d4-ea86a9848b67 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:46.796053 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-71315067-2c85-48a0-88d4-ea86a9848b67 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:46.802260 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-71315067-2c85-48a0-88d4-ea86a9848b67 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:46.802713 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-71315067-2c85-48a0-88d4-ea86a9848b67 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:46.803521 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-71315067-2c85-48a0-88d4-ea86a9848b67 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:46.803964 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-71315067-2c85-48a0-88d4-ea86a9848b67 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:46.863424 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-71315067-2c85-48a0-88d4-ea86a9848b67 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:46.870615 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-71315067-2c85-48a0-88d4-ea86a9848b67 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.078806 Jan 11 15:29:46.871174 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 971/1749] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:46 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:47.886053 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ef080a47-cb27-407f-8628-349d5ac1bc0a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:47.886650 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-ef080a47-cb27-407f-8628-349d5ac1bc0a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:47.893516 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ef080a47-cb27-407f-8628-349d5ac1bc0a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:47.893977 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ef080a47-cb27-407f-8628-349d5ac1bc0a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:47.894752 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ef080a47-cb27-407f-8628-349d5ac1bc0a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:47.895189 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ef080a47-cb27-407f-8628-349d5ac1bc0a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:47.951642 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-ef080a47-cb27-407f-8628-349d5ac1bc0a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:47.958741 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-ef080a47-cb27-407f-8628-349d5ac1bc0a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.076311 Jan 11 15:29:47.959314 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 779/1750] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:47 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:48.974931 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-31dceba2-93be-4c00-bab9-c5670d1eb170 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:48.975573 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-31dceba2-93be-4c00-bab9-c5670d1eb170 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:48.982461 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-31dceba2-93be-4c00-bab9-c5670d1eb170 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:48.982916 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-31dceba2-93be-4c00-bab9-c5670d1eb170 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:48.983731 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-31dceba2-93be-4c00-bab9-c5670d1eb170 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:48.984179 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-31dceba2-93be-4c00-bab9-c5670d1eb170 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:49.040616 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-31dceba2-93be-4c00-bab9-c5670d1eb170 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:49.047873 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-31dceba2-93be-4c00-bab9-c5670d1eb170 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.076640 Jan 11 15:29:49.048440 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 972/1751] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:48 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:50.064956 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-5d954cd3-5809-4b16-9ead-c776be5eed05 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:50.065564 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-5d954cd3-5809-4b16-9ead-c776be5eed05 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:50.071818 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5d954cd3-5809-4b16-9ead-c776be5eed05 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:50.072261 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5d954cd3-5809-4b16-9ead-c776be5eed05 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:50.073028 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5d954cd3-5809-4b16-9ead-c776be5eed05 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:50.073458 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5d954cd3-5809-4b16-9ead-c776be5eed05 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:50.129496 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-5d954cd3-5809-4b16-9ead-c776be5eed05 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:50.136597 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-5d954cd3-5809-4b16-9ead-c776be5eed05 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.075302 Jan 11 15:29:50.137171 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 780/1752] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:50 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:51.152665 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0299c831-463f-41e9-bff6-9ab80e734c89 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:51.153317 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0299c831-463f-41e9-bff6-9ab80e734c89 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:51.159601 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0299c831-463f-41e9-bff6-9ab80e734c89 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:51.160058 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0299c831-463f-41e9-bff6-9ab80e734c89 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:51.160845 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0299c831-463f-41e9-bff6-9ab80e734c89 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:51.161287 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0299c831-463f-41e9-bff6-9ab80e734c89 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:51.217707 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0299c831-463f-41e9-bff6-9ab80e734c89 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:51.224899 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0299c831-463f-41e9-bff6-9ab80e734c89 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.075886 Jan 11 15:29:51.225469 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 973/1753] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:51 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:52.241774 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e92faa04-5e45-4ed0-a2d9-6c84d23a6946 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:52.242317 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e92faa04-5e45-4ed0-a2d9-6c84d23a6946 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:52.248570 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e92faa04-5e45-4ed0-a2d9-6c84d23a6946 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:52.249017 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e92faa04-5e45-4ed0-a2d9-6c84d23a6946 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:52.249793 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e92faa04-5e45-4ed0-a2d9-6c84d23a6946 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:52.250230 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e92faa04-5e45-4ed0-a2d9-6c84d23a6946 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:52.307177 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-e92faa04-5e45-4ed0-a2d9-6c84d23a6946 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:52.314702 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e92faa04-5e45-4ed0-a2d9-6c84d23a6946 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.076665 Jan 11 15:29:52.315254 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 781/1754] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:52 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:53.331236 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f39ee22c-1623-4ec4-b2c3-89b74263f0fb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:53.331868 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f39ee22c-1623-4ec4-b2c3-89b74263f0fb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:53.338234 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f39ee22c-1623-4ec4-b2c3-89b74263f0fb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:53.338649 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f39ee22c-1623-4ec4-b2c3-89b74263f0fb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:53.339492 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f39ee22c-1623-4ec4-b2c3-89b74263f0fb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:53.345206 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f39ee22c-1623-4ec4-b2c3-89b74263f0fb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:53.404471 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f39ee22c-1623-4ec4-b2c3-89b74263f0fb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:53.412043 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f39ee22c-1623-4ec4-b2c3-89b74263f0fb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.084478 Jan 11 15:29:53.414919 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 974/1755] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:53 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:54.429272 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-46afdc4f-d2fb-4a3e-8cbd-13d7e9968af4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:54.429886 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-46afdc4f-d2fb-4a3e-8cbd-13d7e9968af4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:54.436145 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-46afdc4f-d2fb-4a3e-8cbd-13d7e9968af4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:54.436601 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-46afdc4f-d2fb-4a3e-8cbd-13d7e9968af4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:54.437383 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-46afdc4f-d2fb-4a3e-8cbd-13d7e9968af4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:54.437825 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-46afdc4f-d2fb-4a3e-8cbd-13d7e9968af4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:54.494217 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-46afdc4f-d2fb-4a3e-8cbd-13d7e9968af4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:54.501551 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-46afdc4f-d2fb-4a3e-8cbd-13d7e9968af4 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.075943 Jan 11 15:29:54.502114 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 782/1756] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:54 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:54.656734 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:29:54.656933 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: Tue Jan 11 15:29:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:29:55.518156 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-17eff305-c059-4f3d-a9a9-2f6ba59327bb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:55.518799 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-17eff305-c059-4f3d-a9a9-2f6ba59327bb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:55.525165 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-17eff305-c059-4f3d-a9a9-2f6ba59327bb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:55.525613 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-17eff305-c059-4f3d-a9a9-2f6ba59327bb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:55.526385 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-17eff305-c059-4f3d-a9a9-2f6ba59327bb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:55.526817 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-17eff305-c059-4f3d-a9a9-2f6ba59327bb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:55.583417 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-17eff305-c059-4f3d-a9a9-2f6ba59327bb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:55.590479 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-17eff305-c059-4f3d-a9a9-2f6ba59327bb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.075932 Jan 11 15:29:55.591050 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 975/1757] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:55 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:56.606330 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d72562a1-fb6d-49f5-ae07-71169c42f58d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:56.606915 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d72562a1-fb6d-49f5-ae07-71169c42f58d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:56.613079 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d72562a1-fb6d-49f5-ae07-71169c42f58d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:56.613533 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d72562a1-fb6d-49f5-ae07-71169c42f58d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:56.614311 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d72562a1-fb6d-49f5-ae07-71169c42f58d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:56.614755 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d72562a1-fb6d-49f5-ae07-71169c42f58d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:56.672692 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-d72562a1-fb6d-49f5-ae07-71169c42f58d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:56.679926 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d72562a1-fb6d-49f5-ae07-71169c42f58d tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.077906 Jan 11 15:29:56.680496 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 783/1758] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:56 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:57.697194 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0cca6514-9869-4889-ae89-0a724a8ca753 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:57.697836 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0cca6514-9869-4889-ae89-0a724a8ca753 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:57.704014 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0cca6514-9869-4889-ae89-0a724a8ca753 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:57.704458 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0cca6514-9869-4889-ae89-0a724a8ca753 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:57.705228 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0cca6514-9869-4889-ae89-0a724a8ca753 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:57.705658 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0cca6514-9869-4889-ae89-0a724a8ca753 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:57.762189 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0cca6514-9869-4889-ae89-0a724a8ca753 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:57.769499 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0cca6514-9869-4889-ae89-0a724a8ca753 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.075978 Jan 11 15:29:57.770071 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 976/1759] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:57 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:58.785729 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-82d67e1f-2508-4734-91fe-e4d221940756 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:58.786344 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-82d67e1f-2508-4734-91fe-e4d221940756 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:58.792783 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-82d67e1f-2508-4734-91fe-e4d221940756 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:58.793746 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-82d67e1f-2508-4734-91fe-e4d221940756 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:58.794524 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-82d67e1f-2508-4734-91fe-e4d221940756 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:58.794968 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-82d67e1f-2508-4734-91fe-e4d221940756 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:58.850409 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-82d67e1f-2508-4734-91fe-e4d221940756 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:58.857992 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-82d67e1f-2508-4734-91fe-e4d221940756 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.075994 Jan 11 15:29:58.858551 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 784/1760] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:58 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:29:59.874288 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-09ed70cd-5862-4441-a3e0-2b27f4643881 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:29:59.874904 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-09ed70cd-5862-4441-a3e0-2b27f4643881 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:29:59.881303 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-09ed70cd-5862-4441-a3e0-2b27f4643881 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:59.881754 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-09ed70cd-5862-4441-a3e0-2b27f4643881 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:59.882531 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-09ed70cd-5862-4441-a3e0-2b27f4643881 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:29:59.882972 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-09ed70cd-5862-4441-a3e0-2b27f4643881 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:29:59.942120 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-09ed70cd-5862-4441-a3e0-2b27f4643881 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:29:59.950083 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-09ed70cd-5862-4441-a3e0-2b27f4643881 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.079296 Jan 11 15:29:59.950640 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 977/1761] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:29:59 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:30:00.967065 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-1aafab71-63f8-472b-9136-5b175031e66e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:30:00.967721 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-1aafab71-63f8-472b-9136-5b175031e66e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:30:00.973987 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1aafab71-63f8-472b-9136-5b175031e66e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:00.974450 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1aafab71-63f8-472b-9136-5b175031e66e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:00.975231 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1aafab71-63f8-472b-9136-5b175031e66e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:00.975696 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1aafab71-63f8-472b-9136-5b175031e66e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:01.032452 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-1aafab71-63f8-472b-9136-5b175031e66e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:30:01.039568 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-1aafab71-63f8-472b-9136-5b175031e66e tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.076762 Jan 11 15:30:01.040129 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 785/1762] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:30:00 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:30:02.055693 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6b103476-b57e-455c-a2d8-ef2252c67add tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:30:02.056309 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6b103476-b57e-455c-a2d8-ef2252c67add tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:30:02.063428 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6b103476-b57e-455c-a2d8-ef2252c67add tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:02.063884 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6b103476-b57e-455c-a2d8-ef2252c67add tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:02.064668 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6b103476-b57e-455c-a2d8-ef2252c67add tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:02.065111 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6b103476-b57e-455c-a2d8-ef2252c67add tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:02.121865 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6b103476-b57e-455c-a2d8-ef2252c67add tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:30:02.129053 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6b103476-b57e-455c-a2d8-ef2252c67add tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.076981 Jan 11 15:30:02.129616 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 978/1763] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:30:02 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:30:03.145249 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-8c73d2a1-2bad-4561-a48f-f084f244ed30 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:30:03.145853 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-8c73d2a1-2bad-4561-a48f-f084f244ed30 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:30:03.152024 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8c73d2a1-2bad-4561-a48f-f084f244ed30 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:03.152489 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8c73d2a1-2bad-4561-a48f-f084f244ed30 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:03.153254 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8c73d2a1-2bad-4561-a48f-f084f244ed30 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:03.153685 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8c73d2a1-2bad-4561-a48f-f084f244ed30 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:03.209652 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-8c73d2a1-2bad-4561-a48f-f084f244ed30 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:30:03.216684 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-8c73d2a1-2bad-4561-a48f-f084f244ed30 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.075056 Jan 11 15:30:03.217243 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 786/1764] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:30:03 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:30:04.232865 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f98ca49b-af3e-4760-b5c3-05f5728dbc67 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:30:04.233484 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f98ca49b-af3e-4760-b5c3-05f5728dbc67 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:30:04.239829 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f98ca49b-af3e-4760-b5c3-05f5728dbc67 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:04.240275 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f98ca49b-af3e-4760-b5c3-05f5728dbc67 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:04.241061 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f98ca49b-af3e-4760-b5c3-05f5728dbc67 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:04.241501 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f98ca49b-af3e-4760-b5c3-05f5728dbc67 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:04.299698 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f98ca49b-af3e-4760-b5c3-05f5728dbc67 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:30:04.306815 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f98ca49b-af3e-4760-b5c3-05f5728dbc67 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.077592 Jan 11 15:30:04.307420 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 979/1765] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:30:04 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:30:05.324163 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ebdfd410-d9ef-4ac1-88c5-6944dab76770 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:30:05.324774 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-ebdfd410-d9ef-4ac1-88c5-6944dab76770 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:30:05.331046 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ebdfd410-d9ef-4ac1-88c5-6944dab76770 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:05.331539 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ebdfd410-d9ef-4ac1-88c5-6944dab76770 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:05.332457 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ebdfd410-d9ef-4ac1-88c5-6944dab76770 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:05.332895 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ebdfd410-d9ef-4ac1-88c5-6944dab76770 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:05.389718 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-ebdfd410-d9ef-4ac1-88c5-6944dab76770 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:30:05.396884 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-ebdfd410-d9ef-4ac1-88c5-6944dab76770 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.076527 Jan 11 15:30:05.397441 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 787/1766] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:30:05 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:30:06.413815 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e412c7e8-1593-4add-bca6-83a7956eb411 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:30:06.414420 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e412c7e8-1593-4add-bca6-83a7956eb411 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:30:06.420709 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e412c7e8-1593-4add-bca6-83a7956eb411 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:06.421155 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e412c7e8-1593-4add-bca6-83a7956eb411 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:06.421925 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e412c7e8-1593-4add-bca6-83a7956eb411 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:06.422364 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e412c7e8-1593-4add-bca6-83a7956eb411 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:06.481909 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e412c7e8-1593-4add-bca6-83a7956eb411 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:30:06.489137 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e412c7e8-1593-4add-bca6-83a7956eb411 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.079134 Jan 11 15:30:06.489702 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 980/1767] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:30:06 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:30:07.504927 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b6a35a83-d54f-41bf-8a6e-ec98c48e0d87 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:30:07.505534 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b6a35a83-d54f-41bf-8a6e-ec98c48e0d87 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:30:07.511852 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b6a35a83-d54f-41bf-8a6e-ec98c48e0d87 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:07.512311 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b6a35a83-d54f-41bf-8a6e-ec98c48e0d87 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:07.513086 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b6a35a83-d54f-41bf-8a6e-ec98c48e0d87 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:07.513527 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b6a35a83-d54f-41bf-8a6e-ec98c48e0d87 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:07.574821 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-b6a35a83-d54f-41bf-8a6e-ec98c48e0d87 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:30:07.582127 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b6a35a83-d54f-41bf-8a6e-ec98c48e0d87 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.080904 Jan 11 15:30:07.582690 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 788/1768] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:30:07 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:30:08.599096 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d6245501-b3ca-451f-b08b-76c9bf63b638 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:30:08.599677 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d6245501-b3ca-451f-b08b-76c9bf63b638 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:30:08.606387 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d6245501-b3ca-451f-b08b-76c9bf63b638 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:08.606837 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d6245501-b3ca-451f-b08b-76c9bf63b638 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:08.607786 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d6245501-b3ca-451f-b08b-76c9bf63b638 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:08.608233 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d6245501-b3ca-451f-b08b-76c9bf63b638 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:08.665376 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d6245501-b3ca-451f-b08b-76c9bf63b638 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:30:08.673110 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d6245501-b3ca-451f-b08b-76c9bf63b638 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.077934 Jan 11 15:30:08.673687 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 981/1769] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:30:08 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:30:09.689706 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e792e5bf-b854-42a6-a4ce-4754d6caa261 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:30:09.690323 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e792e5bf-b854-42a6-a4ce-4754d6caa261 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:30:09.696577 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e792e5bf-b854-42a6-a4ce-4754d6caa261 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:09.697031 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e792e5bf-b854-42a6-a4ce-4754d6caa261 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:09.697837 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e792e5bf-b854-42a6-a4ce-4754d6caa261 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:09.698276 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e792e5bf-b854-42a6-a4ce-4754d6caa261 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:09.757685 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-e792e5bf-b854-42a6-a4ce-4754d6caa261 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:30:09.764831 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e792e5bf-b854-42a6-a4ce-4754d6caa261 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.078811 Jan 11 15:30:09.765388 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 789/1770] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:30:09 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:30:10.781208 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0ce7ea32-fca0-4093-b028-d83b4789b6b8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:30:10.781785 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0ce7ea32-fca0-4093-b028-d83b4789b6b8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:30:10.788041 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0ce7ea32-fca0-4093-b028-d83b4789b6b8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:10.788490 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0ce7ea32-fca0-4093-b028-d83b4789b6b8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:10.789263 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0ce7ea32-fca0-4093-b028-d83b4789b6b8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:10.789695 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0ce7ea32-fca0-4093-b028-d83b4789b6b8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:10.847761 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0ce7ea32-fca0-4093-b028-d83b4789b6b8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:30:10.855893 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0ce7ea32-fca0-4093-b028-d83b4789b6b8 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.077816 Jan 11 15:30:10.856472 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 982/1771] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:30:10 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:30:11.872786 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f9f20b9a-1828-4186-83c2-a1f311eadf9a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:30:11.873352 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f9f20b9a-1828-4186-83c2-a1f311eadf9a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:30:11.880287 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f9f20b9a-1828-4186-83c2-a1f311eadf9a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:11.880739 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f9f20b9a-1828-4186-83c2-a1f311eadf9a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:11.881513 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f9f20b9a-1828-4186-83c2-a1f311eadf9a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:11.881953 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f9f20b9a-1828-4186-83c2-a1f311eadf9a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:11.941346 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-f9f20b9a-1828-4186-83c2-a1f311eadf9a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:30:11.948608 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f9f20b9a-1828-4186-83c2-a1f311eadf9a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.080062 Jan 11 15:30:11.949776 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 790/1772] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:30:11 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:30:12.965403 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-dd798ed1-aaec-4cf4-8b6d-ba925eb532df tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:30:12.966015 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-dd798ed1-aaec-4cf4-8b6d-ba925eb532df tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:30:12.972321 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dd798ed1-aaec-4cf4-8b6d-ba925eb532df tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:12.972779 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dd798ed1-aaec-4cf4-8b6d-ba925eb532df tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:12.973564 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dd798ed1-aaec-4cf4-8b6d-ba925eb532df tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:12.974014 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dd798ed1-aaec-4cf4-8b6d-ba925eb532df tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:13.034716 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-dd798ed1-aaec-4cf4-8b6d-ba925eb532df tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:30:13.042053 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-dd798ed1-aaec-4cf4-8b6d-ba925eb532df tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.080763 Jan 11 15:30:13.042623 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 983/1773] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:30:12 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:30:14.057716 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-69d6e324-9e37-4da1-8eea-33be8f12ad5a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:30:14.059198 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-69d6e324-9e37-4da1-8eea-33be8f12ad5a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:30:14.065404 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-69d6e324-9e37-4da1-8eea-33be8f12ad5a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:14.065856 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-69d6e324-9e37-4da1-8eea-33be8f12ad5a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:14.066631 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-69d6e324-9e37-4da1-8eea-33be8f12ad5a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:14.067071 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-69d6e324-9e37-4da1-8eea-33be8f12ad5a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:14.123115 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-69d6e324-9e37-4da1-8eea-33be8f12ad5a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:30:14.130259 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-69d6e324-9e37-4da1-8eea-33be8f12ad5a tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.076229 Jan 11 15:30:14.130812 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 791/1774] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:30:14 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:30:15.145873 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d651046d-936f-4823-bfab-3bb1de87add1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:30:15.146489 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d651046d-936f-4823-bfab-3bb1de87add1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:30:15.152849 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d651046d-936f-4823-bfab-3bb1de87add1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:15.153303 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d651046d-936f-4823-bfab-3bb1de87add1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:15.154080 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d651046d-936f-4823-bfab-3bb1de87add1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:15.154520 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d651046d-936f-4823-bfab-3bb1de87add1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:15.211630 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d651046d-936f-4823-bfab-3bb1de87add1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:30:15.220501 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d651046d-936f-4823-bfab-3bb1de87add1 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.078245 Jan 11 15:30:15.221089 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 984/1775] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:30:15 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:30:16.237546 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2366163c-15fa-4c23-8c80-4429553f5feb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:30:16.238234 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2366163c-15fa-4c23-8c80-4429553f5feb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:30:16.244542 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2366163c-15fa-4c23-8c80-4429553f5feb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:16.244993 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2366163c-15fa-4c23-8c80-4429553f5feb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:16.245766 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2366163c-15fa-4c23-8c80-4429553f5feb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:16.246201 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2366163c-15fa-4c23-8c80-4429553f5feb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:16.310648 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-2366163c-15fa-4c23-8c80-4429553f5feb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:30:16.318117 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2366163c-15fa-4c23-8c80-4429553f5feb tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.084229 Jan 11 15:30:16.318676 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 792/1776] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:30:16 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:30:17.333684 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-53ab4339-6c46-4b2d-8d39-5122e9e02eef tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:30:17.334293 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-53ab4339-6c46-4b2d-8d39-5122e9e02eef tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:30:17.341101 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-53ab4339-6c46-4b2d-8d39-5122e9e02eef tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:17.343090 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-53ab4339-6c46-4b2d-8d39-5122e9e02eef tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:17.343090 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-53ab4339-6c46-4b2d-8d39-5122e9e02eef tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:17.343090 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-53ab4339-6c46-4b2d-8d39-5122e9e02eef tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:17.398792 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-53ab4339-6c46-4b2d-8d39-5122e9e02eef tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:30:17.406509 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-53ab4339-6c46-4b2d-8d39-5122e9e02eef tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.076492 Jan 11 15:30:17.407065 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 985/1777] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:30:17 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:30:18.422861 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3c19c512-f983-4a01-97f6-5c64f2552cff tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:30:18.423500 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3c19c512-f983-4a01-97f6-5c64f2552cff tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:30:18.429736 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3c19c512-f983-4a01-97f6-5c64f2552cff tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:18.430187 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3c19c512-f983-4a01-97f6-5c64f2552cff tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:18.430961 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3c19c512-f983-4a01-97f6-5c64f2552cff tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:18.431431 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3c19c512-f983-4a01-97f6-5c64f2552cff tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:18.492963 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-3c19c512-f983-4a01-97f6-5c64f2552cff tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:30:18.500261 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3c19c512-f983-4a01-97f6-5c64f2552cff tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.081173 Jan 11 15:30:18.500825 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 793/1778] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:30:18 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:30:19.517175 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7391643b-fb18-4519-b6b1-2c5840a233de tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:30:19.517802 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-7391643b-fb18-4519-b6b1-2c5840a233de tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:30:19.524316 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7391643b-fb18-4519-b6b1-2c5840a233de tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:19.524761 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7391643b-fb18-4519-b6b1-2c5840a233de tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:19.525530 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7391643b-fb18-4519-b6b1-2c5840a233de tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:19.525967 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7391643b-fb18-4519-b6b1-2c5840a233de tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:19.582969 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-7391643b-fb18-4519-b6b1-2c5840a233de tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:30:19.590310 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7391643b-fb18-4519-b6b1-2c5840a233de tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.076757 Jan 11 15:30:19.590869 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 986/1779] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:30:19 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:30:20.607484 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-0179a179-588c-4910-996c-0e7f433add3c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:30:20.608042 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-0179a179-588c-4910-996c-0e7f433add3c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:30:20.614273 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0179a179-588c-4910-996c-0e7f433add3c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:20.614723 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0179a179-588c-4910-996c-0e7f433add3c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:20.615527 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0179a179-588c-4910-996c-0e7f433add3c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:20.615963 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0179a179-588c-4910-996c-0e7f433add3c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:20.676277 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-0179a179-588c-4910-996c-0e7f433add3c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:30:20.684594 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-0179a179-588c-4910-996c-0e7f433add3c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.080904 Jan 11 15:30:20.685158 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 794/1780] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:30:20 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:30:21.701455 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-549a2a3c-6648-41eb-bd87-b3f18f94e97c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:30:21.702072 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-549a2a3c-6648-41eb-bd87-b3f18f94e97c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:30:21.708209 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-549a2a3c-6648-41eb-bd87-b3f18f94e97c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:21.708674 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-549a2a3c-6648-41eb-bd87-b3f18f94e97c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:21.709471 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-549a2a3c-6648-41eb-bd87-b3f18f94e97c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:21.709917 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-549a2a3c-6648-41eb-bd87-b3f18f94e97c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:21.767834 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-549a2a3c-6648-41eb-bd87-b3f18f94e97c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:30:21.775222 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-549a2a3c-6648-41eb-bd87-b3f18f94e97c tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.078151 Jan 11 15:30:21.775813 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 987/1781] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:30:21 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:30:22.791581 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-69e83e0c-7ae3-46db-acf0-92abb0c0c860 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:30:22.792190 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-69e83e0c-7ae3-46db-acf0-92abb0c0c860 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:30:22.798914 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-69e83e0c-7ae3-46db-acf0-92abb0c0c860 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:22.799392 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-69e83e0c-7ae3-46db-acf0-92abb0c0c860 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:22.800161 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-69e83e0c-7ae3-46db-acf0-92abb0c0c860 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:22.800595 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-69e83e0c-7ae3-46db-acf0-92abb0c0c860 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:22.856795 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-69e83e0c-7ae3-46db-acf0-92abb0c0c860 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:30:22.863856 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-69e83e0c-7ae3-46db-acf0-92abb0c0c860 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.075907 Jan 11 15:30:22.864417 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 795/1782] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:30:22 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:30:23.880525 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d29f45ff-1274-4bf0-ae73-09ca5604a8ca tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:30:23.881163 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d29f45ff-1274-4bf0-ae73-09ca5604a8ca tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:30:23.888170 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d29f45ff-1274-4bf0-ae73-09ca5604a8ca tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:23.888629 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d29f45ff-1274-4bf0-ae73-09ca5604a8ca tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:23.889413 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d29f45ff-1274-4bf0-ae73-09ca5604a8ca tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:23.889858 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d29f45ff-1274-4bf0-ae73-09ca5604a8ca tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:23.946077 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d29f45ff-1274-4bf0-ae73-09ca5604a8ca tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:30:23.954086 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d29f45ff-1274-4bf0-ae73-09ca5604a8ca tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.077209 Jan 11 15:30:23.954659 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 988/1783] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:30:23 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:30:24.971008 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d2aec6b5-b848-4ca7-ab35-cdcbc7c9cbd2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:30:24.971587 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d2aec6b5-b848-4ca7-ab35-cdcbc7c9cbd2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:30:24.979202 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d2aec6b5-b848-4ca7-ab35-cdcbc7c9cbd2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:24.979692 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d2aec6b5-b848-4ca7-ab35-cdcbc7c9cbd2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:24.980567 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d2aec6b5-b848-4ca7-ab35-cdcbc7c9cbd2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:24.981016 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d2aec6b5-b848-4ca7-ab35-cdcbc7c9cbd2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:25.054254 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-d2aec6b5-b848-4ca7-ab35-cdcbc7c9cbd2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:30:25.062288 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d2aec6b5-b848-4ca7-ab35-cdcbc7c9cbd2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.094961 Jan 11 15:30:25.062857 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 796/1784] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:30:24 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:30:26.081305 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ee003103-bb5a-40b0-9e13-79eb4b9e164f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:30:26.081928 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ee003103-bb5a-40b0-9e13-79eb4b9e164f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:30:26.088236 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ee003103-bb5a-40b0-9e13-79eb4b9e164f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:26.088692 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ee003103-bb5a-40b0-9e13-79eb4b9e164f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:26.089478 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ee003103-bb5a-40b0-9e13-79eb4b9e164f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:26.090474 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ee003103-bb5a-40b0-9e13-79eb4b9e164f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:26.146345 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ee003103-bb5a-40b0-9e13-79eb4b9e164f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:30:26.154020 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ee003103-bb5a-40b0-9e13-79eb4b9e164f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.076402 Jan 11 15:30:26.154593 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 989/1785] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:30:26 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:30:27.169886 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f14402f9-373e-4cef-a198-558431ed4ff3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:30:27.170498 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f14402f9-373e-4cef-a198-558431ed4ff3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:30:27.176795 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f14402f9-373e-4cef-a198-558431ed4ff3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:27.177247 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f14402f9-373e-4cef-a198-558431ed4ff3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:27.178051 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f14402f9-373e-4cef-a198-558431ed4ff3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:27.178491 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f14402f9-373e-4cef-a198-558431ed4ff3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:27.235582 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-f14402f9-373e-4cef-a198-558431ed4ff3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:30:27.243007 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f14402f9-373e-4cef-a198-558431ed4ff3 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.077461 Jan 11 15:30:27.243608 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 797/1786] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:30:27 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:30:28.258639 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-83f64b82-1546-4174-b794-6b76abc58896 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:30:28.259248 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-83f64b82-1546-4174-b794-6b76abc58896 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:30:28.265985 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-83f64b82-1546-4174-b794-6b76abc58896 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:28.266431 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-83f64b82-1546-4174-b794-6b76abc58896 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:28.267202 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-83f64b82-1546-4174-b794-6b76abc58896 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:28.267660 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-83f64b82-1546-4174-b794-6b76abc58896 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:28.326239 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-83f64b82-1546-4174-b794-6b76abc58896 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:30:28.333472 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-83f64b82-1546-4174-b794-6b76abc58896 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.078486 Jan 11 15:30:28.334037 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 990/1787] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:30:28 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:30:29.349946 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7bdf3407-d08b-4fc7-b7e0-90a1fc78fe9f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:30:29.350561 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7bdf3407-d08b-4fc7-b7e0-90a1fc78fe9f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:30:29.357763 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7bdf3407-d08b-4fc7-b7e0-90a1fc78fe9f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:29.357763 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7bdf3407-d08b-4fc7-b7e0-90a1fc78fe9f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:29.358152 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7bdf3407-d08b-4fc7-b7e0-90a1fc78fe9f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:29.358591 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7bdf3407-d08b-4fc7-b7e0-90a1fc78fe9f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:29.415714 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-7bdf3407-d08b-4fc7-b7e0-90a1fc78fe9f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:30:29.423420 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7bdf3407-d08b-4fc7-b7e0-90a1fc78fe9f tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.077163 Jan 11 15:30:29.423986 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 798/1788] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:30:29 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:30:30.443664 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8a070a2b-923e-4ef6-afd3-33db595269b2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:30:30.443664 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8a070a2b-923e-4ef6-afd3-33db595269b2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] [instance: 347a0a52-47fa-4799-97ca-551bc356aca0] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:30:30.446468 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8a070a2b-923e-4ef6-afd3-33db595269b2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:30.446914 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8a070a2b-923e-4ef6-afd3-33db595269b2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:30.447717 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8a070a2b-923e-4ef6-afd3-33db595269b2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:30.448152 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8a070a2b-923e-4ef6-afd3-33db595269b2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:30.504495 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-8a070a2b-923e-4ef6-afd3-33db595269b2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7306e551d8234142977681a0d803a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650f188bc41c4e3287333c86a814f108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:30:30.511730 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8a070a2b-923e-4ef6-afd3-33db595269b2 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0" status: 200 len: 1214 microversion: 2.1 time: 0.075655 Jan 11 15:30:30.512244 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 991/1789] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:30:30 2022] GET /compute/v2.1/servers/347a0a52-47fa-4799-97ca-551bc356aca0 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:30:30.738178 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-48339a83-3413-4ab8-9b3e-60ee2ea56162 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] Calling method '.version_select at 0x7f16ba9c9c10>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:30:30.860320 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-48339a83-3413-4ab8-9b3e-60ee2ea56162 tempest-TestShelveInstance-2000393451 tempest-TestShelveInstance-2000393451-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1509984335" status: 202 len: 0 microversion: 2.1 time: 0.125754 Jan 11 15:30:30.860902 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 799/1790] 10.222.0.52 () {58 vars in 1253 bytes} [Tue Jan 11 15:30:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1509984335 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:30:50.574433 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-235cd097-3f7f-4867-9476-3891122c0cc5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:30:50.575044 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-235cd097-3f7f-4867-9476-3891122c0cc5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:30:50.581410 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-235cd097-3f7f-4867-9476-3891122c0cc5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:50.581861 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-235cd097-3f7f-4867-9476-3891122c0cc5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:50.582647 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-235cd097-3f7f-4867-9476-3891122c0cc5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:50.583093 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-235cd097-3f7f-4867-9476-3891122c0cc5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:50.596604 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.wsgi [None req-235cd097-3f7f-4867-9476-3891122c0cc5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] HTTP exception thrown: Instance bdd2d856-37d5-436b-b0c4-9874da364cda could not be found. Jan 11 15:30:50.597326 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-235cd097-3f7f-4867-9476-3891122c0cc5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Returning 404 to user: Instance bdd2d856-37d5-436b-b0c4-9874da364cda could not be found. {{(pid=116902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:30:50.598168 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-235cd097-3f7f-4867-9476-3891122c0cc5 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda" status: 404 len: 111 microversion: 2.20 time: 0.027355 Jan 11 15:30:50.599000 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 992/1791] 10.222.0.52 () {60 vars in 1279 bytes} [Tue Jan 11 15:30:50 2022] DELETE /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 11 15:30:50.607367 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a61155fb-3af8-4216-8484-4e3dd6046c51 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:30:50.608635 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a61155fb-3af8-4216-8484-4e3dd6046c51 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] [instance: bdd2d856-37d5-436b-b0c4-9874da364cda] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:30:50.609097 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-5750ba21-f95a-446a-96f7-42d07bd3efbb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:30:50.609596 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-5750ba21-f95a-446a-96f7-42d07bd3efbb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:30:50.614606 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a61155fb-3af8-4216-8484-4e3dd6046c51 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:50.615064 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a61155fb-3af8-4216-8484-4e3dd6046c51 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:50.615917 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a61155fb-3af8-4216-8484-4e3dd6046c51 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:50.616354 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a61155fb-3af8-4216-8484-4e3dd6046c51 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:50.617976 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5750ba21-f95a-446a-96f7-42d07bd3efbb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:50.618593 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5750ba21-f95a-446a-96f7-42d07bd3efbb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:50.619606 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5750ba21-f95a-446a-96f7-42d07bd3efbb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:50.620375 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5750ba21-f95a-446a-96f7-42d07bd3efbb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:50.634482 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.wsgi [None req-a61155fb-3af8-4216-8484-4e3dd6046c51 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] HTTP exception thrown: Instance bdd2d856-37d5-436b-b0c4-9874da364cda could not be found. Jan 11 15:30:50.634482 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a61155fb-3af8-4216-8484-4e3dd6046c51 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] Returning 404 to user: Instance bdd2d856-37d5-436b-b0c4-9874da364cda could not be found. {{(pid=116902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:30:50.634482 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a61155fb-3af8-4216-8484-4e3dd6046c51 tempest-AttachVolumeShelveTestJSON-319817223 tempest-AttachVolumeShelveTestJSON-319817223-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda" status: 404 len: 111 microversion: 2.20 time: 0.028299 Jan 11 15:30:50.634482 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 993/1792] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jan 11 15:30:50 2022] GET /compute/v2.1/servers/bdd2d856-37d5-436b-b0c4-9874da364cda => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 11 15:30:50.636033 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.wsgi [None req-5750ba21-f95a-446a-96f7-42d07bd3efbb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] HTTP exception thrown: Instance 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 could not be found. Jan 11 15:30:50.636846 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-5750ba21-f95a-446a-96f7-42d07bd3efbb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Returning 404 to user: Instance 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 could not be found. {{(pid=116903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:30:50.637961 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-5750ba21-f95a-446a-96f7-42d07bd3efbb tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "DELETE /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 404 len: 111 microversion: 2.1 time: 0.034348 Jan 11 15:30:50.638703 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 800/1793] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jan 11 15:30:50 2022] DELETE /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 15:30:50.647876 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-bbf47596-d369-47be-8e7a-dcfced162256 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:30:50.648544 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-bbf47596-d369-47be-8e7a-dcfced162256 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] [instance: 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:30:50.654553 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bbf47596-d369-47be-8e7a-dcfced162256 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:50.654955 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bbf47596-d369-47be-8e7a-dcfced162256 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:50.655804 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bbf47596-d369-47be-8e7a-dcfced162256 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:30:50.656248 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bbf47596-d369-47be-8e7a-dcfced162256 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:30:50.670253 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.wsgi [None req-bbf47596-d369-47be-8e7a-dcfced162256 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] HTTP exception thrown: Instance 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 could not be found. Jan 11 15:30:50.671449 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-bbf47596-d369-47be-8e7a-dcfced162256 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] Returning 404 to user: Instance 556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 could not be found. {{(pid=116902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:30:50.672282 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-bbf47596-d369-47be-8e7a-dcfced162256 tempest-AttachVolumeTestJSON-1217129543 tempest-AttachVolumeTestJSON-1217129543-project] 10.222.0.52 "GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4" status: 404 len: 111 microversion: 2.1 time: 0.029575 Jan 11 15:30:50.673156 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 994/1794] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:30:50 2022] GET /compute/v2.1/servers/556650b4-5ee6-4ed5-ad51-cb3c36cca0b4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 15:30:56.719393 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-64ed757b-99dc-43de-b191-0600a63938d6 tempest-VolumesGetTestJSON-1240442925 tempest-VolumesGetTestJSON-1240442925-project] Action: 'create', calling method: .version_select at 0x7f16bea0f280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-396190462", "metadata": {"Type": "work"}}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:31:05.207586 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:31:05.208081 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: Tue Jan 11 15:31:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:31:05.309158 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:31:05.309608 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: Tue Jan 11 15:31:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes (ip 10.222.0.52) !!! Jan 11 15:31:20.577330 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:31:20.577330 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: Tue Jan 11 15:31:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:31:43.735851 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5cfa7208-09b8-4a78-8339-702c3500e153 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:31:43.736553 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5cfa7208-09b8-4a78-8339-702c3500e153 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:31:43.742430 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5cfa7208-09b8-4a78-8339-702c3500e153 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:31:43.742878 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5cfa7208-09b8-4a78-8339-702c3500e153 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:31:43.743896 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5cfa7208-09b8-4a78-8339-702c3500e153 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:31:43.744502 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5cfa7208-09b8-4a78-8339-702c3500e153 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:31:43.780725 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5cfa7208-09b8-4a78-8339-702c3500e153 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Going to try to terminate instance {{(pid=116902) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 15:31:44.112783 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5cfa7208-09b8-4a78-8339-702c3500e153 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "DELETE /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 204 len: 0 microversion: 2.1 time: 0.380930 Jan 11 15:31:44.113519 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 995/1795] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jan 11 15:31:43 2022] DELETE /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 15:31:44.122260 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e78ed15f-01de-411b-8642-e9f33546bd1c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:31:44.123055 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e78ed15f-01de-411b-8642-e9f33546bd1c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:31:44.129082 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e78ed15f-01de-411b-8642-e9f33546bd1c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:31:44.129535 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e78ed15f-01de-411b-8642-e9f33546bd1c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:31:44.130317 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e78ed15f-01de-411b-8642-e9f33546bd1c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:31:44.130760 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e78ed15f-01de-411b-8642-e9f33546bd1c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:31:44.276740 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e78ed15f-01de-411b-8642-e9f33546bd1c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:31:44.283851 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e78ed15f-01de-411b-8642-e9f33546bd1c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.165642 Jan 11 15:31:44.284525 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 996/1796] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:31:44 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:31:45.301806 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7d619cd1-e5d6-4852-b505-50a65425e148 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:31:45.303274 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-7d619cd1-e5d6-4852-b505-50a65425e148 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:31:45.310852 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7d619cd1-e5d6-4852-b505-50a65425e148 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:31:45.311324 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7d619cd1-e5d6-4852-b505-50a65425e148 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:31:45.312127 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7d619cd1-e5d6-4852-b505-50a65425e148 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:31:45.312573 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7d619cd1-e5d6-4852-b505-50a65425e148 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:31:45.443243 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-7d619cd1-e5d6-4852-b505-50a65425e148 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:31:45.451920 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7d619cd1-e5d6-4852-b505-50a65425e148 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.154007 Jan 11 15:31:45.452492 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 997/1797] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:31:45 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:31:46.469121 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-13b03953-d1db-499b-84bf-fc97ec67a99a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:31:46.469781 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-13b03953-d1db-499b-84bf-fc97ec67a99a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:31:46.475898 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-13b03953-d1db-499b-84bf-fc97ec67a99a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:31:46.476351 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-13b03953-d1db-499b-84bf-fc97ec67a99a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:31:46.477118 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-13b03953-d1db-499b-84bf-fc97ec67a99a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:31:46.477551 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-13b03953-d1db-499b-84bf-fc97ec67a99a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:31:46.607406 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-13b03953-d1db-499b-84bf-fc97ec67a99a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:31:46.613152 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-13b03953-d1db-499b-84bf-fc97ec67a99a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.148128 Jan 11 15:31:46.613714 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 998/1798] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:31:46 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:31:47.630417 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-37722f6c-d31b-4458-a428-f57cf0d15457 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:31:47.631119 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-37722f6c-d31b-4458-a428-f57cf0d15457 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:31:47.637294 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-37722f6c-d31b-4458-a428-f57cf0d15457 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:31:47.637743 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-37722f6c-d31b-4458-a428-f57cf0d15457 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:31:47.638519 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-37722f6c-d31b-4458-a428-f57cf0d15457 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:31:47.638958 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-37722f6c-d31b-4458-a428-f57cf0d15457 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:31:47.768409 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-37722f6c-d31b-4458-a428-f57cf0d15457 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:31:47.776095 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-37722f6c-d31b-4458-a428-f57cf0d15457 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.149385 Jan 11 15:31:47.776653 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 999/1799] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:31:47 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:31:48.793424 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4d6905cf-028e-4d67-aa27-611294fe8305 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:31:48.794160 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-4d6905cf-028e-4d67-aa27-611294fe8305 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:31:48.800903 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4d6905cf-028e-4d67-aa27-611294fe8305 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:31:48.801351 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4d6905cf-028e-4d67-aa27-611294fe8305 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:31:48.802124 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4d6905cf-028e-4d67-aa27-611294fe8305 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:31:48.802558 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4d6905cf-028e-4d67-aa27-611294fe8305 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:31:48.934039 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-4d6905cf-028e-4d67-aa27-611294fe8305 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:31:48.942564 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4d6905cf-028e-4d67-aa27-611294fe8305 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.152781 Jan 11 15:31:48.943120 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1000/1800] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:31:48 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:31:49.959783 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-33f3041c-1c0a-41f8-9880-73d9944bdde4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:31:49.960628 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-33f3041c-1c0a-41f8-9880-73d9944bdde4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:31:49.967143 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-33f3041c-1c0a-41f8-9880-73d9944bdde4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:31:49.967623 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-33f3041c-1c0a-41f8-9880-73d9944bdde4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:31:49.968954 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-33f3041c-1c0a-41f8-9880-73d9944bdde4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:31:49.969400 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-33f3041c-1c0a-41f8-9880-73d9944bdde4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:31:50.097588 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-33f3041c-1c0a-41f8-9880-73d9944bdde4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:31:50.105512 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-33f3041c-1c0a-41f8-9880-73d9944bdde4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.149410 Jan 11 15:31:50.106075 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1001/1801] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:31:49 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:31:51.123021 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-42fe814d-c15c-4541-928d-2b18153c0a42 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:31:51.123758 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-42fe814d-c15c-4541-928d-2b18153c0a42 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:31:51.129973 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-42fe814d-c15c-4541-928d-2b18153c0a42 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:31:51.130420 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-42fe814d-c15c-4541-928d-2b18153c0a42 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:31:51.131191 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-42fe814d-c15c-4541-928d-2b18153c0a42 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:31:51.131650 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-42fe814d-c15c-4541-928d-2b18153c0a42 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:31:51.259977 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-42fe814d-c15c-4541-928d-2b18153c0a42 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:31:51.268300 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-42fe814d-c15c-4541-928d-2b18153c0a42 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.148780 Jan 11 15:31:51.268924 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1002/1802] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:31:51 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:31:52.284897 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-abbae484-e71a-401c-b859-6ad70fe5dc68 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:31:52.285617 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-abbae484-e71a-401c-b859-6ad70fe5dc68 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:31:52.292905 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-abbae484-e71a-401c-b859-6ad70fe5dc68 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:31:52.293429 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-abbae484-e71a-401c-b859-6ad70fe5dc68 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:31:52.294240 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-abbae484-e71a-401c-b859-6ad70fe5dc68 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:31:52.294883 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-abbae484-e71a-401c-b859-6ad70fe5dc68 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:31:52.427139 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-abbae484-e71a-401c-b859-6ad70fe5dc68 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:31:52.435065 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-abbae484-e71a-401c-b859-6ad70fe5dc68 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.153817 Jan 11 15:31:52.435654 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1003/1803] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:31:52 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:31:53.452422 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3d644945-d9d4-4a5b-88d1-2d34aa5fc9d0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:31:53.453578 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3d644945-d9d4-4a5b-88d1-2d34aa5fc9d0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:31:53.459762 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3d644945-d9d4-4a5b-88d1-2d34aa5fc9d0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:31:53.460215 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3d644945-d9d4-4a5b-88d1-2d34aa5fc9d0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:31:53.460992 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3d644945-d9d4-4a5b-88d1-2d34aa5fc9d0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:31:53.461432 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3d644945-d9d4-4a5b-88d1-2d34aa5fc9d0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:31:53.586197 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3d644945-d9d4-4a5b-88d1-2d34aa5fc9d0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:31:53.594881 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3d644945-d9d4-4a5b-88d1-2d34aa5fc9d0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.146172 Jan 11 15:31:53.595484 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1004/1804] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:31:53 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:31:54.612498 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-fcc7a5dc-81e3-4c92-9bb5-7df717fd1013 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:31:54.613151 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-fcc7a5dc-81e3-4c92-9bb5-7df717fd1013 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:31:54.619429 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fcc7a5dc-81e3-4c92-9bb5-7df717fd1013 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:31:54.619884 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fcc7a5dc-81e3-4c92-9bb5-7df717fd1013 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:31:54.620673 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fcc7a5dc-81e3-4c92-9bb5-7df717fd1013 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:31:54.621112 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fcc7a5dc-81e3-4c92-9bb5-7df717fd1013 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:31:54.759116 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-fcc7a5dc-81e3-4c92-9bb5-7df717fd1013 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:31:54.767461 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-fcc7a5dc-81e3-4c92-9bb5-7df717fd1013 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.159309 Jan 11 15:31:54.768030 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1005/1805] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:31:54 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:31:55.784813 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-74933e98-f8cb-46f7-a8d6-067b8a476c90 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:31:55.785465 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-74933e98-f8cb-46f7-a8d6-067b8a476c90 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:31:55.791762 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-74933e98-f8cb-46f7-a8d6-067b8a476c90 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:31:55.792223 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-74933e98-f8cb-46f7-a8d6-067b8a476c90 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:31:55.793005 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-74933e98-f8cb-46f7-a8d6-067b8a476c90 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:31:55.793448 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-74933e98-f8cb-46f7-a8d6-067b8a476c90 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:31:55.920003 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-74933e98-f8cb-46f7-a8d6-067b8a476c90 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:31:55.928269 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-74933e98-f8cb-46f7-a8d6-067b8a476c90 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.147081 Jan 11 15:31:55.929027 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1006/1806] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:31:55 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:31:56.945297 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9943c4c1-6799-4824-8faf-4ed9ffdaea8e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:31:56.945911 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9943c4c1-6799-4824-8faf-4ed9ffdaea8e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:31:56.952054 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9943c4c1-6799-4824-8faf-4ed9ffdaea8e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:31:56.952546 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9943c4c1-6799-4824-8faf-4ed9ffdaea8e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:31:56.953328 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9943c4c1-6799-4824-8faf-4ed9ffdaea8e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:31:56.953770 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9943c4c1-6799-4824-8faf-4ed9ffdaea8e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:31:57.082393 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-9943c4c1-6799-4824-8faf-4ed9ffdaea8e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:31:57.090398 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9943c4c1-6799-4824-8faf-4ed9ffdaea8e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.148713 Jan 11 15:31:57.097210 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1007/1807] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:31:56 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:31:58.112471 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0ff0b979-10c7-4fcf-b07e-7d09b276002d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:31:58.113092 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0ff0b979-10c7-4fcf-b07e-7d09b276002d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:31:58.119443 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0ff0b979-10c7-4fcf-b07e-7d09b276002d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:31:58.119911 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0ff0b979-10c7-4fcf-b07e-7d09b276002d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:31:58.120710 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0ff0b979-10c7-4fcf-b07e-7d09b276002d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:31:58.121161 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0ff0b979-10c7-4fcf-b07e-7d09b276002d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:31:58.249070 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0ff0b979-10c7-4fcf-b07e-7d09b276002d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:31:58.259614 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0ff0b979-10c7-4fcf-b07e-7d09b276002d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.151240 Jan 11 15:31:58.260195 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1008/1808] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:31:58 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:31:59.276112 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ebd254b5-c3f3-4b21-874a-8a91ce3a238a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:31:59.276900 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ebd254b5-c3f3-4b21-874a-8a91ce3a238a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:31:59.283055 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ebd254b5-c3f3-4b21-874a-8a91ce3a238a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:31:59.283624 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ebd254b5-c3f3-4b21-874a-8a91ce3a238a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:31:59.284409 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ebd254b5-c3f3-4b21-874a-8a91ce3a238a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:31:59.284853 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ebd254b5-c3f3-4b21-874a-8a91ce3a238a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:31:59.410408 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ebd254b5-c3f3-4b21-874a-8a91ce3a238a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:31:59.418205 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ebd254b5-c3f3-4b21-874a-8a91ce3a238a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.145728 Jan 11 15:31:59.418772 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1009/1809] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:31:59 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:00.435592 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b95455a4-8f52-4ff3-87bb-f64964868f9e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:00.436286 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b95455a4-8f52-4ff3-87bb-f64964868f9e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:00.442389 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b95455a4-8f52-4ff3-87bb-f64964868f9e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:00.442834 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b95455a4-8f52-4ff3-87bb-f64964868f9e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:00.443634 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b95455a4-8f52-4ff3-87bb-f64964868f9e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:00.444068 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b95455a4-8f52-4ff3-87bb-f64964868f9e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:00.572428 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b95455a4-8f52-4ff3-87bb-f64964868f9e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:00.580019 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b95455a4-8f52-4ff3-87bb-f64964868f9e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.148044 Jan 11 15:32:00.580629 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1010/1810] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:00 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:01.597372 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a37f8ff8-aff0-4358-9cca-a44d33ac291d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:01.611693 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a37f8ff8-aff0-4358-9cca-a44d33ac291d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:01.611693 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a37f8ff8-aff0-4358-9cca-a44d33ac291d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:01.611693 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a37f8ff8-aff0-4358-9cca-a44d33ac291d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:01.611693 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a37f8ff8-aff0-4358-9cca-a44d33ac291d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:01.612133 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a37f8ff8-aff0-4358-9cca-a44d33ac291d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:01.730233 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a37f8ff8-aff0-4358-9cca-a44d33ac291d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:01.738352 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a37f8ff8-aff0-4358-9cca-a44d33ac291d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.145281 Jan 11 15:32:01.738916 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1011/1811] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:01 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:02.754659 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d66b7f30-2d46-47b7-9a7d-e8ac512f3644 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:02.755357 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d66b7f30-2d46-47b7-9a7d-e8ac512f3644 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:02.761486 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d66b7f30-2d46-47b7-9a7d-e8ac512f3644 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:02.761932 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d66b7f30-2d46-47b7-9a7d-e8ac512f3644 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:02.762700 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d66b7f30-2d46-47b7-9a7d-e8ac512f3644 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:02.763131 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d66b7f30-2d46-47b7-9a7d-e8ac512f3644 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:02.890615 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d66b7f30-2d46-47b7-9a7d-e8ac512f3644 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:02.898280 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d66b7f30-2d46-47b7-9a7d-e8ac512f3644 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.147296 Jan 11 15:32:02.898843 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1012/1812] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:02 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:03.914987 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b2b58ff6-8197-4d24-996e-5726040d9093 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:03.915730 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b2b58ff6-8197-4d24-996e-5726040d9093 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:03.921935 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b2b58ff6-8197-4d24-996e-5726040d9093 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:03.922394 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b2b58ff6-8197-4d24-996e-5726040d9093 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:03.923169 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b2b58ff6-8197-4d24-996e-5726040d9093 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:03.923646 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b2b58ff6-8197-4d24-996e-5726040d9093 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:04.049080 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b2b58ff6-8197-4d24-996e-5726040d9093 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:04.057135 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b2b58ff6-8197-4d24-996e-5726040d9093 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.145717 Jan 11 15:32:04.057720 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1013/1813] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:03 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:32:05.075193 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-49c23e92-2ccc-4ffc-bc44-f5781874911d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:05.075914 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-49c23e92-2ccc-4ffc-bc44-f5781874911d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:05.082015 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-49c23e92-2ccc-4ffc-bc44-f5781874911d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:05.082467 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-49c23e92-2ccc-4ffc-bc44-f5781874911d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:05.083277 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-49c23e92-2ccc-4ffc-bc44-f5781874911d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:05.083746 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-49c23e92-2ccc-4ffc-bc44-f5781874911d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:05.211721 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-49c23e92-2ccc-4ffc-bc44-f5781874911d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:05.219778 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-49c23e92-2ccc-4ffc-bc44-f5781874911d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.148219 Jan 11 15:32:05.220351 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1014/1814] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:05 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:06.237202 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a112a4c1-3910-423e-a5d7-625670ad9a13 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:06.237875 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a112a4c1-3910-423e-a5d7-625670ad9a13 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:06.244125 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a112a4c1-3910-423e-a5d7-625670ad9a13 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:06.244584 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a112a4c1-3910-423e-a5d7-625670ad9a13 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:06.245368 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a112a4c1-3910-423e-a5d7-625670ad9a13 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:06.245814 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a112a4c1-3910-423e-a5d7-625670ad9a13 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:06.369850 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a112a4c1-3910-423e-a5d7-625670ad9a13 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:06.378033 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a112a4c1-3910-423e-a5d7-625670ad9a13 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.144004 Jan 11 15:32:06.378599 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1015/1815] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:06 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:07.395245 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9688ec87-956d-4de7-8e9d-8c0278aea543 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:07.395892 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9688ec87-956d-4de7-8e9d-8c0278aea543 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:07.402093 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9688ec87-956d-4de7-8e9d-8c0278aea543 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:07.402485 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9688ec87-956d-4de7-8e9d-8c0278aea543 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:07.403259 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9688ec87-956d-4de7-8e9d-8c0278aea543 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:07.403719 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9688ec87-956d-4de7-8e9d-8c0278aea543 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:07.529200 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-9688ec87-956d-4de7-8e9d-8c0278aea543 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:07.536811 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9688ec87-956d-4de7-8e9d-8c0278aea543 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.145873 Jan 11 15:32:07.537376 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1016/1816] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:07 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:08.553584 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a8665d1f-0de7-4bb7-89c4-e7c623040786 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:08.554478 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a8665d1f-0de7-4bb7-89c4-e7c623040786 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:08.560549 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a8665d1f-0de7-4bb7-89c4-e7c623040786 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:08.560994 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a8665d1f-0de7-4bb7-89c4-e7c623040786 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:08.561756 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a8665d1f-0de7-4bb7-89c4-e7c623040786 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:08.562190 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a8665d1f-0de7-4bb7-89c4-e7c623040786 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:08.693392 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a8665d1f-0de7-4bb7-89c4-e7c623040786 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:08.701055 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a8665d1f-0de7-4bb7-89c4-e7c623040786 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.151174 Jan 11 15:32:08.701616 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1017/1817] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:08 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:09.717659 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1ed01541-fe03-4d02-8ea1-92cce1ec9a1e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:09.718324 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1ed01541-fe03-4d02-8ea1-92cce1ec9a1e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:09.724802 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1ed01541-fe03-4d02-8ea1-92cce1ec9a1e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:09.725258 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1ed01541-fe03-4d02-8ea1-92cce1ec9a1e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:09.726036 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1ed01541-fe03-4d02-8ea1-92cce1ec9a1e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:09.726477 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1ed01541-fe03-4d02-8ea1-92cce1ec9a1e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:09.849496 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1ed01541-fe03-4d02-8ea1-92cce1ec9a1e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:09.857073 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1ed01541-fe03-4d02-8ea1-92cce1ec9a1e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.143062 Jan 11 15:32:09.857641 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1018/1818] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:09 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:10.874480 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-930bae1d-27ba-46b3-adfc-963cff3094a2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:10.875185 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-930bae1d-27ba-46b3-adfc-963cff3094a2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:10.881837 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-930bae1d-27ba-46b3-adfc-963cff3094a2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:10.882281 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-930bae1d-27ba-46b3-adfc-963cff3094a2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:10.883049 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-930bae1d-27ba-46b3-adfc-963cff3094a2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:10.883517 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-930bae1d-27ba-46b3-adfc-963cff3094a2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:11.009361 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-930bae1d-27ba-46b3-adfc-963cff3094a2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:11.016919 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-930bae1d-27ba-46b3-adfc-963cff3094a2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.146276 Jan 11 15:32:11.017492 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1019/1819] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:10 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:12.033915 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5e7b4d1b-edf5-43ad-9200-f20ecdbe1773 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:12.034592 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5e7b4d1b-edf5-43ad-9200-f20ecdbe1773 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:12.040726 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5e7b4d1b-edf5-43ad-9200-f20ecdbe1773 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:12.041184 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5e7b4d1b-edf5-43ad-9200-f20ecdbe1773 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:12.041964 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5e7b4d1b-edf5-43ad-9200-f20ecdbe1773 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:12.042406 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5e7b4d1b-edf5-43ad-9200-f20ecdbe1773 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:12.165603 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-5e7b4d1b-edf5-43ad-9200-f20ecdbe1773 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:12.173097 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5e7b4d1b-edf5-43ad-9200-f20ecdbe1773 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.142882 Jan 11 15:32:12.173661 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1020/1820] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:12 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:13.193037 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-765d6b79-fb41-4be5-9f7a-f8ee8f2eb7d0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:13.193639 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-765d6b79-fb41-4be5-9f7a-f8ee8f2eb7d0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:13.199852 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-765d6b79-fb41-4be5-9f7a-f8ee8f2eb7d0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:13.200304 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-765d6b79-fb41-4be5-9f7a-f8ee8f2eb7d0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:13.201075 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-765d6b79-fb41-4be5-9f7a-f8ee8f2eb7d0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:13.201510 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-765d6b79-fb41-4be5-9f7a-f8ee8f2eb7d0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:13.325428 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-765d6b79-fb41-4be5-9f7a-f8ee8f2eb7d0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:13.333079 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-765d6b79-fb41-4be5-9f7a-f8ee8f2eb7d0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.143653 Jan 11 15:32:13.333661 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1021/1821] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:13 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:14.350120 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b8d5c774-0715-4f44-8bad-ef7a1a8a17ec tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:14.350727 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b8d5c774-0715-4f44-8bad-ef7a1a8a17ec tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:14.356965 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b8d5c774-0715-4f44-8bad-ef7a1a8a17ec tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:14.357412 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b8d5c774-0715-4f44-8bad-ef7a1a8a17ec tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:14.358180 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b8d5c774-0715-4f44-8bad-ef7a1a8a17ec tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:14.358611 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b8d5c774-0715-4f44-8bad-ef7a1a8a17ec tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:14.485157 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b8d5c774-0715-4f44-8bad-ef7a1a8a17ec tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:14.493466 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b8d5c774-0715-4f44-8bad-ef7a1a8a17ec tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.147348 Jan 11 15:32:14.494043 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1022/1822] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:14 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:15.510749 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a6c6ffc9-28e8-49df-aab7-a6490049a8be tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:15.511439 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a6c6ffc9-28e8-49df-aab7-a6490049a8be tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:15.517587 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a6c6ffc9-28e8-49df-aab7-a6490049a8be tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:15.518624 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a6c6ffc9-28e8-49df-aab7-a6490049a8be tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:15.519423 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a6c6ffc9-28e8-49df-aab7-a6490049a8be tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:15.519869 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a6c6ffc9-28e8-49df-aab7-a6490049a8be tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:15.645908 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a6c6ffc9-28e8-49df-aab7-a6490049a8be tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:15.653638 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a6c6ffc9-28e8-49df-aab7-a6490049a8be tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.146519 Jan 11 15:32:15.658378 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1023/1823] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:15 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:16.670469 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5752bc7f-180e-4889-8799-4c9c27fa67bf tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:16.671110 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5752bc7f-180e-4889-8799-4c9c27fa67bf tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:16.677304 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5752bc7f-180e-4889-8799-4c9c27fa67bf tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:16.677757 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5752bc7f-180e-4889-8799-4c9c27fa67bf tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:16.678794 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5752bc7f-180e-4889-8799-4c9c27fa67bf tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:16.679233 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5752bc7f-180e-4889-8799-4c9c27fa67bf tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:16.806332 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-5752bc7f-180e-4889-8799-4c9c27fa67bf tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:16.814191 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5752bc7f-180e-4889-8799-4c9c27fa67bf tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.147465 Jan 11 15:32:16.815262 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1024/1824] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:16 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:17.831312 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b5ebbd97-965e-40eb-ae9c-209d145912ee tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:17.832489 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b5ebbd97-965e-40eb-ae9c-209d145912ee tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:17.839042 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b5ebbd97-965e-40eb-ae9c-209d145912ee tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:17.839541 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b5ebbd97-965e-40eb-ae9c-209d145912ee tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:17.840331 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b5ebbd97-965e-40eb-ae9c-209d145912ee tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:17.840780 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b5ebbd97-965e-40eb-ae9c-209d145912ee tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:18.045947 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b5ebbd97-965e-40eb-ae9c-209d145912ee tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:18.053979 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b5ebbd97-965e-40eb-ae9c-209d145912ee tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.226017 Jan 11 15:32:18.054470 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1025/1825] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:17 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:19.073570 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-794c0f7e-4f5a-4ba3-bbb5-32b394473e7f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:19.074255 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-794c0f7e-4f5a-4ba3-bbb5-32b394473e7f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:19.082893 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-794c0f7e-4f5a-4ba3-bbb5-32b394473e7f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:19.083379 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-794c0f7e-4f5a-4ba3-bbb5-32b394473e7f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:19.084170 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-794c0f7e-4f5a-4ba3-bbb5-32b394473e7f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:19.084621 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-794c0f7e-4f5a-4ba3-bbb5-32b394473e7f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:19.216314 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-794c0f7e-4f5a-4ba3-bbb5-32b394473e7f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:19.224042 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-794c0f7e-4f5a-4ba3-bbb5-32b394473e7f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.156610 Jan 11 15:32:19.224610 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1026/1826] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:19 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:20.240796 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8251b784-e357-4a9c-bafb-ad72554462a1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:20.241467 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8251b784-e357-4a9c-bafb-ad72554462a1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:20.247629 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8251b784-e357-4a9c-bafb-ad72554462a1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:20.248078 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8251b784-e357-4a9c-bafb-ad72554462a1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:20.248846 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8251b784-e357-4a9c-bafb-ad72554462a1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:20.249281 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8251b784-e357-4a9c-bafb-ad72554462a1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:20.374422 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-8251b784-e357-4a9c-bafb-ad72554462a1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:20.382052 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8251b784-e357-4a9c-bafb-ad72554462a1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.144868 Jan 11 15:32:20.382634 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1027/1827] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:20 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:21.399513 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f5b275ad-d494-4749-b53f-22f690e0eb34 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:21.400155 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f5b275ad-d494-4749-b53f-22f690e0eb34 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:21.406344 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f5b275ad-d494-4749-b53f-22f690e0eb34 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:21.406838 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f5b275ad-d494-4749-b53f-22f690e0eb34 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:21.407579 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f5b275ad-d494-4749-b53f-22f690e0eb34 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:21.408013 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f5b275ad-d494-4749-b53f-22f690e0eb34 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:21.532459 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f5b275ad-d494-4749-b53f-22f690e0eb34 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:21.540179 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f5b275ad-d494-4749-b53f-22f690e0eb34 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.144291 Jan 11 15:32:21.540748 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1028/1828] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:21 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:22.557116 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c6826836-12f6-408e-954a-57fc0f35701c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:22.557805 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c6826836-12f6-408e-954a-57fc0f35701c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:22.563612 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c6826836-12f6-408e-954a-57fc0f35701c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:22.564057 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c6826836-12f6-408e-954a-57fc0f35701c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:22.564825 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c6826836-12f6-408e-954a-57fc0f35701c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:22.565264 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c6826836-12f6-408e-954a-57fc0f35701c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:22.693717 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c6826836-12f6-408e-954a-57fc0f35701c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:22.701325 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c6826836-12f6-408e-954a-57fc0f35701c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.148148 Jan 11 15:32:22.701881 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1029/1829] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:22 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:23.717709 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-bbe38fb5-4268-4b76-91c7-aa4d34fd5675 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:23.718395 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-bbe38fb5-4268-4b76-91c7-aa4d34fd5675 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:23.725153 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bbe38fb5-4268-4b76-91c7-aa4d34fd5675 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:23.725612 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bbe38fb5-4268-4b76-91c7-aa4d34fd5675 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:23.726390 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bbe38fb5-4268-4b76-91c7-aa4d34fd5675 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:23.726838 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bbe38fb5-4268-4b76-91c7-aa4d34fd5675 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:23.854571 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-bbe38fb5-4268-4b76-91c7-aa4d34fd5675 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:23.863052 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-bbe38fb5-4268-4b76-91c7-aa4d34fd5675 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.148987 Jan 11 15:32:23.863663 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1030/1830] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:23 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:24.880480 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-24e8d0eb-b0df-429d-b445-1b467045603f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:24.881116 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-24e8d0eb-b0df-429d-b445-1b467045603f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:24.887196 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-24e8d0eb-b0df-429d-b445-1b467045603f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:24.887681 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-24e8d0eb-b0df-429d-b445-1b467045603f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:24.888460 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-24e8d0eb-b0df-429d-b445-1b467045603f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:24.888902 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-24e8d0eb-b0df-429d-b445-1b467045603f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:25.016496 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-24e8d0eb-b0df-429d-b445-1b467045603f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:25.024350 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-24e8d0eb-b0df-429d-b445-1b467045603f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.148202 Jan 11 15:32:25.025058 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1031/1831] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:24 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:26.041985 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c9bc89b8-9ed9-4057-bcba-5d59fe4e3f3a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:26.042869 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c9bc89b8-9ed9-4057-bcba-5d59fe4e3f3a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:26.049193 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c9bc89b8-9ed9-4057-bcba-5d59fe4e3f3a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:26.049653 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c9bc89b8-9ed9-4057-bcba-5d59fe4e3f3a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:26.050451 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c9bc89b8-9ed9-4057-bcba-5d59fe4e3f3a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:26.050898 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c9bc89b8-9ed9-4057-bcba-5d59fe4e3f3a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:26.198732 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c9bc89b8-9ed9-4057-bcba-5d59fe4e3f3a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:26.207064 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c9bc89b8-9ed9-4057-bcba-5d59fe4e3f3a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.169089 Jan 11 15:32:26.207675 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1032/1832] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:26 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:27.224872 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a6484d2e-d6d8-4897-904b-d3759405c601 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:27.225504 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a6484d2e-d6d8-4897-904b-d3759405c601 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:27.231692 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a6484d2e-d6d8-4897-904b-d3759405c601 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:27.232135 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a6484d2e-d6d8-4897-904b-d3759405c601 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:27.232907 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a6484d2e-d6d8-4897-904b-d3759405c601 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:27.233342 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a6484d2e-d6d8-4897-904b-d3759405c601 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:27.360061 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a6484d2e-d6d8-4897-904b-d3759405c601 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:27.367868 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a6484d2e-d6d8-4897-904b-d3759405c601 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.147254 Jan 11 15:32:27.368435 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1033/1833] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:27 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:28.384980 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-42c43cb1-b6cd-47e2-b535-2eb11dd14c84 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:28.385637 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-42c43cb1-b6cd-47e2-b535-2eb11dd14c84 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:28.391890 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-42c43cb1-b6cd-47e2-b535-2eb11dd14c84 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:28.392348 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-42c43cb1-b6cd-47e2-b535-2eb11dd14c84 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:28.393181 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-42c43cb1-b6cd-47e2-b535-2eb11dd14c84 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:28.393625 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-42c43cb1-b6cd-47e2-b535-2eb11dd14c84 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:28.516801 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-42c43cb1-b6cd-47e2-b535-2eb11dd14c84 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:28.524986 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-42c43cb1-b6cd-47e2-b535-2eb11dd14c84 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.143641 Jan 11 15:32:28.525561 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1034/1834] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:28 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:29.541645 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a5111a5b-17db-490a-91ca-1652dcdff46d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:29.542256 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a5111a5b-17db-490a-91ca-1652dcdff46d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:29.548374 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a5111a5b-17db-490a-91ca-1652dcdff46d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:29.548818 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a5111a5b-17db-490a-91ca-1652dcdff46d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:29.550201 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a5111a5b-17db-490a-91ca-1652dcdff46d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:29.550634 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a5111a5b-17db-490a-91ca-1652dcdff46d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:29.679555 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a5111a5b-17db-490a-91ca-1652dcdff46d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:29.687401 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a5111a5b-17db-490a-91ca-1652dcdff46d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.149359 Jan 11 15:32:29.687972 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1035/1835] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:29 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:30.704265 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-528bc04a-e74d-4d9c-a279-eaae1c760607 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:30.704913 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-528bc04a-e74d-4d9c-a279-eaae1c760607 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:30.711728 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-528bc04a-e74d-4d9c-a279-eaae1c760607 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:30.712191 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-528bc04a-e74d-4d9c-a279-eaae1c760607 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:30.712979 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-528bc04a-e74d-4d9c-a279-eaae1c760607 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:30.713423 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-528bc04a-e74d-4d9c-a279-eaae1c760607 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:30.850330 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-528bc04a-e74d-4d9c-a279-eaae1c760607 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:30.858545 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-528bc04a-e74d-4d9c-a279-eaae1c760607 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.157954 Jan 11 15:32:30.859220 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1036/1836] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:30 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:31.875835 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f89c68a6-073b-441f-9b79-4d0f16ffc54e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:31.876521 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f89c68a6-073b-441f-9b79-4d0f16ffc54e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:31.882750 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f89c68a6-073b-441f-9b79-4d0f16ffc54e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:31.883205 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f89c68a6-073b-441f-9b79-4d0f16ffc54e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:31.884013 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f89c68a6-073b-441f-9b79-4d0f16ffc54e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:31.884458 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f89c68a6-073b-441f-9b79-4d0f16ffc54e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:32.008196 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f89c68a6-073b-441f-9b79-4d0f16ffc54e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:32.015985 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f89c68a6-073b-441f-9b79-4d0f16ffc54e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.143761 Jan 11 15:32:32.016819 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1037/1837] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:31 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:33.032879 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d2752cbb-a22a-4c63-9a8b-d6b193bfe145 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:33.033572 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d2752cbb-a22a-4c63-9a8b-d6b193bfe145 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:33.040317 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d2752cbb-a22a-4c63-9a8b-d6b193bfe145 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:33.040757 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d2752cbb-a22a-4c63-9a8b-d6b193bfe145 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:33.041524 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d2752cbb-a22a-4c63-9a8b-d6b193bfe145 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:33.041962 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d2752cbb-a22a-4c63-9a8b-d6b193bfe145 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:33.168268 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d2752cbb-a22a-4c63-9a8b-d6b193bfe145 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:33.175929 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d2752cbb-a22a-4c63-9a8b-d6b193bfe145 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.146708 Jan 11 15:32:33.176508 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1038/1838] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:33 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:34.193702 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c23274ed-e699-4608-9842-66d819781d53 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:34.194403 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c23274ed-e699-4608-9842-66d819781d53 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:34.200547 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c23274ed-e699-4608-9842-66d819781d53 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:34.200995 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c23274ed-e699-4608-9842-66d819781d53 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:34.201766 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c23274ed-e699-4608-9842-66d819781d53 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:34.202213 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c23274ed-e699-4608-9842-66d819781d53 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:34.333516 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c23274ed-e699-4608-9842-66d819781d53 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:34.341107 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c23274ed-e699-4608-9842-66d819781d53 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.151633 Jan 11 15:32:34.341675 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1039/1839] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:34 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:35.358376 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-01370c51-4ea5-47c3-9d0c-00e35e07c501 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:35.359009 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-01370c51-4ea5-47c3-9d0c-00e35e07c501 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:35.365847 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-01370c51-4ea5-47c3-9d0c-00e35e07c501 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:35.366305 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-01370c51-4ea5-47c3-9d0c-00e35e07c501 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:35.367085 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-01370c51-4ea5-47c3-9d0c-00e35e07c501 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:35.367573 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-01370c51-4ea5-47c3-9d0c-00e35e07c501 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:35.501225 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-01370c51-4ea5-47c3-9d0c-00e35e07c501 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:35.509523 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-01370c51-4ea5-47c3-9d0c-00e35e07c501 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.154900 Jan 11 15:32:35.510090 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1040/1840] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:35 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:36.525779 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-48411d13-1556-4ee9-a5c0-a6298c9c6b18 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:36.526422 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-48411d13-1556-4ee9-a5c0-a6298c9c6b18 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:36.532579 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-48411d13-1556-4ee9-a5c0-a6298c9c6b18 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:36.533165 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-48411d13-1556-4ee9-a5c0-a6298c9c6b18 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:36.533952 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-48411d13-1556-4ee9-a5c0-a6298c9c6b18 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:36.534396 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-48411d13-1556-4ee9-a5c0-a6298c9c6b18 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:36.668337 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-48411d13-1556-4ee9-a5c0-a6298c9c6b18 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:36.676257 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-48411d13-1556-4ee9-a5c0-a6298c9c6b18 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.154284 Jan 11 15:32:36.676829 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1041/1841] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:36 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:37.693029 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a8fa9ed6-6305-49e3-b36f-0bd78934a2ac tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:37.693719 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a8fa9ed6-6305-49e3-b36f-0bd78934a2ac tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:37.699825 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a8fa9ed6-6305-49e3-b36f-0bd78934a2ac tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:37.700275 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a8fa9ed6-6305-49e3-b36f-0bd78934a2ac tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:37.701080 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a8fa9ed6-6305-49e3-b36f-0bd78934a2ac tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:37.701516 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a8fa9ed6-6305-49e3-b36f-0bd78934a2ac tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:37.827375 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a8fa9ed6-6305-49e3-b36f-0bd78934a2ac tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:37.835876 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a8fa9ed6-6305-49e3-b36f-0bd78934a2ac tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.146466 Jan 11 15:32:37.839581 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1042/1842] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:37 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:38.852457 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-322cd9f1-6634-457d-ade7-79400a1afbb1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:38.853135 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-322cd9f1-6634-457d-ade7-79400a1afbb1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:38.859315 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-322cd9f1-6634-457d-ade7-79400a1afbb1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:38.859770 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-322cd9f1-6634-457d-ade7-79400a1afbb1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:38.860534 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-322cd9f1-6634-457d-ade7-79400a1afbb1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:38.860973 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-322cd9f1-6634-457d-ade7-79400a1afbb1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:39.137516 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-322cd9f1-6634-457d-ade7-79400a1afbb1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:39.145151 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-322cd9f1-6634-457d-ade7-79400a1afbb1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.296313 Jan 11 15:32:39.145706 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1043/1843] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:38 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:40.161711 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9a2c3a98-73b5-4928-84d4-d8e5b2f914de tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:40.162395 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9a2c3a98-73b5-4928-84d4-d8e5b2f914de tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:40.168564 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9a2c3a98-73b5-4928-84d4-d8e5b2f914de tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:40.169015 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9a2c3a98-73b5-4928-84d4-d8e5b2f914de tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:40.169791 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9a2c3a98-73b5-4928-84d4-d8e5b2f914de tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:40.170231 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9a2c3a98-73b5-4928-84d4-d8e5b2f914de tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:40.296273 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-9a2c3a98-73b5-4928-84d4-d8e5b2f914de tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:40.304222 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9a2c3a98-73b5-4928-84d4-d8e5b2f914de tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.146108 Jan 11 15:32:40.304773 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1044/1844] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:40 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:41.321531 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-015f2ad1-6857-4a3c-8829-3cb7a6414778 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:41.322218 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-015f2ad1-6857-4a3c-8829-3cb7a6414778 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:41.328405 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-015f2ad1-6857-4a3c-8829-3cb7a6414778 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:41.328853 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-015f2ad1-6857-4a3c-8829-3cb7a6414778 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:41.329620 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-015f2ad1-6857-4a3c-8829-3cb7a6414778 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:41.330056 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-015f2ad1-6857-4a3c-8829-3cb7a6414778 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:41.456165 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-015f2ad1-6857-4a3c-8829-3cb7a6414778 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:41.463687 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-015f2ad1-6857-4a3c-8829-3cb7a6414778 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.145746 Jan 11 15:32:41.464235 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1045/1845] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:41 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:42.480407 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-10da4d2c-4ebb-4d58-a9ec-4621bddebef0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:42.481074 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-10da4d2c-4ebb-4d58-a9ec-4621bddebef0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:42.487272 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-10da4d2c-4ebb-4d58-a9ec-4621bddebef0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:42.487823 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-10da4d2c-4ebb-4d58-a9ec-4621bddebef0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:42.488612 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-10da4d2c-4ebb-4d58-a9ec-4621bddebef0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:42.489059 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-10da4d2c-4ebb-4d58-a9ec-4621bddebef0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:42.613547 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-10da4d2c-4ebb-4d58-a9ec-4621bddebef0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:42.619868 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-10da4d2c-4ebb-4d58-a9ec-4621bddebef0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.143128 Jan 11 15:32:42.620425 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1046/1846] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:42 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:43.638309 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-911c37d1-5c89-4a43-b2fd-7b818a921bbb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:43.639019 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-911c37d1-5c89-4a43-b2fd-7b818a921bbb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:43.645826 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-911c37d1-5c89-4a43-b2fd-7b818a921bbb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:43.646282 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-911c37d1-5c89-4a43-b2fd-7b818a921bbb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:43.647068 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-911c37d1-5c89-4a43-b2fd-7b818a921bbb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:43.647577 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-911c37d1-5c89-4a43-b2fd-7b818a921bbb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:43.772907 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-911c37d1-5c89-4a43-b2fd-7b818a921bbb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:43.780500 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-911c37d1-5c89-4a43-b2fd-7b818a921bbb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.145839 Jan 11 15:32:43.781049 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1047/1847] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:43 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:44.797149 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-cb3666b1-2d1d-479e-af7f-50c29d0d5cb8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:44.797812 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-cb3666b1-2d1d-479e-af7f-50c29d0d5cb8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:44.804801 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cb3666b1-2d1d-479e-af7f-50c29d0d5cb8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:44.805241 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cb3666b1-2d1d-479e-af7f-50c29d0d5cb8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:44.806018 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cb3666b1-2d1d-479e-af7f-50c29d0d5cb8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:44.806453 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cb3666b1-2d1d-479e-af7f-50c29d0d5cb8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:44.931753 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-cb3666b1-2d1d-479e-af7f-50c29d0d5cb8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:44.939322 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-cb3666b1-2d1d-479e-af7f-50c29d0d5cb8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.145779 Jan 11 15:32:44.939883 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1048/1848] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:44 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:45.955962 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f05438d8-c765-45fc-b4a4-55da9f88c0c1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:45.956656 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f05438d8-c765-45fc-b4a4-55da9f88c0c1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:45.962845 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f05438d8-c765-45fc-b4a4-55da9f88c0c1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:45.963313 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f05438d8-c765-45fc-b4a4-55da9f88c0c1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:45.964092 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f05438d8-c765-45fc-b4a4-55da9f88c0c1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:45.964529 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f05438d8-c765-45fc-b4a4-55da9f88c0c1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:46.089648 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f05438d8-c765-45fc-b4a4-55da9f88c0c1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:46.097940 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f05438d8-c765-45fc-b4a4-55da9f88c0c1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.145623 Jan 11 15:32:46.098516 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1049/1849] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:45 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:47.009036 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:32:47.009738 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: Tue Jan 11 15:32:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:32:47.114923 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c8489e7b-0ed7-4dd5-8d4e-d7ab0d5fe1b9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:47.115560 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c8489e7b-0ed7-4dd5-8d4e-d7ab0d5fe1b9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:47.121881 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c8489e7b-0ed7-4dd5-8d4e-d7ab0d5fe1b9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:47.122328 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c8489e7b-0ed7-4dd5-8d4e-d7ab0d5fe1b9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:47.123098 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c8489e7b-0ed7-4dd5-8d4e-d7ab0d5fe1b9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:47.123561 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c8489e7b-0ed7-4dd5-8d4e-d7ab0d5fe1b9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:47.250341 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c8489e7b-0ed7-4dd5-8d4e-d7ab0d5fe1b9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:47.258678 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c8489e7b-0ed7-4dd5-8d4e-d7ab0d5fe1b9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.147776 Jan 11 15:32:47.259324 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1050/1850] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:47 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:48.275744 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-651547e5-36ad-4bff-9ce5-8360bc510f24 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:48.276365 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-651547e5-36ad-4bff-9ce5-8360bc510f24 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:48.282924 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-651547e5-36ad-4bff-9ce5-8360bc510f24 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:48.283419 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-651547e5-36ad-4bff-9ce5-8360bc510f24 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:48.284205 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-651547e5-36ad-4bff-9ce5-8360bc510f24 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:48.284650 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-651547e5-36ad-4bff-9ce5-8360bc510f24 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:48.411668 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-651547e5-36ad-4bff-9ce5-8360bc510f24 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:48.419261 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-651547e5-36ad-4bff-9ce5-8360bc510f24 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.147171 Jan 11 15:32:48.419880 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1051/1851] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:48 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:49.436294 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-29707fdd-f9b9-4a95-aa4c-c0f461028535 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:49.436953 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-29707fdd-f9b9-4a95-aa4c-c0f461028535 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:49.442624 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-29707fdd-f9b9-4a95-aa4c-c0f461028535 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:49.443072 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-29707fdd-f9b9-4a95-aa4c-c0f461028535 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:49.443859 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-29707fdd-f9b9-4a95-aa4c-c0f461028535 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:49.444294 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-29707fdd-f9b9-4a95-aa4c-c0f461028535 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:49.569506 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-29707fdd-f9b9-4a95-aa4c-c0f461028535 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:49.577230 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-29707fdd-f9b9-4a95-aa4c-c0f461028535 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.144734 Jan 11 15:32:49.577789 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1052/1852] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:49 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:50.594172 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9caf400b-b41f-4db9-bc0a-f8315137e375 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:50.594926 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9caf400b-b41f-4db9-bc0a-f8315137e375 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:50.600843 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9caf400b-b41f-4db9-bc0a-f8315137e375 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:50.601295 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9caf400b-b41f-4db9-bc0a-f8315137e375 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:50.602200 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9caf400b-b41f-4db9-bc0a-f8315137e375 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:50.602651 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9caf400b-b41f-4db9-bc0a-f8315137e375 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:50.737800 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-9caf400b-b41f-4db9-bc0a-f8315137e375 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:50.740274 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9caf400b-b41f-4db9-bc0a-f8315137e375 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.150213 Jan 11 15:32:50.740838 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1053/1853] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:50 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:32:51.076152 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-64ed757b-99dc-43de-b191-0600a63938d6 tempest-VolumesGetTestJSON-1240442925 tempest-VolumesGetTestJSON-1240442925-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 114.464147 Jan 11 15:32:51.076774 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 801/1854] 10.222.0.52 () {60 vars in 1155 bytes} [Tue Jan 11 15:30:56 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 114465 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 11 15:32:51.756556 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5423bf20-e6cd-4891-aba2-705c4c460d8c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:51.757170 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5423bf20-e6cd-4891-aba2-705c4c460d8c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:51.763108 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5423bf20-e6cd-4891-aba2-705c4c460d8c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:51.763601 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5423bf20-e6cd-4891-aba2-705c4c460d8c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:51.764383 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5423bf20-e6cd-4891-aba2-705c4c460d8c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:51.764825 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5423bf20-e6cd-4891-aba2-705c4c460d8c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:51.889663 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-5423bf20-e6cd-4891-aba2-705c4c460d8c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:51.897902 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5423bf20-e6cd-4891-aba2-705c4c460d8c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.145206 Jan 11 15:32:51.898460 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1054/1855] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:51 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:32:52.915444 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f1670e48-8501-4c0a-9767-e4bbbbfbf756 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:52.916056 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f1670e48-8501-4c0a-9767-e4bbbbfbf756 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:52.922888 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f1670e48-8501-4c0a-9767-e4bbbbfbf756 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:52.923357 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f1670e48-8501-4c0a-9767-e4bbbbfbf756 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:52.924130 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f1670e48-8501-4c0a-9767-e4bbbbfbf756 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:52.924565 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f1670e48-8501-4c0a-9767-e4bbbbfbf756 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:53.051029 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-f1670e48-8501-4c0a-9767-e4bbbbfbf756 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:53.059456 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f1670e48-8501-4c0a-9767-e4bbbbfbf756 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.149220 Jan 11 15:32:53.060009 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 802/1856] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:52 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:32:54.075626 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f8525326-468f-490b-83cc-edee72e3c1d2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:54.076232 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f8525326-468f-490b-83cc-edee72e3c1d2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:54.082395 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f8525326-468f-490b-83cc-edee72e3c1d2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:54.082843 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f8525326-468f-490b-83cc-edee72e3c1d2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:54.083644 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f8525326-468f-490b-83cc-edee72e3c1d2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:54.084077 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f8525326-468f-490b-83cc-edee72e3c1d2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:54.211016 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f8525326-468f-490b-83cc-edee72e3c1d2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:54.218837 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f8525326-468f-490b-83cc-edee72e3c1d2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.146778 Jan 11 15:32:54.219432 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1055/1857] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:54 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:32:55.236386 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-11718bc9-f066-4cfd-88b4-3deb8538a6f7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:55.237015 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-11718bc9-f066-4cfd-88b4-3deb8538a6f7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:55.243078 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-11718bc9-f066-4cfd-88b4-3deb8538a6f7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:55.243583 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-11718bc9-f066-4cfd-88b4-3deb8538a6f7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:55.244430 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-11718bc9-f066-4cfd-88b4-3deb8538a6f7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:55.244861 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-11718bc9-f066-4cfd-88b4-3deb8538a6f7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:55.371630 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-11718bc9-f066-4cfd-88b4-3deb8538a6f7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:55.379139 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-11718bc9-f066-4cfd-88b4-3deb8538a6f7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.146609 Jan 11 15:32:55.379732 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 803/1858] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:55 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:32:56.396709 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-fe5376d5-9e40-4577-a05e-05bb75177c68 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:56.397316 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-fe5376d5-9e40-4577-a05e-05bb75177c68 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:56.403638 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fe5376d5-9e40-4577-a05e-05bb75177c68 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:56.404094 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fe5376d5-9e40-4577-a05e-05bb75177c68 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:56.404868 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fe5376d5-9e40-4577-a05e-05bb75177c68 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:56.405311 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fe5376d5-9e40-4577-a05e-05bb75177c68 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:56.530002 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-fe5376d5-9e40-4577-a05e-05bb75177c68 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:56.538161 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-fe5376d5-9e40-4577-a05e-05bb75177c68 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.145098 Jan 11 15:32:56.538747 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1056/1859] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:56 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:32:57.555757 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d9a21d35-4c65-4d33-a715-8a6145533f42 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:57.556385 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d9a21d35-4c65-4d33-a715-8a6145533f42 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:57.562642 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d9a21d35-4c65-4d33-a715-8a6145533f42 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:57.563094 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d9a21d35-4c65-4d33-a715-8a6145533f42 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:57.563906 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d9a21d35-4c65-4d33-a715-8a6145533f42 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:57.564349 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d9a21d35-4c65-4d33-a715-8a6145533f42 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:57.689328 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-d9a21d35-4c65-4d33-a715-8a6145533f42 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:57.697570 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d9a21d35-4c65-4d33-a715-8a6145533f42 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.146387 Jan 11 15:32:57.698129 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 804/1860] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:57 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:32:58.714230 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1790c615-b743-40a4-9443-846db7582bdf tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:58.714836 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1790c615-b743-40a4-9443-846db7582bdf tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:58.721238 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1790c615-b743-40a4-9443-846db7582bdf tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:58.721697 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1790c615-b743-40a4-9443-846db7582bdf tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:58.722486 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1790c615-b743-40a4-9443-846db7582bdf tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:58.722932 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1790c615-b743-40a4-9443-846db7582bdf tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:58.849728 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1790c615-b743-40a4-9443-846db7582bdf tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:32:58.857414 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1790c615-b743-40a4-9443-846db7582bdf tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.146858 Jan 11 15:32:58.857983 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1057/1861] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:58 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:32:59.873837 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-88862cd5-5931-41ea-bed5-45fdbef4cba1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:32:59.874447 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-88862cd5-5931-41ea-bed5-45fdbef4cba1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:32:59.880691 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-88862cd5-5931-41ea-bed5-45fdbef4cba1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:59.881143 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-88862cd5-5931-41ea-bed5-45fdbef4cba1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:32:59.881921 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-88862cd5-5931-41ea-bed5-45fdbef4cba1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:32:59.882362 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-88862cd5-5931-41ea-bed5-45fdbef4cba1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:00.006852 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-88862cd5-5931-41ea-bed5-45fdbef4cba1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:00.014643 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-88862cd5-5931-41ea-bed5-45fdbef4cba1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.144486 Jan 11 15:33:00.015211 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 805/1862] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:32:59 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:01.031886 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e1e8c346-b408-4851-9d98-9bc967ee39ce tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:01.032566 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e1e8c346-b408-4851-9d98-9bc967ee39ce tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:01.039497 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e1e8c346-b408-4851-9d98-9bc967ee39ce tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:01.039952 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e1e8c346-b408-4851-9d98-9bc967ee39ce tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:01.040722 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e1e8c346-b408-4851-9d98-9bc967ee39ce tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:01.041159 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e1e8c346-b408-4851-9d98-9bc967ee39ce tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:01.407599 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e1e8c346-b408-4851-9d98-9bc967ee39ce tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:01.415921 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e1e8c346-b408-4851-9d98-9bc967ee39ce tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.387745 Jan 11 15:33:01.416594 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1058/1863] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:01 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:02.433182 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3ba8dbbf-e052-422d-b37b-722fbc97a844 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:02.433781 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3ba8dbbf-e052-422d-b37b-722fbc97a844 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:02.440057 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3ba8dbbf-e052-422d-b37b-722fbc97a844 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:02.440506 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3ba8dbbf-e052-422d-b37b-722fbc97a844 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:02.441289 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3ba8dbbf-e052-422d-b37b-722fbc97a844 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:02.441727 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3ba8dbbf-e052-422d-b37b-722fbc97a844 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:02.565552 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-3ba8dbbf-e052-422d-b37b-722fbc97a844 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:02.573236 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3ba8dbbf-e052-422d-b37b-722fbc97a844 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.143704 Jan 11 15:33:02.573800 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 806/1864] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:02 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:03.589892 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0489ea27-cb3b-4c47-a4f9-033f4dbf5489 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:03.590499 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0489ea27-cb3b-4c47-a4f9-033f4dbf5489 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:03.596728 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0489ea27-cb3b-4c47-a4f9-033f4dbf5489 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:03.597178 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0489ea27-cb3b-4c47-a4f9-033f4dbf5489 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:03.597950 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0489ea27-cb3b-4c47-a4f9-033f4dbf5489 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:03.598991 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0489ea27-cb3b-4c47-a4f9-033f4dbf5489 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:03.724706 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0489ea27-cb3b-4c47-a4f9-033f4dbf5489 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:03.732464 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0489ea27-cb3b-4c47-a4f9-033f4dbf5489 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.146211 Jan 11 15:33:03.733022 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1059/1865] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:03 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:04.748939 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-dddd7a21-5aa9-4777-9cce-51edcf6eb00d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:04.749487 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-dddd7a21-5aa9-4777-9cce-51edcf6eb00d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:04.755808 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-dddd7a21-5aa9-4777-9cce-51edcf6eb00d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:04.759030 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-dddd7a21-5aa9-4777-9cce-51edcf6eb00d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:04.759030 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-dddd7a21-5aa9-4777-9cce-51edcf6eb00d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:04.759030 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-dddd7a21-5aa9-4777-9cce-51edcf6eb00d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:04.886426 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-dddd7a21-5aa9-4777-9cce-51edcf6eb00d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:04.894116 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-dddd7a21-5aa9-4777-9cce-51edcf6eb00d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.148948 Jan 11 15:33:04.894685 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 807/1866] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:04 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:05.911054 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4fcac5aa-cd1f-468e-ba7f-aa1f4c026b6d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:05.911697 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-4fcac5aa-cd1f-468e-ba7f-aa1f4c026b6d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:05.918068 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4fcac5aa-cd1f-468e-ba7f-aa1f4c026b6d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:05.918563 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4fcac5aa-cd1f-468e-ba7f-aa1f4c026b6d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:05.919378 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4fcac5aa-cd1f-468e-ba7f-aa1f4c026b6d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:05.919826 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4fcac5aa-cd1f-468e-ba7f-aa1f4c026b6d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:06.049386 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-4fcac5aa-cd1f-468e-ba7f-aa1f4c026b6d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:06.057979 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4fcac5aa-cd1f-468e-ba7f-aa1f4c026b6d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.150610 Jan 11 15:33:06.058548 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1060/1867] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:05 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:07.074505 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-245460c3-b0b8-4de1-869c-23eafcba0bfe tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:07.075161 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-245460c3-b0b8-4de1-869c-23eafcba0bfe tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:07.081389 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-245460c3-b0b8-4de1-869c-23eafcba0bfe tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:07.081844 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-245460c3-b0b8-4de1-869c-23eafcba0bfe tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:07.082623 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-245460c3-b0b8-4de1-869c-23eafcba0bfe tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:07.083067 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-245460c3-b0b8-4de1-869c-23eafcba0bfe tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:07.210164 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-245460c3-b0b8-4de1-869c-23eafcba0bfe tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:07.217797 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-245460c3-b0b8-4de1-869c-23eafcba0bfe tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.146929 Jan 11 15:33:07.218419 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 808/1868] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:07 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:08.234937 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7b986c1e-6f72-401e-bef5-226a8fbe5809 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:08.236109 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-7b986c1e-6f72-401e-bef5-226a8fbe5809 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:08.245733 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7b986c1e-6f72-401e-bef5-226a8fbe5809 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:08.246182 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7b986c1e-6f72-401e-bef5-226a8fbe5809 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:08.246961 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7b986c1e-6f72-401e-bef5-226a8fbe5809 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:08.247431 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7b986c1e-6f72-401e-bef5-226a8fbe5809 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:08.371526 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-7b986c1e-6f72-401e-bef5-226a8fbe5809 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:08.379245 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7b986c1e-6f72-401e-bef5-226a8fbe5809 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.149077 Jan 11 15:33:08.379833 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1061/1869] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:08 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:09.397016 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a5b44c32-0613-4d20-a801-2f2bbd4cf1bc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:09.397581 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a5b44c32-0613-4d20-a801-2f2bbd4cf1bc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:09.403647 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a5b44c32-0613-4d20-a801-2f2bbd4cf1bc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:09.404102 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a5b44c32-0613-4d20-a801-2f2bbd4cf1bc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:09.404878 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a5b44c32-0613-4d20-a801-2f2bbd4cf1bc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:09.405318 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a5b44c32-0613-4d20-a801-2f2bbd4cf1bc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:09.532229 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-a5b44c32-0613-4d20-a801-2f2bbd4cf1bc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:09.540618 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a5b44c32-0613-4d20-a801-2f2bbd4cf1bc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.147559 Jan 11 15:33:09.541201 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 809/1870] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:09 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:10.556765 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-53ff9085-6828-488a-a0a6-166a611095ae tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:10.557315 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-53ff9085-6828-488a-a0a6-166a611095ae tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:10.563584 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-53ff9085-6828-488a-a0a6-166a611095ae tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:10.564024 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-53ff9085-6828-488a-a0a6-166a611095ae tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:10.564799 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-53ff9085-6828-488a-a0a6-166a611095ae tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:10.565241 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-53ff9085-6828-488a-a0a6-166a611095ae tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:10.689213 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-53ff9085-6828-488a-a0a6-166a611095ae tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:10.697553 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-53ff9085-6828-488a-a0a6-166a611095ae tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.144567 Jan 11 15:33:10.698120 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1062/1871] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:10 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:11.713724 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d60a6405-ea47-4546-b5dd-48ef1fb9d656 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:11.714370 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d60a6405-ea47-4546-b5dd-48ef1fb9d656 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:11.720946 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d60a6405-ea47-4546-b5dd-48ef1fb9d656 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:11.721410 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d60a6405-ea47-4546-b5dd-48ef1fb9d656 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:11.722195 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d60a6405-ea47-4546-b5dd-48ef1fb9d656 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:11.722635 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d60a6405-ea47-4546-b5dd-48ef1fb9d656 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:11.846404 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-d60a6405-ea47-4546-b5dd-48ef1fb9d656 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:11.854763 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d60a6405-ea47-4546-b5dd-48ef1fb9d656 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.144706 Jan 11 15:33:11.855463 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 810/1872] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:11 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:12.871619 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4e744ff3-1f24-4ac2-ac53-83280e5a411d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:12.872237 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-4e744ff3-1f24-4ac2-ac53-83280e5a411d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:12.878431 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4e744ff3-1f24-4ac2-ac53-83280e5a411d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:12.878886 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4e744ff3-1f24-4ac2-ac53-83280e5a411d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:12.879690 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4e744ff3-1f24-4ac2-ac53-83280e5a411d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:12.880130 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4e744ff3-1f24-4ac2-ac53-83280e5a411d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:13.008730 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-4e744ff3-1f24-4ac2-ac53-83280e5a411d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:13.016396 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4e744ff3-1f24-4ac2-ac53-83280e5a411d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.148455 Jan 11 15:33:13.016995 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1063/1873] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:12 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:14.033820 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-73c68ae0-7f25-40af-b458-7cd34ce5026c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:14.034438 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-73c68ae0-7f25-40af-b458-7cd34ce5026c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:14.041301 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-73c68ae0-7f25-40af-b458-7cd34ce5026c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:14.041755 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-73c68ae0-7f25-40af-b458-7cd34ce5026c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:14.042531 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-73c68ae0-7f25-40af-b458-7cd34ce5026c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:14.042972 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-73c68ae0-7f25-40af-b458-7cd34ce5026c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:14.165598 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-73c68ae0-7f25-40af-b458-7cd34ce5026c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:14.173157 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-73c68ae0-7f25-40af-b458-7cd34ce5026c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.143172 Jan 11 15:33:14.173720 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 811/1874] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:14 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:14.664627 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:33:14.664870 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: Tue Jan 11 15:33:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:33:15.189455 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-32501930-1906-4a3c-87a3-e11390e45541 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:15.190107 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-32501930-1906-4a3c-87a3-e11390e45541 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:15.196853 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-32501930-1906-4a3c-87a3-e11390e45541 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:15.197306 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-32501930-1906-4a3c-87a3-e11390e45541 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:15.198092 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-32501930-1906-4a3c-87a3-e11390e45541 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:15.198532 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-32501930-1906-4a3c-87a3-e11390e45541 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:15.327734 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-32501930-1906-4a3c-87a3-e11390e45541 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:15.335929 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-32501930-1906-4a3c-87a3-e11390e45541 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.150220 Jan 11 15:33:15.336497 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1064/1875] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:15 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:16.352729 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d08d68c6-581a-4cc2-99d4-8e6caa5ec3b2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:16.353339 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d08d68c6-581a-4cc2-99d4-8e6caa5ec3b2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:16.359598 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d08d68c6-581a-4cc2-99d4-8e6caa5ec3b2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:16.360051 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d08d68c6-581a-4cc2-99d4-8e6caa5ec3b2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:16.360826 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d08d68c6-581a-4cc2-99d4-8e6caa5ec3b2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:16.361263 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d08d68c6-581a-4cc2-99d4-8e6caa5ec3b2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:16.487378 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-d08d68c6-581a-4cc2-99d4-8e6caa5ec3b2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:16.495669 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d08d68c6-581a-4cc2-99d4-8e6caa5ec3b2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.146677 Jan 11 15:33:16.496235 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 812/1876] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:16 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:17.512501 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4cca63bb-430d-48d0-8771-537b8bfb9001 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:17.513109 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-4cca63bb-430d-48d0-8771-537b8bfb9001 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:17.519386 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4cca63bb-430d-48d0-8771-537b8bfb9001 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:17.519838 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4cca63bb-430d-48d0-8771-537b8bfb9001 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:17.520606 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4cca63bb-430d-48d0-8771-537b8bfb9001 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:17.521039 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4cca63bb-430d-48d0-8771-537b8bfb9001 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:17.646320 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-4cca63bb-430d-48d0-8771-537b8bfb9001 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:17.654687 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4cca63bb-430d-48d0-8771-537b8bfb9001 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.145816 Jan 11 15:33:17.655241 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1065/1877] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:17 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:18.671305 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-73d9e9ce-9af3-4023-8e11-1acfed67d0dd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:18.671950 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-73d9e9ce-9af3-4023-8e11-1acfed67d0dd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:18.679121 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-73d9e9ce-9af3-4023-8e11-1acfed67d0dd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:18.679607 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-73d9e9ce-9af3-4023-8e11-1acfed67d0dd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:18.680388 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-73d9e9ce-9af3-4023-8e11-1acfed67d0dd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:18.680831 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-73d9e9ce-9af3-4023-8e11-1acfed67d0dd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:18.857952 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-73d9e9ce-9af3-4023-8e11-1acfed67d0dd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:18.866120 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-73d9e9ce-9af3-4023-8e11-1acfed67d0dd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.198140 Jan 11 15:33:18.866685 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 813/1878] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:18 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:19.882529 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a0bc9505-455c-4f6b-8fc2-2583e6373970 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:19.883135 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a0bc9505-455c-4f6b-8fc2-2583e6373970 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:19.889582 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a0bc9505-455c-4f6b-8fc2-2583e6373970 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:19.890030 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a0bc9505-455c-4f6b-8fc2-2583e6373970 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:19.890798 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a0bc9505-455c-4f6b-8fc2-2583e6373970 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:19.891230 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a0bc9505-455c-4f6b-8fc2-2583e6373970 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:20.015035 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a0bc9505-455c-4f6b-8fc2-2583e6373970 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:20.023317 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a0bc9505-455c-4f6b-8fc2-2583e6373970 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.144949 Jan 11 15:33:20.023911 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1066/1879] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:19 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:21.040701 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-91ec35df-b455-4a12-9c5c-296b4b11f02b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:21.041302 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-91ec35df-b455-4a12-9c5c-296b4b11f02b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:21.047606 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-91ec35df-b455-4a12-9c5c-296b4b11f02b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:21.048063 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-91ec35df-b455-4a12-9c5c-296b4b11f02b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:21.048853 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-91ec35df-b455-4a12-9c5c-296b4b11f02b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:21.049298 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-91ec35df-b455-4a12-9c5c-296b4b11f02b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:21.177547 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-91ec35df-b455-4a12-9c5c-296b4b11f02b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:21.185209 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-91ec35df-b455-4a12-9c5c-296b4b11f02b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.148960 Jan 11 15:33:21.185771 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 814/1880] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:21 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:22.202731 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d840cec3-1cd3-4375-ae4d-02b4f840eced tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:22.203303 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d840cec3-1cd3-4375-ae4d-02b4f840eced tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:22.209888 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d840cec3-1cd3-4375-ae4d-02b4f840eced tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:22.210337 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d840cec3-1cd3-4375-ae4d-02b4f840eced tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:22.211105 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d840cec3-1cd3-4375-ae4d-02b4f840eced tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:22.211566 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d840cec3-1cd3-4375-ae4d-02b4f840eced tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:22.337511 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d840cec3-1cd3-4375-ae4d-02b4f840eced tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:22.345231 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d840cec3-1cd3-4375-ae4d-02b4f840eced tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.146358 Jan 11 15:33:22.345802 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1067/1881] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:22 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:23.361707 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-897f995d-a0a4-4153-b71a-00f3b07913ed tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:23.362326 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-897f995d-a0a4-4153-b71a-00f3b07913ed tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:23.369136 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-897f995d-a0a4-4153-b71a-00f3b07913ed tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:23.369590 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-897f995d-a0a4-4153-b71a-00f3b07913ed tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:23.370374 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-897f995d-a0a4-4153-b71a-00f3b07913ed tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:23.370822 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-897f995d-a0a4-4153-b71a-00f3b07913ed tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:23.502032 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-897f995d-a0a4-4153-b71a-00f3b07913ed tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:23.509788 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-897f995d-a0a4-4153-b71a-00f3b07913ed tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.151823 Jan 11 15:33:23.510364 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 815/1882] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:23 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:24.526551 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5fef8a61-9557-4081-a045-7bfb0b4e2aed tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:24.527095 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5fef8a61-9557-4081-a045-7bfb0b4e2aed tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:24.533291 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5fef8a61-9557-4081-a045-7bfb0b4e2aed tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:24.533739 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5fef8a61-9557-4081-a045-7bfb0b4e2aed tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:24.534575 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5fef8a61-9557-4081-a045-7bfb0b4e2aed tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:24.535009 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5fef8a61-9557-4081-a045-7bfb0b4e2aed tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:24.659668 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-5fef8a61-9557-4081-a045-7bfb0b4e2aed tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:24.667975 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5fef8a61-9557-4081-a045-7bfb0b4e2aed tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.145190 Jan 11 15:33:24.668532 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1068/1883] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:24 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:25.685572 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-5db31bb8-faca-47e9-ba2e-0c6fba639c5a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:25.686235 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-5db31bb8-faca-47e9-ba2e-0c6fba639c5a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:25.692513 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5db31bb8-faca-47e9-ba2e-0c6fba639c5a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:25.692962 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5db31bb8-faca-47e9-ba2e-0c6fba639c5a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:25.693732 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5db31bb8-faca-47e9-ba2e-0c6fba639c5a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:25.694165 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5db31bb8-faca-47e9-ba2e-0c6fba639c5a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:25.830159 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-5db31bb8-faca-47e9-ba2e-0c6fba639c5a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:25.837954 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-5db31bb8-faca-47e9-ba2e-0c6fba639c5a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.156363 Jan 11 15:33:25.838528 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 816/1884] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:25 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:26.854241 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-077bb57e-cb0a-47b7-ab44-8caed3f4eaca tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:26.854850 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-077bb57e-cb0a-47b7-ab44-8caed3f4eaca tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:26.861116 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-077bb57e-cb0a-47b7-ab44-8caed3f4eaca tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:26.861561 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-077bb57e-cb0a-47b7-ab44-8caed3f4eaca tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:26.862330 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-077bb57e-cb0a-47b7-ab44-8caed3f4eaca tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:26.862767 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-077bb57e-cb0a-47b7-ab44-8caed3f4eaca tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:26.986490 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-077bb57e-cb0a-47b7-ab44-8caed3f4eaca tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:26.994112 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-077bb57e-cb0a-47b7-ab44-8caed3f4eaca tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.143545 Jan 11 15:33:26.994668 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1069/1885] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:26 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:28.011374 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-bea0fc8b-b3c9-4d4e-8bab-33d2d24726da tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:28.011995 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-bea0fc8b-b3c9-4d4e-8bab-33d2d24726da tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:28.018172 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bea0fc8b-b3c9-4d4e-8bab-33d2d24726da tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:28.018617 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bea0fc8b-b3c9-4d4e-8bab-33d2d24726da tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:28.019409 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bea0fc8b-b3c9-4d4e-8bab-33d2d24726da tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:28.019845 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bea0fc8b-b3c9-4d4e-8bab-33d2d24726da tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:28.142497 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-bea0fc8b-b3c9-4d4e-8bab-33d2d24726da tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:28.150071 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-bea0fc8b-b3c9-4d4e-8bab-33d2d24726da tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.142292 Jan 11 15:33:28.150632 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 817/1886] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:28 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:29.166665 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-99a5a860-73c3-4b77-b3b3-629db71ad9f8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:29.167274 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-99a5a860-73c3-4b77-b3b3-629db71ad9f8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:29.173591 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-99a5a860-73c3-4b77-b3b3-629db71ad9f8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:29.174050 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-99a5a860-73c3-4b77-b3b3-629db71ad9f8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:29.174823 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-99a5a860-73c3-4b77-b3b3-629db71ad9f8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:29.175266 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-99a5a860-73c3-4b77-b3b3-629db71ad9f8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:29.307027 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-99a5a860-73c3-4b77-b3b3-629db71ad9f8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:29.314923 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-99a5a860-73c3-4b77-b3b3-629db71ad9f8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.151916 Jan 11 15:33:29.315518 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1070/1887] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:29 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:30.331740 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-cd5a8e8c-b0a5-4f0b-b010-e3dbc40db3c7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:30.332388 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-cd5a8e8c-b0a5-4f0b-b010-e3dbc40db3c7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:30.338634 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cd5a8e8c-b0a5-4f0b-b010-e3dbc40db3c7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:30.339088 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cd5a8e8c-b0a5-4f0b-b010-e3dbc40db3c7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:30.339923 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cd5a8e8c-b0a5-4f0b-b010-e3dbc40db3c7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:30.340364 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cd5a8e8c-b0a5-4f0b-b010-e3dbc40db3c7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:30.465100 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-cd5a8e8c-b0a5-4f0b-b010-e3dbc40db3c7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:30.472530 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-cd5a8e8c-b0a5-4f0b-b010-e3dbc40db3c7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.144603 Jan 11 15:33:30.473103 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 818/1888] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:30 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:31.490424 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b050f42f-a35f-4f64-bd63-2b9daf2c2e8a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:31.491004 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b050f42f-a35f-4f64-bd63-2b9daf2c2e8a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:31.497323 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b050f42f-a35f-4f64-bd63-2b9daf2c2e8a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:31.497783 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b050f42f-a35f-4f64-bd63-2b9daf2c2e8a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:31.498565 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b050f42f-a35f-4f64-bd63-2b9daf2c2e8a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:31.499015 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b050f42f-a35f-4f64-bd63-2b9daf2c2e8a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:31.628079 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b050f42f-a35f-4f64-bd63-2b9daf2c2e8a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:31.636491 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b050f42f-a35f-4f64-bd63-2b9daf2c2e8a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.150429 Jan 11 15:33:31.637058 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1071/1889] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:31 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:32.653399 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-18f3df00-580a-44d7-a663-00d20c4ef6d8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:32.653955 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-18f3df00-580a-44d7-a663-00d20c4ef6d8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:32.660159 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-18f3df00-580a-44d7-a663-00d20c4ef6d8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:32.660620 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-18f3df00-580a-44d7-a663-00d20c4ef6d8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:32.661395 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-18f3df00-580a-44d7-a663-00d20c4ef6d8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:32.662361 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-18f3df00-580a-44d7-a663-00d20c4ef6d8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:32.794855 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-18f3df00-580a-44d7-a663-00d20c4ef6d8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:32.802776 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-18f3df00-580a-44d7-a663-00d20c4ef6d8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.153163 Jan 11 15:33:32.803355 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 819/1890] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:32 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:33.819925 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7ea6c066-bcb3-433f-9422-a9f420e5dc87 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:33.820564 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-7ea6c066-bcb3-433f-9422-a9f420e5dc87 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:33.826707 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7ea6c066-bcb3-433f-9422-a9f420e5dc87 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:33.827157 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7ea6c066-bcb3-433f-9422-a9f420e5dc87 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:33.827969 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7ea6c066-bcb3-433f-9422-a9f420e5dc87 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:33.828416 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7ea6c066-bcb3-433f-9422-a9f420e5dc87 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:33.954461 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-7ea6c066-bcb3-433f-9422-a9f420e5dc87 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:33.962985 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7ea6c066-bcb3-433f-9422-a9f420e5dc87 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.147359 Jan 11 15:33:33.963583 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1072/1891] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:33 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:34.979254 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4c93f1ff-efaa-4679-b822-cc27f74607b1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:34.979912 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4c93f1ff-efaa-4679-b822-cc27f74607b1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:34.986061 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4c93f1ff-efaa-4679-b822-cc27f74607b1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:34.986508 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4c93f1ff-efaa-4679-b822-cc27f74607b1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:34.987277 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4c93f1ff-efaa-4679-b822-cc27f74607b1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:34.987737 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4c93f1ff-efaa-4679-b822-cc27f74607b1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:35.117980 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-4c93f1ff-efaa-4679-b822-cc27f74607b1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:35.125597 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4c93f1ff-efaa-4679-b822-cc27f74607b1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.150479 Jan 11 15:33:35.126160 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 820/1892] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:34 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:36.142172 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0c0220a9-6637-49ea-8455-076612d9e4e7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:36.142763 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0c0220a9-6637-49ea-8455-076612d9e4e7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:36.149738 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0c0220a9-6637-49ea-8455-076612d9e4e7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:36.150183 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0c0220a9-6637-49ea-8455-076612d9e4e7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:36.150948 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0c0220a9-6637-49ea-8455-076612d9e4e7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:36.151419 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0c0220a9-6637-49ea-8455-076612d9e4e7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:36.276645 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0c0220a9-6637-49ea-8455-076612d9e4e7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:36.284343 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0c0220a9-6637-49ea-8455-076612d9e4e7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.145813 Jan 11 15:33:36.284900 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1073/1893] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:36 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:37.300640 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-395e0569-e8a5-4750-afb1-6f7e09a61281 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:37.301260 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-395e0569-e8a5-4750-afb1-6f7e09a61281 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:37.307498 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-395e0569-e8a5-4750-afb1-6f7e09a61281 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:37.307947 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-395e0569-e8a5-4750-afb1-6f7e09a61281 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:37.308717 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-395e0569-e8a5-4750-afb1-6f7e09a61281 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:37.309158 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-395e0569-e8a5-4750-afb1-6f7e09a61281 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:37.436260 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-395e0569-e8a5-4750-afb1-6f7e09a61281 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:37.443851 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-395e0569-e8a5-4750-afb1-6f7e09a61281 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.147205 Jan 11 15:33:37.444437 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 821/1894] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:37 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:38.460995 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9821cf42-4d73-4bbb-aebb-df278fa66166 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:38.461585 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9821cf42-4d73-4bbb-aebb-df278fa66166 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:38.468080 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9821cf42-4d73-4bbb-aebb-df278fa66166 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:38.468496 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9821cf42-4d73-4bbb-aebb-df278fa66166 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:38.469268 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9821cf42-4d73-4bbb-aebb-df278fa66166 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:38.469703 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9821cf42-4d73-4bbb-aebb-df278fa66166 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:38.595201 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-9821cf42-4d73-4bbb-aebb-df278fa66166 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:38.602950 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9821cf42-4d73-4bbb-aebb-df278fa66166 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.146164 Jan 11 15:33:38.603547 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1074/1895] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:38 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:39.620108 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-bd991ad8-87dc-4a55-b894-27a647313110 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:39.621064 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-bd991ad8-87dc-4a55-b894-27a647313110 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:39.627379 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bd991ad8-87dc-4a55-b894-27a647313110 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:39.627841 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bd991ad8-87dc-4a55-b894-27a647313110 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:39.628621 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bd991ad8-87dc-4a55-b894-27a647313110 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:39.629066 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bd991ad8-87dc-4a55-b894-27a647313110 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:39.756269 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-bd991ad8-87dc-4a55-b894-27a647313110 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:39.763920 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-bd991ad8-87dc-4a55-b894-27a647313110 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.147841 Jan 11 15:33:39.764483 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 822/1896] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:39 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:40.781779 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9ab12a9f-cd2e-4661-b611-0d64b53060b4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:40.782505 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9ab12a9f-cd2e-4661-b611-0d64b53060b4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:40.793659 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9ab12a9f-cd2e-4661-b611-0d64b53060b4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:40.794134 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9ab12a9f-cd2e-4661-b611-0d64b53060b4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:40.794945 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9ab12a9f-cd2e-4661-b611-0d64b53060b4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:40.795417 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9ab12a9f-cd2e-4661-b611-0d64b53060b4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:40.921716 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-9ab12a9f-cd2e-4661-b611-0d64b53060b4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:40.930412 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9ab12a9f-cd2e-4661-b611-0d64b53060b4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.152951 Jan 11 15:33:40.930973 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1075/1897] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:40 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:41.947124 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-49ab9b3e-198d-439f-8953-9a7509581172 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:41.947815 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-49ab9b3e-198d-439f-8953-9a7509581172 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:41.954588 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-49ab9b3e-198d-439f-8953-9a7509581172 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:41.955034 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-49ab9b3e-198d-439f-8953-9a7509581172 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:41.955838 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-49ab9b3e-198d-439f-8953-9a7509581172 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:41.956276 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-49ab9b3e-198d-439f-8953-9a7509581172 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:42.080936 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-49ab9b3e-198d-439f-8953-9a7509581172 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:42.089115 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-49ab9b3e-198d-439f-8953-9a7509581172 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.145608 Jan 11 15:33:42.095086 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 823/1898] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:41 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:43.106546 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b17baa36-9f03-44cf-b06a-666110211f64 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:43.107226 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b17baa36-9f03-44cf-b06a-666110211f64 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:43.113620 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b17baa36-9f03-44cf-b06a-666110211f64 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:43.114072 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b17baa36-9f03-44cf-b06a-666110211f64 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:43.114859 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b17baa36-9f03-44cf-b06a-666110211f64 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:43.115320 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b17baa36-9f03-44cf-b06a-666110211f64 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:43.393241 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b17baa36-9f03-44cf-b06a-666110211f64 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:43.401418 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b17baa36-9f03-44cf-b06a-666110211f64 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.298663 Jan 11 15:33:43.401979 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1076/1899] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:43 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:44.418502 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f1de4147-5ff4-4d1b-854d-7e2be42cf589 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:44.419092 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f1de4147-5ff4-4d1b-854d-7e2be42cf589 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:44.425538 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f1de4147-5ff4-4d1b-854d-7e2be42cf589 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:44.425982 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f1de4147-5ff4-4d1b-854d-7e2be42cf589 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:44.426741 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f1de4147-5ff4-4d1b-854d-7e2be42cf589 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:44.427171 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f1de4147-5ff4-4d1b-854d-7e2be42cf589 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:44.551949 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-f1de4147-5ff4-4d1b-854d-7e2be42cf589 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:44.560283 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f1de4147-5ff4-4d1b-854d-7e2be42cf589 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.145433 Jan 11 15:33:44.560851 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 824/1900] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:44 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:45.577823 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9e314d73-a9c7-4208-a081-dd749852396a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:45.578435 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9e314d73-a9c7-4208-a081-dd749852396a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:45.584716 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9e314d73-a9c7-4208-a081-dd749852396a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:45.585161 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9e314d73-a9c7-4208-a081-dd749852396a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:45.585932 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9e314d73-a9c7-4208-a081-dd749852396a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:45.586367 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9e314d73-a9c7-4208-a081-dd749852396a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:45.713447 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-9e314d73-a9c7-4208-a081-dd749852396a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:45.721226 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9e314d73-a9c7-4208-a081-dd749852396a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.147022 Jan 11 15:33:45.721790 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1077/1901] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:45 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:33:46.738622 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4cbe2db2-8aee-4911-9720-25f8b4326d6c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:46.739159 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4cbe2db2-8aee-4911-9720-25f8b4326d6c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:46.746104 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4cbe2db2-8aee-4911-9720-25f8b4326d6c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:46.746556 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4cbe2db2-8aee-4911-9720-25f8b4326d6c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:46.747352 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4cbe2db2-8aee-4911-9720-25f8b4326d6c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:46.747794 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4cbe2db2-8aee-4911-9720-25f8b4326d6c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:46.871774 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-4cbe2db2-8aee-4911-9720-25f8b4326d6c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:46.879412 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4cbe2db2-8aee-4911-9720-25f8b4326d6c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.144501 Jan 11 15:33:46.879987 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 825/1902] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:46 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:47.896314 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-190ad717-79ef-40f6-930a-8f078d4e2047 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:47.896974 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-190ad717-79ef-40f6-930a-8f078d4e2047 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:47.903115 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-190ad717-79ef-40f6-930a-8f078d4e2047 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:47.903598 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-190ad717-79ef-40f6-930a-8f078d4e2047 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:47.904363 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-190ad717-79ef-40f6-930a-8f078d4e2047 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:47.904796 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-190ad717-79ef-40f6-930a-8f078d4e2047 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:48.028030 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-190ad717-79ef-40f6-930a-8f078d4e2047 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:48.035709 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-190ad717-79ef-40f6-930a-8f078d4e2047 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.143014 Jan 11 15:33:48.036274 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1078/1903] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:47 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:49.053248 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a26ffa4e-96ac-4af5-b1c3-7264653e1c4a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:49.053925 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a26ffa4e-96ac-4af5-b1c3-7264653e1c4a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:49.060234 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a26ffa4e-96ac-4af5-b1c3-7264653e1c4a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:49.060673 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a26ffa4e-96ac-4af5-b1c3-7264653e1c4a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:49.061466 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a26ffa4e-96ac-4af5-b1c3-7264653e1c4a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:49.061895 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a26ffa4e-96ac-4af5-b1c3-7264653e1c4a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:49.190612 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-a26ffa4e-96ac-4af5-b1c3-7264653e1c4a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:49.198775 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a26ffa4e-96ac-4af5-b1c3-7264653e1c4a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.149441 Jan 11 15:33:49.199362 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 826/1904] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:49 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:33:50.372838 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-40d7dd86-e04e-47a7-972c-6cfa8ef0286a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:50.373454 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-40d7dd86-e04e-47a7-972c-6cfa8ef0286a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:50.379198 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-40d7dd86-e04e-47a7-972c-6cfa8ef0286a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:50.379684 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-40d7dd86-e04e-47a7-972c-6cfa8ef0286a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:50.380460 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-40d7dd86-e04e-47a7-972c-6cfa8ef0286a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:50.380905 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-40d7dd86-e04e-47a7-972c-6cfa8ef0286a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:50.505892 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-40d7dd86-e04e-47a7-972c-6cfa8ef0286a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:50.513684 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-40d7dd86-e04e-47a7-972c-6cfa8ef0286a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.302836 Jan 11 15:33:50.514245 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1079/1905] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:50 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:50.752801 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:33:50.753300 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: Tue Jan 11 15:33:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:33:51.531818 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-75cdb3cd-d01a-4e10-bb74-533ec5aa62b9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:51.532461 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-75cdb3cd-d01a-4e10-bb74-533ec5aa62b9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:51.539329 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-75cdb3cd-d01a-4e10-bb74-533ec5aa62b9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:51.539788 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-75cdb3cd-d01a-4e10-bb74-533ec5aa62b9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:51.540570 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-75cdb3cd-d01a-4e10-bb74-533ec5aa62b9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:51.541011 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-75cdb3cd-d01a-4e10-bb74-533ec5aa62b9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:51.668829 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-75cdb3cd-d01a-4e10-bb74-533ec5aa62b9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:51.676797 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-75cdb3cd-d01a-4e10-bb74-533ec5aa62b9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.148649 Jan 11 15:33:51.677352 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 827/1906] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:51 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:52.694272 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1a703420-a271-496d-83f3-0f655e8d6d53 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:52.694803 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1a703420-a271-496d-83f3-0f655e8d6d53 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:52.700671 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1a703420-a271-496d-83f3-0f655e8d6d53 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:52.701132 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1a703420-a271-496d-83f3-0f655e8d6d53 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:52.701924 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1a703420-a271-496d-83f3-0f655e8d6d53 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:52.702363 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1a703420-a271-496d-83f3-0f655e8d6d53 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:52.824769 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1a703420-a271-496d-83f3-0f655e8d6d53 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:52.832444 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1a703420-a271-496d-83f3-0f655e8d6d53 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.142611 Jan 11 15:33:52.833047 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1080/1907] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:52 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:53.850368 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-52573c60-0f03-4f5b-98c7-64971605c0b4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:53.850998 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-52573c60-0f03-4f5b-98c7-64971605c0b4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:53.857108 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-52573c60-0f03-4f5b-98c7-64971605c0b4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:53.857559 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-52573c60-0f03-4f5b-98c7-64971605c0b4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:53.858330 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-52573c60-0f03-4f5b-98c7-64971605c0b4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:53.858769 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-52573c60-0f03-4f5b-98c7-64971605c0b4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:53.984363 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-52573c60-0f03-4f5b-98c7-64971605c0b4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:53.992013 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-52573c60-0f03-4f5b-98c7-64971605c0b4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.145994 Jan 11 15:33:53.992576 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 828/1908] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:53 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:55.008279 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6c8a1aac-b320-4a03-b465-52e023039668 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:55.008890 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6c8a1aac-b320-4a03-b465-52e023039668 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:55.015124 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6c8a1aac-b320-4a03-b465-52e023039668 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:55.015599 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6c8a1aac-b320-4a03-b465-52e023039668 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:55.016371 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6c8a1aac-b320-4a03-b465-52e023039668 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:55.016809 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6c8a1aac-b320-4a03-b465-52e023039668 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:55.141132 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6c8a1aac-b320-4a03-b465-52e023039668 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:55.149471 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6c8a1aac-b320-4a03-b465-52e023039668 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.145295 Jan 11 15:33:55.150054 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1081/1909] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:55 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:56.165704 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-edd366e0-6c19-4ba7-b5ea-cc7bc46fce9b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:56.166301 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-edd366e0-6c19-4ba7-b5ea-cc7bc46fce9b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:56.172605 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-edd366e0-6c19-4ba7-b5ea-cc7bc46fce9b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:56.173061 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-edd366e0-6c19-4ba7-b5ea-cc7bc46fce9b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:56.173837 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-edd366e0-6c19-4ba7-b5ea-cc7bc46fce9b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:56.174278 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-edd366e0-6c19-4ba7-b5ea-cc7bc46fce9b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:56.304367 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-edd366e0-6c19-4ba7-b5ea-cc7bc46fce9b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:56.312001 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-edd366e0-6c19-4ba7-b5ea-cc7bc46fce9b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.149944 Jan 11 15:33:56.312559 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 829/1910] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:56 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:57.329460 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b3e1262c-0dfd-4253-8632-c383a80a2e34 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:57.330068 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b3e1262c-0dfd-4253-8632-c383a80a2e34 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:57.336432 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b3e1262c-0dfd-4253-8632-c383a80a2e34 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:57.336883 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b3e1262c-0dfd-4253-8632-c383a80a2e34 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:57.337651 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b3e1262c-0dfd-4253-8632-c383a80a2e34 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:57.338087 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b3e1262c-0dfd-4253-8632-c383a80a2e34 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:57.465883 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b3e1262c-0dfd-4253-8632-c383a80a2e34 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:57.473575 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b3e1262c-0dfd-4253-8632-c383a80a2e34 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.147775 Jan 11 15:33:57.474139 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1082/1911] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:57 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:58.491122 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2aae5c30-f826-4db6-bda5-fb86f0bf6aa2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:58.491917 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2aae5c30-f826-4db6-bda5-fb86f0bf6aa2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:58.498555 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2aae5c30-f826-4db6-bda5-fb86f0bf6aa2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:58.499007 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2aae5c30-f826-4db6-bda5-fb86f0bf6aa2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:58.499816 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2aae5c30-f826-4db6-bda5-fb86f0bf6aa2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:58.500257 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2aae5c30-f826-4db6-bda5-fb86f0bf6aa2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:58.625955 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-2aae5c30-f826-4db6-bda5-fb86f0bf6aa2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:58.634023 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2aae5c30-f826-4db6-bda5-fb86f0bf6aa2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.147071 Jan 11 15:33:58.634587 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 830/1912] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:58 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:33:59.651187 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-48871c93-4a44-4023-b274-d5926ab80932 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:33:59.651821 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-48871c93-4a44-4023-b274-d5926ab80932 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:33:59.658018 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-48871c93-4a44-4023-b274-d5926ab80932 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:59.658470 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-48871c93-4a44-4023-b274-d5926ab80932 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:59.659234 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-48871c93-4a44-4023-b274-d5926ab80932 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:33:59.659698 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-48871c93-4a44-4023-b274-d5926ab80932 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:33:59.787428 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-48871c93-4a44-4023-b274-d5926ab80932 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:33:59.795787 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-48871c93-4a44-4023-b274-d5926ab80932 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.148775 Jan 11 15:33:59.796373 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1083/1913] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:33:59 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:00.813281 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f052762e-cf70-4e8f-8d57-95022ab692e4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:00.813894 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f052762e-cf70-4e8f-8d57-95022ab692e4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:00.820566 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f052762e-cf70-4e8f-8d57-95022ab692e4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:00.823237 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f052762e-cf70-4e8f-8d57-95022ab692e4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:00.823237 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f052762e-cf70-4e8f-8d57-95022ab692e4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:00.823237 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f052762e-cf70-4e8f-8d57-95022ab692e4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:00.947268 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-f052762e-cf70-4e8f-8d57-95022ab692e4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:00.954960 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f052762e-cf70-4e8f-8d57-95022ab692e4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.145329 Jan 11 15:34:00.955558 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 831/1914] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:00 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:01.971485 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c2cdf23f-913b-4c56-86fc-ca7999ea4217 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:01.972161 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c2cdf23f-913b-4c56-86fc-ca7999ea4217 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:01.978932 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c2cdf23f-913b-4c56-86fc-ca7999ea4217 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:01.979413 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c2cdf23f-913b-4c56-86fc-ca7999ea4217 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:01.980211 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c2cdf23f-913b-4c56-86fc-ca7999ea4217 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:01.980650 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c2cdf23f-913b-4c56-86fc-ca7999ea4217 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:02.104278 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c2cdf23f-913b-4c56-86fc-ca7999ea4217 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:02.114038 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c2cdf23f-913b-4c56-86fc-ca7999ea4217 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.146137 Jan 11 15:34:02.114606 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1084/1915] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:01 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:03.131476 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-08c8d4c6-64b7-4c1a-b2cf-2d1f6d4a5f6d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:03.132074 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-08c8d4c6-64b7-4c1a-b2cf-2d1f6d4a5f6d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:03.138254 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-08c8d4c6-64b7-4c1a-b2cf-2d1f6d4a5f6d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:03.138808 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-08c8d4c6-64b7-4c1a-b2cf-2d1f6d4a5f6d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:03.139642 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-08c8d4c6-64b7-4c1a-b2cf-2d1f6d4a5f6d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:03.140101 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-08c8d4c6-64b7-4c1a-b2cf-2d1f6d4a5f6d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:03.269836 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-08c8d4c6-64b7-4c1a-b2cf-2d1f6d4a5f6d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:03.277896 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-08c8d4c6-64b7-4c1a-b2cf-2d1f6d4a5f6d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.150205 Jan 11 15:34:03.280903 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 832/1916] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:03 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:34:04.295512 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-35f31b49-a4b1-435f-8f6f-595b499aa408 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:04.296126 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-35f31b49-a4b1-435f-8f6f-595b499aa408 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:04.302735 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-35f31b49-a4b1-435f-8f6f-595b499aa408 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:04.303702 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-35f31b49-a4b1-435f-8f6f-595b499aa408 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:04.304477 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-35f31b49-a4b1-435f-8f6f-595b499aa408 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:04.304916 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-35f31b49-a4b1-435f-8f6f-595b499aa408 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:04.434487 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-35f31b49-a4b1-435f-8f6f-595b499aa408 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:04.442248 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-35f31b49-a4b1-435f-8f6f-595b499aa408 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.150358 Jan 11 15:34:04.442821 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1085/1917] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:04 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:05.460569 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f78a291c-446e-4b9a-b3fa-a1ad61c65cee tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:05.461248 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f78a291c-446e-4b9a-b3fa-a1ad61c65cee tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:05.467453 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f78a291c-446e-4b9a-b3fa-a1ad61c65cee tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:05.467903 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f78a291c-446e-4b9a-b3fa-a1ad61c65cee tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:05.468675 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f78a291c-446e-4b9a-b3fa-a1ad61c65cee tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:05.469110 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f78a291c-446e-4b9a-b3fa-a1ad61c65cee tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:05.595115 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-f78a291c-446e-4b9a-b3fa-a1ad61c65cee tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:05.602707 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f78a291c-446e-4b9a-b3fa-a1ad61c65cee tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.146360 Jan 11 15:34:05.603267 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 833/1918] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:05 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:06.619611 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-10e72865-6409-4408-b006-f35b1eeddee3 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:06.620161 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-10e72865-6409-4408-b006-f35b1eeddee3 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:06.626615 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-10e72865-6409-4408-b006-f35b1eeddee3 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:06.627077 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-10e72865-6409-4408-b006-f35b1eeddee3 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:06.627893 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-10e72865-6409-4408-b006-f35b1eeddee3 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:06.628343 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-10e72865-6409-4408-b006-f35b1eeddee3 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:06.754052 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-10e72865-6409-4408-b006-f35b1eeddee3 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:06.761668 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-10e72865-6409-4408-b006-f35b1eeddee3 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.145841 Jan 11 15:34:06.762225 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1086/1919] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:06 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:07.778297 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-cd1ab1d2-11e0-4103-a01b-868acfb894cb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:07.778888 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-cd1ab1d2-11e0-4103-a01b-868acfb894cb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:07.785247 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cd1ab1d2-11e0-4103-a01b-868acfb894cb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:07.785705 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cd1ab1d2-11e0-4103-a01b-868acfb894cb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:07.786477 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cd1ab1d2-11e0-4103-a01b-868acfb894cb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:07.786913 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cd1ab1d2-11e0-4103-a01b-868acfb894cb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:07.914518 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-cd1ab1d2-11e0-4103-a01b-868acfb894cb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:07.922203 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-cd1ab1d2-11e0-4103-a01b-868acfb894cb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.147628 Jan 11 15:34:07.922763 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 834/1920] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:07 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:08.939993 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a26e8334-22f2-4d79-9f2b-fb832c311f24 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:08.940593 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a26e8334-22f2-4d79-9f2b-fb832c311f24 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:08.946846 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a26e8334-22f2-4d79-9f2b-fb832c311f24 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:08.947309 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a26e8334-22f2-4d79-9f2b-fb832c311f24 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:08.948083 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a26e8334-22f2-4d79-9f2b-fb832c311f24 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:08.948523 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a26e8334-22f2-4d79-9f2b-fb832c311f24 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:09.074556 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a26e8334-22f2-4d79-9f2b-fb832c311f24 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:09.082475 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a26e8334-22f2-4d79-9f2b-fb832c311f24 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.146164 Jan 11 15:34:09.083037 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1087/1921] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:08 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:10.099785 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-85992920-26fc-4c80-8004-266beda0947e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:10.100404 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-85992920-26fc-4c80-8004-266beda0947e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:10.106617 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-85992920-26fc-4c80-8004-266beda0947e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:10.107075 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-85992920-26fc-4c80-8004-266beda0947e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:10.107892 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-85992920-26fc-4c80-8004-266beda0947e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:10.108348 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-85992920-26fc-4c80-8004-266beda0947e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:10.231334 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-85992920-26fc-4c80-8004-266beda0947e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:10.239271 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-85992920-26fc-4c80-8004-266beda0947e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.143114 Jan 11 15:34:10.239860 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 835/1922] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:10 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:11.256867 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2397a001-4c80-42cd-ae57-a89871b65656 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:11.257554 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2397a001-4c80-42cd-ae57-a89871b65656 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:11.263723 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2397a001-4c80-42cd-ae57-a89871b65656 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:11.264172 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2397a001-4c80-42cd-ae57-a89871b65656 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:11.264944 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2397a001-4c80-42cd-ae57-a89871b65656 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:11.265378 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2397a001-4c80-42cd-ae57-a89871b65656 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:11.392975 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-2397a001-4c80-42cd-ae57-a89871b65656 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:11.401235 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2397a001-4c80-42cd-ae57-a89871b65656 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.148136 Jan 11 15:34:11.401790 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1088/1923] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:11 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:12.418020 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e34dae9f-35fe-47dc-84f4-904d73dcfbf5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:12.418645 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e34dae9f-35fe-47dc-84f4-904d73dcfbf5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:12.425172 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e34dae9f-35fe-47dc-84f4-904d73dcfbf5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:12.425629 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e34dae9f-35fe-47dc-84f4-904d73dcfbf5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:12.426406 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e34dae9f-35fe-47dc-84f4-904d73dcfbf5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:12.426853 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e34dae9f-35fe-47dc-84f4-904d73dcfbf5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:12.550331 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-e34dae9f-35fe-47dc-84f4-904d73dcfbf5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:12.558538 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e34dae9f-35fe-47dc-84f4-904d73dcfbf5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.144227 Jan 11 15:34:12.559095 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 836/1924] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:12 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:13.575263 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-da62e82a-6681-4157-82ed-e6776822d3eb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:13.575879 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-da62e82a-6681-4157-82ed-e6776822d3eb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:13.582159 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-da62e82a-6681-4157-82ed-e6776822d3eb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:13.582603 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-da62e82a-6681-4157-82ed-e6776822d3eb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:13.583412 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-da62e82a-6681-4157-82ed-e6776822d3eb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:13.583849 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-da62e82a-6681-4157-82ed-e6776822d3eb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:13.711242 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-da62e82a-6681-4157-82ed-e6776822d3eb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:13.719045 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-da62e82a-6681-4157-82ed-e6776822d3eb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.147455 Jan 11 15:34:13.719655 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1089/1925] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:13 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:14.736570 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-65530791-5ae8-427e-86bb-8edd238d5ec2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:14.737122 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-65530791-5ae8-427e-86bb-8edd238d5ec2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:14.743422 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-65530791-5ae8-427e-86bb-8edd238d5ec2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:14.743874 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-65530791-5ae8-427e-86bb-8edd238d5ec2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:14.744638 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-65530791-5ae8-427e-86bb-8edd238d5ec2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:14.745074 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-65530791-5ae8-427e-86bb-8edd238d5ec2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:14.869543 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-65530791-5ae8-427e-86bb-8edd238d5ec2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:14.877112 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-65530791-5ae8-427e-86bb-8edd238d5ec2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.144309 Jan 11 15:34:14.877668 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 837/1926] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:14 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:15.893949 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c9c85d67-ba92-4224-8476-a2f24c89051b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:15.894557 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c9c85d67-ba92-4224-8476-a2f24c89051b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:15.901324 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c9c85d67-ba92-4224-8476-a2f24c89051b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:15.901770 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c9c85d67-ba92-4224-8476-a2f24c89051b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:15.902540 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c9c85d67-ba92-4224-8476-a2f24c89051b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:15.902977 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c9c85d67-ba92-4224-8476-a2f24c89051b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:16.026047 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c9c85d67-ba92-4224-8476-a2f24c89051b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:16.033851 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c9c85d67-ba92-4224-8476-a2f24c89051b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.143547 Jan 11 15:34:16.034413 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1090/1927] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:15 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:17.050822 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-de074579-9235-403c-9356-a7958f265858 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:17.051470 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-de074579-9235-403c-9356-a7958f265858 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:17.057744 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-de074579-9235-403c-9356-a7958f265858 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:17.058201 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-de074579-9235-403c-9356-a7958f265858 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:17.058982 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-de074579-9235-403c-9356-a7958f265858 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:17.059456 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-de074579-9235-403c-9356-a7958f265858 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:17.186630 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-de074579-9235-403c-9356-a7958f265858 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:17.194413 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-de074579-9235-403c-9356-a7958f265858 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.147501 Jan 11 15:34:17.204556 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 838/1928] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:17 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:18.211898 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-79a80aa2-042f-449c-adb2-691a2bd44b20 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:18.212519 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-79a80aa2-042f-449c-adb2-691a2bd44b20 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:18.220618 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-79a80aa2-042f-449c-adb2-691a2bd44b20 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:18.221063 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-79a80aa2-042f-449c-adb2-691a2bd44b20 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:18.221848 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-79a80aa2-042f-449c-adb2-691a2bd44b20 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:18.222285 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-79a80aa2-042f-449c-adb2-691a2bd44b20 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:18.350244 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-79a80aa2-042f-449c-adb2-691a2bd44b20 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:18.357983 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-79a80aa2-042f-449c-adb2-691a2bd44b20 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.150444 Jan 11 15:34:18.358555 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1091/1929] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:18 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:19.375473 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c14aa3a9-9951-4b15-95d2-35b44e36733d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:19.376093 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c14aa3a9-9951-4b15-95d2-35b44e36733d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:19.382324 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c14aa3a9-9951-4b15-95d2-35b44e36733d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:19.382780 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c14aa3a9-9951-4b15-95d2-35b44e36733d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:19.383591 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c14aa3a9-9951-4b15-95d2-35b44e36733d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:19.384029 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c14aa3a9-9951-4b15-95d2-35b44e36733d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:19.510304 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-c14aa3a9-9951-4b15-95d2-35b44e36733d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:19.518247 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c14aa3a9-9951-4b15-95d2-35b44e36733d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.146526 Jan 11 15:34:19.518819 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 839/1930] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:19 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:20.535422 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a7eb4f98-f7bc-4c43-9bb8-443341876a35 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:20.536034 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a7eb4f98-f7bc-4c43-9bb8-443341876a35 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:20.542686 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a7eb4f98-f7bc-4c43-9bb8-443341876a35 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:20.543134 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a7eb4f98-f7bc-4c43-9bb8-443341876a35 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:20.543985 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a7eb4f98-f7bc-4c43-9bb8-443341876a35 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:20.544423 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a7eb4f98-f7bc-4c43-9bb8-443341876a35 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:20.671870 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a7eb4f98-f7bc-4c43-9bb8-443341876a35 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:20.679766 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a7eb4f98-f7bc-4c43-9bb8-443341876a35 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.147957 Jan 11 15:34:20.680330 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1092/1931] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:20 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:21.697137 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-61730081-29b9-4603-b427-eb3eb95170e6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:21.697744 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-61730081-29b9-4603-b427-eb3eb95170e6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:21.703927 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-61730081-29b9-4603-b427-eb3eb95170e6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:21.704372 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-61730081-29b9-4603-b427-eb3eb95170e6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:21.705136 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-61730081-29b9-4603-b427-eb3eb95170e6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:21.705569 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-61730081-29b9-4603-b427-eb3eb95170e6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:21.833273 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-61730081-29b9-4603-b427-eb3eb95170e6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:21.841142 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-61730081-29b9-4603-b427-eb3eb95170e6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.148174 Jan 11 15:34:21.841705 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 840/1932] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:21 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:22.861113 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-36487082-7cc2-4571-bdde-644e21d4c95a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:22.861739 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-36487082-7cc2-4571-bdde-644e21d4c95a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:22.870365 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-36487082-7cc2-4571-bdde-644e21d4c95a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:22.870815 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-36487082-7cc2-4571-bdde-644e21d4c95a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:22.871627 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-36487082-7cc2-4571-bdde-644e21d4c95a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:22.872073 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-36487082-7cc2-4571-bdde-644e21d4c95a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:22.997645 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-36487082-7cc2-4571-bdde-644e21d4c95a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:23.005613 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-36487082-7cc2-4571-bdde-644e21d4c95a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.150663 Jan 11 15:34:23.006175 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1093/1933] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:22 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:24.022739 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c33f851c-639c-43a9-9367-1ebd6649cd6e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:24.023383 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c33f851c-639c-43a9-9367-1ebd6649cd6e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:24.029236 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c33f851c-639c-43a9-9367-1ebd6649cd6e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:24.029683 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c33f851c-639c-43a9-9367-1ebd6649cd6e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:24.030443 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c33f851c-639c-43a9-9367-1ebd6649cd6e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:24.030875 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c33f851c-639c-43a9-9367-1ebd6649cd6e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:24.153252 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-c33f851c-639c-43a9-9367-1ebd6649cd6e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:24.160926 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c33f851c-639c-43a9-9367-1ebd6649cd6e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.141948 Jan 11 15:34:24.161483 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 841/1934] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:24 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:25.178306 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3a4ca1b0-e875-41de-bc33-efe568f8168b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:25.178920 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3a4ca1b0-e875-41de-bc33-efe568f8168b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:25.185219 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3a4ca1b0-e875-41de-bc33-efe568f8168b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:25.185670 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3a4ca1b0-e875-41de-bc33-efe568f8168b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:25.186445 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3a4ca1b0-e875-41de-bc33-efe568f8168b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:25.186885 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3a4ca1b0-e875-41de-bc33-efe568f8168b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:25.216178 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:34:25.216755 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: Tue Jan 11 15:34:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 (ip 10.222.0.52) !!! Jan 11 15:34:25.317602 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:34:25.318089 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: Tue Jan 11 15:34:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:34:25.320001 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3a4ca1b0-e875-41de-bc33-efe568f8168b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:25.327716 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3a4ca1b0-e875-41de-bc33-efe568f8168b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.153040 Jan 11 15:34:25.328277 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1094/1935] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:25 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:26.344740 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-33389d28-e851-48f0-9aae-48fbc1efc6f3 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:26.345344 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-33389d28-e851-48f0-9aae-48fbc1efc6f3 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:26.351584 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-33389d28-e851-48f0-9aae-48fbc1efc6f3 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:26.352028 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-33389d28-e851-48f0-9aae-48fbc1efc6f3 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:26.352800 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-33389d28-e851-48f0-9aae-48fbc1efc6f3 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:26.353231 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-33389d28-e851-48f0-9aae-48fbc1efc6f3 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:26.476691 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-33389d28-e851-48f0-9aae-48fbc1efc6f3 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:26.484308 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-33389d28-e851-48f0-9aae-48fbc1efc6f3 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.143237 Jan 11 15:34:26.484864 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 842/1936] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:26 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:27.501224 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-993a4b53-3f20-4bde-ba8b-25e1c6018b32 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:27.501792 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-993a4b53-3f20-4bde-ba8b-25e1c6018b32 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:27.508197 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-993a4b53-3f20-4bde-ba8b-25e1c6018b32 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:27.508647 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-993a4b53-3f20-4bde-ba8b-25e1c6018b32 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:27.509454 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-993a4b53-3f20-4bde-ba8b-25e1c6018b32 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:27.509938 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-993a4b53-3f20-4bde-ba8b-25e1c6018b32 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:27.636541 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-993a4b53-3f20-4bde-ba8b-25e1c6018b32 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:27.644290 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-993a4b53-3f20-4bde-ba8b-25e1c6018b32 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.146839 Jan 11 15:34:27.644858 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1095/1937] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:27 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:28.661262 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-48db58a9-8bf7-41fd-95d3-765bb4a85b79 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:28.661890 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-48db58a9-8bf7-41fd-95d3-765bb4a85b79 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:28.668336 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-48db58a9-8bf7-41fd-95d3-765bb4a85b79 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:28.668785 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-48db58a9-8bf7-41fd-95d3-765bb4a85b79 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:28.669648 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-48db58a9-8bf7-41fd-95d3-765bb4a85b79 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:28.670075 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-48db58a9-8bf7-41fd-95d3-765bb4a85b79 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:28.795886 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-48db58a9-8bf7-41fd-95d3-765bb4a85b79 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:28.803693 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-48db58a9-8bf7-41fd-95d3-765bb4a85b79 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.146065 Jan 11 15:34:28.804250 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 843/1938] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:28 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:29.819552 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1079f2d4-fecc-4e5b-84ac-ebead2565a16 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:29.820167 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1079f2d4-fecc-4e5b-84ac-ebead2565a16 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:29.826564 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1079f2d4-fecc-4e5b-84ac-ebead2565a16 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:29.827013 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1079f2d4-fecc-4e5b-84ac-ebead2565a16 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:29.827820 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1079f2d4-fecc-4e5b-84ac-ebead2565a16 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:29.828261 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1079f2d4-fecc-4e5b-84ac-ebead2565a16 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:29.956356 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1079f2d4-fecc-4e5b-84ac-ebead2565a16 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:29.964549 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1079f2d4-fecc-4e5b-84ac-ebead2565a16 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.148629 Jan 11 15:34:29.965117 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1096/1939] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:29 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:30.981822 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7c4ce103-529d-45c4-9ad5-e074c7e7aded tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:30.982425 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7c4ce103-529d-45c4-9ad5-e074c7e7aded tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:30.988587 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7c4ce103-529d-45c4-9ad5-e074c7e7aded tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:30.989032 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7c4ce103-529d-45c4-9ad5-e074c7e7aded tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:30.989796 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7c4ce103-529d-45c4-9ad5-e074c7e7aded tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:30.990227 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7c4ce103-529d-45c4-9ad5-e074c7e7aded tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:31.115504 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-7c4ce103-529d-45c4-9ad5-e074c7e7aded tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:31.123459 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7c4ce103-529d-45c4-9ad5-e074c7e7aded tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.145855 Jan 11 15:34:31.124021 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 844/1940] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:30 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:32.139909 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-81cefee4-ecbb-4185-906c-ee4e41cc3839 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:32.140527 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-81cefee4-ecbb-4185-906c-ee4e41cc3839 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:32.146686 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-81cefee4-ecbb-4185-906c-ee4e41cc3839 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:32.147135 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-81cefee4-ecbb-4185-906c-ee4e41cc3839 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:32.147940 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-81cefee4-ecbb-4185-906c-ee4e41cc3839 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:32.148384 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-81cefee4-ecbb-4185-906c-ee4e41cc3839 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:32.273894 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-81cefee4-ecbb-4185-906c-ee4e41cc3839 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:32.281635 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-81cefee4-ecbb-4185-906c-ee4e41cc3839 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.145519 Jan 11 15:34:32.282197 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1097/1941] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:32 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:33.299035 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b3929d85-89f4-49e1-ae2d-3468555aa75d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:33.299673 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b3929d85-89f4-49e1-ae2d-3468555aa75d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:33.305905 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b3929d85-89f4-49e1-ae2d-3468555aa75d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:33.307009 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b3929d85-89f4-49e1-ae2d-3468555aa75d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:33.307819 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b3929d85-89f4-49e1-ae2d-3468555aa75d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:33.308267 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b3929d85-89f4-49e1-ae2d-3468555aa75d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:33.434066 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-b3929d85-89f4-49e1-ae2d-3468555aa75d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:33.441778 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b3929d85-89f4-49e1-ae2d-3468555aa75d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.146661 Jan 11 15:34:33.442338 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 845/1942] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:33 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:34.457689 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-56fac1a1-1bf8-4481-a73c-0bf72f549d96 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:34.458295 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-56fac1a1-1bf8-4481-a73c-0bf72f549d96 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:34.464534 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-56fac1a1-1bf8-4481-a73c-0bf72f549d96 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:34.464985 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-56fac1a1-1bf8-4481-a73c-0bf72f549d96 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:34.465751 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-56fac1a1-1bf8-4481-a73c-0bf72f549d96 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:34.466203 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-56fac1a1-1bf8-4481-a73c-0bf72f549d96 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:34.591936 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-56fac1a1-1bf8-4481-a73c-0bf72f549d96 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:34.599695 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-56fac1a1-1bf8-4481-a73c-0bf72f549d96 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.145648 Jan 11 15:34:34.600262 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1098/1943] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:34 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:35.616218 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f774377f-348c-490f-9692-00b6723692ed tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:35.616825 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f774377f-348c-490f-9692-00b6723692ed tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:35.623315 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f774377f-348c-490f-9692-00b6723692ed tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:35.623766 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f774377f-348c-490f-9692-00b6723692ed tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:35.624536 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f774377f-348c-490f-9692-00b6723692ed tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:35.624969 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f774377f-348c-490f-9692-00b6723692ed tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:35.751116 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-f774377f-348c-490f-9692-00b6723692ed tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:35.758752 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f774377f-348c-490f-9692-00b6723692ed tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.146152 Jan 11 15:34:35.759326 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 846/1944] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:35 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:36.776079 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-cacecf81-4f31-4335-b475-289feecae743 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:36.776699 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-cacecf81-4f31-4335-b475-289feecae743 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:36.782885 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cacecf81-4f31-4335-b475-289feecae743 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:36.783376 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cacecf81-4f31-4335-b475-289feecae743 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:36.784417 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cacecf81-4f31-4335-b475-289feecae743 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:36.784861 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cacecf81-4f31-4335-b475-289feecae743 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:36.909069 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-cacecf81-4f31-4335-b475-289feecae743 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:36.916699 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-cacecf81-4f31-4335-b475-289feecae743 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.144979 Jan 11 15:34:36.917268 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1099/1945] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:36 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:34:37.933849 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e227264b-cb7d-4829-8f97-d7cefb94ddc4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:37.934447 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e227264b-cb7d-4829-8f97-d7cefb94ddc4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:37.940741 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e227264b-cb7d-4829-8f97-d7cefb94ddc4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:37.941188 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e227264b-cb7d-4829-8f97-d7cefb94ddc4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:37.941953 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e227264b-cb7d-4829-8f97-d7cefb94ddc4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:37.942387 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e227264b-cb7d-4829-8f97-d7cefb94ddc4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:38.070503 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-e227264b-cb7d-4829-8f97-d7cefb94ddc4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:38.078132 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e227264b-cb7d-4829-8f97-d7cefb94ddc4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.148078 Jan 11 15:34:38.078691 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 847/1946] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:37 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:39.095621 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3e20af4e-7d87-487f-9594-9b133e244ad1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:39.096258 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3e20af4e-7d87-487f-9594-9b133e244ad1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:39.102338 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3e20af4e-7d87-487f-9594-9b133e244ad1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:39.104601 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3e20af4e-7d87-487f-9594-9b133e244ad1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:39.104601 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3e20af4e-7d87-487f-9594-9b133e244ad1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:39.104601 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3e20af4e-7d87-487f-9594-9b133e244ad1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:39.232761 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3e20af4e-7d87-487f-9594-9b133e244ad1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:39.240596 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3e20af4e-7d87-487f-9594-9b133e244ad1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.148627 Jan 11 15:34:39.241162 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1100/1947] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:39 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:40.257734 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-33c03441-be69-4922-bb00-b9d87154257c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:40.258345 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-33c03441-be69-4922-bb00-b9d87154257c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:40.265179 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-33c03441-be69-4922-bb00-b9d87154257c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:40.265621 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-33c03441-be69-4922-bb00-b9d87154257c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:40.266392 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-33c03441-be69-4922-bb00-b9d87154257c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:40.266824 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-33c03441-be69-4922-bb00-b9d87154257c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:40.389581 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-33c03441-be69-4922-bb00-b9d87154257c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:40.397093 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-33c03441-be69-4922-bb00-b9d87154257c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.143224 Jan 11 15:34:40.397650 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 848/1948] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:40 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:40.581556 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:34:40.582096 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: Tue Jan 11 15:34:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:34:41.413769 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-74447299-5e76-4d61-af0a-1d2e66630f3f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:41.414370 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-74447299-5e76-4d61-af0a-1d2e66630f3f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:41.421210 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-74447299-5e76-4d61-af0a-1d2e66630f3f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:41.421655 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-74447299-5e76-4d61-af0a-1d2e66630f3f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:41.422419 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-74447299-5e76-4d61-af0a-1d2e66630f3f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:41.422854 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-74447299-5e76-4d61-af0a-1d2e66630f3f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:41.550243 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-74447299-5e76-4d61-af0a-1d2e66630f3f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:41.558519 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-74447299-5e76-4d61-af0a-1d2e66630f3f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.148457 Jan 11 15:34:41.559071 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1101/1949] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:41 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:42.575833 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-1c02a919-9bcb-4737-a871-c2e1faf9f583 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:42.576389 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-1c02a919-9bcb-4737-a871-c2e1faf9f583 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:42.582594 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1c02a919-9bcb-4737-a871-c2e1faf9f583 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:42.583054 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1c02a919-9bcb-4737-a871-c2e1faf9f583 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:42.583873 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1c02a919-9bcb-4737-a871-c2e1faf9f583 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:42.584318 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1c02a919-9bcb-4737-a871-c2e1faf9f583 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:42.711098 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-1c02a919-9bcb-4737-a871-c2e1faf9f583 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:42.719347 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-1c02a919-9bcb-4737-a871-c2e1faf9f583 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.147238 Jan 11 15:34:42.719943 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 849/1950] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:42 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:43.737643 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9d0a92ea-8302-4ab3-bbf5-05f4855c7b9d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:43.738240 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9d0a92ea-8302-4ab3-bbf5-05f4855c7b9d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:43.744675 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9d0a92ea-8302-4ab3-bbf5-05f4855c7b9d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:43.745520 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9d0a92ea-8302-4ab3-bbf5-05f4855c7b9d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:43.745925 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9d0a92ea-8302-4ab3-bbf5-05f4855c7b9d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:43.746360 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9d0a92ea-8302-4ab3-bbf5-05f4855c7b9d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:43.873660 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-9d0a92ea-8302-4ab3-bbf5-05f4855c7b9d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:43.881279 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9d0a92ea-8302-4ab3-bbf5-05f4855c7b9d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.148151 Jan 11 15:34:43.881836 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1102/1951] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:43 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:44.898218 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-324978e7-bd20-4f2b-93d4-87b3be818d9a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:44.898825 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-324978e7-bd20-4f2b-93d4-87b3be818d9a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:44.905041 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-324978e7-bd20-4f2b-93d4-87b3be818d9a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:44.905495 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-324978e7-bd20-4f2b-93d4-87b3be818d9a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:44.906264 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-324978e7-bd20-4f2b-93d4-87b3be818d9a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:44.906708 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-324978e7-bd20-4f2b-93d4-87b3be818d9a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:45.028099 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-324978e7-bd20-4f2b-93d4-87b3be818d9a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:45.035944 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-324978e7-bd20-4f2b-93d4-87b3be818d9a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.141321 Jan 11 15:34:45.036518 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 850/1952] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:44 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:46.053672 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9e32a7b4-6611-4540-aa99-350500932d82 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:46.054262 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9e32a7b4-6611-4540-aa99-350500932d82 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:46.060509 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9e32a7b4-6611-4540-aa99-350500932d82 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:46.060955 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9e32a7b4-6611-4540-aa99-350500932d82 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:46.061724 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9e32a7b4-6611-4540-aa99-350500932d82 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:46.062159 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9e32a7b4-6611-4540-aa99-350500932d82 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:46.186503 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-9e32a7b4-6611-4540-aa99-350500932d82 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:46.194189 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9e32a7b4-6611-4540-aa99-350500932d82 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.144165 Jan 11 15:34:46.200343 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1103/1953] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:46 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:47.215587 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-bf7601bc-ba87-4ddc-955c-a8586acfaa72 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:47.216232 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-bf7601bc-ba87-4ddc-955c-a8586acfaa72 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:47.222747 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bf7601bc-ba87-4ddc-955c-a8586acfaa72 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:47.223192 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bf7601bc-ba87-4ddc-955c-a8586acfaa72 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:47.224004 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bf7601bc-ba87-4ddc-955c-a8586acfaa72 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:47.224434 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bf7601bc-ba87-4ddc-955c-a8586acfaa72 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:47.352520 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-bf7601bc-ba87-4ddc-955c-a8586acfaa72 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:47.360108 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-bf7601bc-ba87-4ddc-955c-a8586acfaa72 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.148702 Jan 11 15:34:47.360668 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 851/1954] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:47 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:48.376508 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-504ab264-f4ab-49c6-aa93-396d9c051663 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:48.377122 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-504ab264-f4ab-49c6-aa93-396d9c051663 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:48.383391 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-504ab264-f4ab-49c6-aa93-396d9c051663 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:48.384525 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-504ab264-f4ab-49c6-aa93-396d9c051663 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:48.385298 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-504ab264-f4ab-49c6-aa93-396d9c051663 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:48.385738 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-504ab264-f4ab-49c6-aa93-396d9c051663 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:48.507688 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-504ab264-f4ab-49c6-aa93-396d9c051663 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:48.515921 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-504ab264-f4ab-49c6-aa93-396d9c051663 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.143030 Jan 11 15:34:48.516479 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1104/1955] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:48 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:49.532951 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e5d20a1f-418b-406d-8d1b-f42e2954c43c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:49.533573 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e5d20a1f-418b-406d-8d1b-f42e2954c43c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:49.540473 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e5d20a1f-418b-406d-8d1b-f42e2954c43c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:49.540959 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e5d20a1f-418b-406d-8d1b-f42e2954c43c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:49.541747 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e5d20a1f-418b-406d-8d1b-f42e2954c43c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:49.542188 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e5d20a1f-418b-406d-8d1b-f42e2954c43c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:49.683442 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-e5d20a1f-418b-406d-8d1b-f42e2954c43c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:49.691185 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e5d20a1f-418b-406d-8d1b-f42e2954c43c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.161948 Jan 11 15:34:49.691771 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 852/1956] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:49 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:50.708572 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9b495e34-0f5c-47bf-b8bb-3f9058432ae8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:50.709187 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9b495e34-0f5c-47bf-b8bb-3f9058432ae8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:50.716969 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9b495e34-0f5c-47bf-b8bb-3f9058432ae8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:50.717495 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9b495e34-0f5c-47bf-b8bb-3f9058432ae8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:50.718829 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9b495e34-0f5c-47bf-b8bb-3f9058432ae8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:50.719533 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9b495e34-0f5c-47bf-b8bb-3f9058432ae8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:50.845472 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-9b495e34-0f5c-47bf-b8bb-3f9058432ae8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:50.853331 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9b495e34-0f5c-47bf-b8bb-3f9058432ae8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.148435 Jan 11 15:34:50.853891 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1105/1957] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:50 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:51.870162 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-abb25b66-fade-4ec1-b1cc-8fc5ce88ce71 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:51.870784 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-abb25b66-fade-4ec1-b1cc-8fc5ce88ce71 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:51.877027 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-abb25b66-fade-4ec1-b1cc-8fc5ce88ce71 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:51.877484 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-abb25b66-fade-4ec1-b1cc-8fc5ce88ce71 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:51.878266 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-abb25b66-fade-4ec1-b1cc-8fc5ce88ce71 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:51.878707 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-abb25b66-fade-4ec1-b1cc-8fc5ce88ce71 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:52.009354 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-abb25b66-fade-4ec1-b1cc-8fc5ce88ce71 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:52.020392 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-abb25b66-fade-4ec1-b1cc-8fc5ce88ce71 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.153871 Jan 11 15:34:52.021089 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 853/1958] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:51 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:53.037791 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-17fd2101-128c-4db9-9d10-155303df9048 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:53.038494 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-17fd2101-128c-4db9-9d10-155303df9048 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:53.045150 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-17fd2101-128c-4db9-9d10-155303df9048 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:53.045606 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-17fd2101-128c-4db9-9d10-155303df9048 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:53.046391 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-17fd2101-128c-4db9-9d10-155303df9048 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:53.046834 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-17fd2101-128c-4db9-9d10-155303df9048 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:53.178821 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-17fd2101-128c-4db9-9d10-155303df9048 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:53.187493 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-17fd2101-128c-4db9-9d10-155303df9048 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.153450 Jan 11 15:34:53.188060 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1106/1959] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:53 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:54.204480 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-1020a66e-3424-4522-89e3-92dbaceacd3a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:54.205091 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-1020a66e-3424-4522-89e3-92dbaceacd3a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:54.210778 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1020a66e-3424-4522-89e3-92dbaceacd3a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:54.211237 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1020a66e-3424-4522-89e3-92dbaceacd3a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:54.212053 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1020a66e-3424-4522-89e3-92dbaceacd3a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:54.212496 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1020a66e-3424-4522-89e3-92dbaceacd3a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:54.362220 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-1020a66e-3424-4522-89e3-92dbaceacd3a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:54.371800 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-1020a66e-3424-4522-89e3-92dbaceacd3a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.171065 Jan 11 15:34:54.372571 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 854/1960] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:54 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:55.388621 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b9f14d50-58df-4e13-a025-69063c5fcc67 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:55.391421 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b9f14d50-58df-4e13-a025-69063c5fcc67 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:55.395688 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b9f14d50-58df-4e13-a025-69063c5fcc67 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:55.396147 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b9f14d50-58df-4e13-a025-69063c5fcc67 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:55.396930 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b9f14d50-58df-4e13-a025-69063c5fcc67 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:55.397402 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b9f14d50-58df-4e13-a025-69063c5fcc67 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:55.797901 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b9f14d50-58df-4e13-a025-69063c5fcc67 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:55.811650 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b9f14d50-58df-4e13-a025-69063c5fcc67 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.420820 Jan 11 15:34:55.811650 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1107/1961] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:55 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:56.823583 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2215b69b-53d7-43ef-a232-d15dbf39f6bf tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:56.824031 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2215b69b-53d7-43ef-a232-d15dbf39f6bf tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:56.829550 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2215b69b-53d7-43ef-a232-d15dbf39f6bf tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:56.830007 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2215b69b-53d7-43ef-a232-d15dbf39f6bf tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:56.830789 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2215b69b-53d7-43ef-a232-d15dbf39f6bf tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:56.831230 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2215b69b-53d7-43ef-a232-d15dbf39f6bf tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:56.972293 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-2215b69b-53d7-43ef-a232-d15dbf39f6bf tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:56.981343 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2215b69b-53d7-43ef-a232-d15dbf39f6bf tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.161871 Jan 11 15:34:56.981910 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 855/1962] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:56 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:57.998298 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1bb3c748-4432-4111-9260-0f8805e77e1e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:57.998914 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1bb3c748-4432-4111-9260-0f8805e77e1e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:58.005202 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1bb3c748-4432-4111-9260-0f8805e77e1e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:58.005656 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1bb3c748-4432-4111-9260-0f8805e77e1e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:58.006437 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1bb3c748-4432-4111-9260-0f8805e77e1e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:58.006878 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1bb3c748-4432-4111-9260-0f8805e77e1e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:58.144220 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1bb3c748-4432-4111-9260-0f8805e77e1e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:58.146763 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1bb3c748-4432-4111-9260-0f8805e77e1e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.152773 Jan 11 15:34:58.147351 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1108/1963] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:57 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:34:59.164126 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-55dea7d4-dfd5-43bc-8ec2-fec8a2630e5e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:34:59.164965 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-55dea7d4-dfd5-43bc-8ec2-fec8a2630e5e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:34:59.171667 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-55dea7d4-dfd5-43bc-8ec2-fec8a2630e5e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:59.172122 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-55dea7d4-dfd5-43bc-8ec2-fec8a2630e5e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:59.173517 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-55dea7d4-dfd5-43bc-8ec2-fec8a2630e5e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:34:59.173957 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-55dea7d4-dfd5-43bc-8ec2-fec8a2630e5e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:34:59.308732 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-55dea7d4-dfd5-43bc-8ec2-fec8a2630e5e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:34:59.316384 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-55dea7d4-dfd5-43bc-8ec2-fec8a2630e5e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.155928 Jan 11 15:34:59.320429 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 856/1964] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:34:59 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:00.333805 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-414f7c66-1bb6-4e2e-b837-ea1fe7a6d2e5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:00.334502 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-414f7c66-1bb6-4e2e-b837-ea1fe7a6d2e5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:00.340499 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-414f7c66-1bb6-4e2e-b837-ea1fe7a6d2e5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:00.340947 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-414f7c66-1bb6-4e2e-b837-ea1fe7a6d2e5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:00.341723 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-414f7c66-1bb6-4e2e-b837-ea1fe7a6d2e5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:00.342163 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-414f7c66-1bb6-4e2e-b837-ea1fe7a6d2e5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:00.476615 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-414f7c66-1bb6-4e2e-b837-ea1fe7a6d2e5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:00.484913 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-414f7c66-1bb6-4e2e-b837-ea1fe7a6d2e5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.154903 Jan 11 15:35:00.485472 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1109/1965] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:00 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:01.501515 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-babfdc1d-aab0-41d2-bd17-25b43982031b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:01.502123 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-babfdc1d-aab0-41d2-bd17-25b43982031b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:01.508403 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-babfdc1d-aab0-41d2-bd17-25b43982031b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:01.508853 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-babfdc1d-aab0-41d2-bd17-25b43982031b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:01.509632 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-babfdc1d-aab0-41d2-bd17-25b43982031b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:01.510069 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-babfdc1d-aab0-41d2-bd17-25b43982031b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:01.634197 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-babfdc1d-aab0-41d2-bd17-25b43982031b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:01.642014 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-babfdc1d-aab0-41d2-bd17-25b43982031b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.144137 Jan 11 15:35:01.643957 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 857/1966] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:01 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:02.659068 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5d892cba-cd79-4dae-8eb8-675a71db8efb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:02.659634 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5d892cba-cd79-4dae-8eb8-675a71db8efb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:02.665911 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5d892cba-cd79-4dae-8eb8-675a71db8efb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:02.666361 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5d892cba-cd79-4dae-8eb8-675a71db8efb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:02.667133 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5d892cba-cd79-4dae-8eb8-675a71db8efb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:02.667598 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5d892cba-cd79-4dae-8eb8-675a71db8efb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:02.795597 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-5d892cba-cd79-4dae-8eb8-675a71db8efb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:02.803764 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5d892cba-cd79-4dae-8eb8-675a71db8efb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.148481 Jan 11 15:35:02.805549 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1110/1967] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:02 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:03.820639 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c23f56a8-e8f7-4511-b354-a446267a3b4b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:03.821296 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c23f56a8-e8f7-4511-b354-a446267a3b4b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:03.827624 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c23f56a8-e8f7-4511-b354-a446267a3b4b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:03.828076 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c23f56a8-e8f7-4511-b354-a446267a3b4b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:03.828856 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c23f56a8-e8f7-4511-b354-a446267a3b4b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:03.829293 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c23f56a8-e8f7-4511-b354-a446267a3b4b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:03.956612 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-c23f56a8-e8f7-4511-b354-a446267a3b4b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:03.964924 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c23f56a8-e8f7-4511-b354-a446267a3b4b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.147959 Jan 11 15:35:03.965492 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 858/1968] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:03 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:04.982004 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-80040ec4-229d-4117-985b-6cf0eaacdd89 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:04.982617 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-80040ec4-229d-4117-985b-6cf0eaacdd89 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:04.988910 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-80040ec4-229d-4117-985b-6cf0eaacdd89 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:04.989363 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-80040ec4-229d-4117-985b-6cf0eaacdd89 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:04.990174 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-80040ec4-229d-4117-985b-6cf0eaacdd89 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:04.990617 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-80040ec4-229d-4117-985b-6cf0eaacdd89 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:05.138805 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-80040ec4-229d-4117-985b-6cf0eaacdd89 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:05.146571 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-80040ec4-229d-4117-985b-6cf0eaacdd89 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.168681 Jan 11 15:35:05.147061 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1111/1969] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:04 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:06.163776 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e9e2aa8b-c1ee-4081-9545-313fac991291 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:06.164467 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e9e2aa8b-c1ee-4081-9545-313fac991291 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:06.171248 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e9e2aa8b-c1ee-4081-9545-313fac991291 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:06.171736 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e9e2aa8b-c1ee-4081-9545-313fac991291 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:06.172777 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e9e2aa8b-c1ee-4081-9545-313fac991291 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:06.173219 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e9e2aa8b-c1ee-4081-9545-313fac991291 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:06.300225 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-e9e2aa8b-c1ee-4081-9545-313fac991291 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:06.308446 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e9e2aa8b-c1ee-4081-9545-313fac991291 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.148498 Jan 11 15:35:06.309007 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 859/1970] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:06 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:07.325007 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-12e56ce9-73ac-4603-929e-461a7e6268d2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:07.325620 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-12e56ce9-73ac-4603-929e-461a7e6268d2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:07.331936 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-12e56ce9-73ac-4603-929e-461a7e6268d2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:07.332393 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-12e56ce9-73ac-4603-929e-461a7e6268d2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:07.333166 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-12e56ce9-73ac-4603-929e-461a7e6268d2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:07.333609 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-12e56ce9-73ac-4603-929e-461a7e6268d2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:07.457961 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-12e56ce9-73ac-4603-929e-461a7e6268d2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:07.466197 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-12e56ce9-73ac-4603-929e-461a7e6268d2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.144843 Jan 11 15:35:07.466792 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1112/1971] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:07 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:08.483470 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f54f717e-b052-4acd-b208-885d58b3682d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:08.484083 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f54f717e-b052-4acd-b208-885d58b3682d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:08.490529 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f54f717e-b052-4acd-b208-885d58b3682d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:08.490986 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f54f717e-b052-4acd-b208-885d58b3682d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:08.491790 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f54f717e-b052-4acd-b208-885d58b3682d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:08.492255 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f54f717e-b052-4acd-b208-885d58b3682d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:08.621959 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-f54f717e-b052-4acd-b208-885d58b3682d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:08.629605 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f54f717e-b052-4acd-b208-885d58b3682d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.149844 Jan 11 15:35:08.630172 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 860/1972] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:08 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:09.646744 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ced633d9-aec9-452f-8131-74eb9a42c61a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:09.647242 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ced633d9-aec9-452f-8131-74eb9a42c61a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:09.653883 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ced633d9-aec9-452f-8131-74eb9a42c61a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:09.654341 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ced633d9-aec9-452f-8131-74eb9a42c61a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:09.659183 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ced633d9-aec9-452f-8131-74eb9a42c61a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:09.659183 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ced633d9-aec9-452f-8131-74eb9a42c61a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:09.784201 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ced633d9-aec9-452f-8131-74eb9a42c61a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:09.791875 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ced633d9-aec9-452f-8131-74eb9a42c61a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.149083 Jan 11 15:35:09.792443 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1113/1973] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:09 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:10.810517 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-dcf0adc0-c367-43ac-bfc4-853a9796d747 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:10.810517 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-dcf0adc0-c367-43ac-bfc4-853a9796d747 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:10.816989 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-dcf0adc0-c367-43ac-bfc4-853a9796d747 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:10.817443 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-dcf0adc0-c367-43ac-bfc4-853a9796d747 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:10.818219 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-dcf0adc0-c367-43ac-bfc4-853a9796d747 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:10.818660 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-dcf0adc0-c367-43ac-bfc4-853a9796d747 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:10.945632 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-dcf0adc0-c367-43ac-bfc4-853a9796d747 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:10.953335 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-dcf0adc0-c367-43ac-bfc4-853a9796d747 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.148002 Jan 11 15:35:10.953901 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 861/1974] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:10 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:11.970456 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2dacd628-e702-4549-a4f2-8a158e6cd176 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:11.971069 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2dacd628-e702-4549-a4f2-8a158e6cd176 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:11.977340 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2dacd628-e702-4549-a4f2-8a158e6cd176 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:11.978307 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2dacd628-e702-4549-a4f2-8a158e6cd176 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:11.979079 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2dacd628-e702-4549-a4f2-8a158e6cd176 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:11.979549 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2dacd628-e702-4549-a4f2-8a158e6cd176 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:12.102439 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-2dacd628-e702-4549-a4f2-8a158e6cd176 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:12.110571 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2dacd628-e702-4549-a4f2-8a158e6cd176 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.143741 Jan 11 15:35:12.111140 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1114/1975] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:11 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:13.127220 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b8069da5-56a4-4f43-8675-83c80d35a676 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:13.127888 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b8069da5-56a4-4f43-8675-83c80d35a676 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:13.134520 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b8069da5-56a4-4f43-8675-83c80d35a676 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:13.134974 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b8069da5-56a4-4f43-8675-83c80d35a676 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:13.135802 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b8069da5-56a4-4f43-8675-83c80d35a676 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:13.136401 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b8069da5-56a4-4f43-8675-83c80d35a676 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:13.267284 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-b8069da5-56a4-4f43-8675-83c80d35a676 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:13.275428 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b8069da5-56a4-4f43-8675-83c80d35a676 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.151637 Jan 11 15:35:13.275993 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 862/1976] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:13 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:14.292705 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1170ef71-ca2c-4153-9cdb-a88d1d3d85c7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:14.293309 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1170ef71-ca2c-4153-9cdb-a88d1d3d85c7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:14.299842 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1170ef71-ca2c-4153-9cdb-a88d1d3d85c7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:14.300292 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1170ef71-ca2c-4153-9cdb-a88d1d3d85c7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:14.301062 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1170ef71-ca2c-4153-9cdb-a88d1d3d85c7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:14.301498 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1170ef71-ca2c-4153-9cdb-a88d1d3d85c7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:14.430500 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1170ef71-ca2c-4153-9cdb-a88d1d3d85c7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:14.438671 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1170ef71-ca2c-4153-9cdb-a88d1d3d85c7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.150231 Jan 11 15:35:14.439232 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1115/1977] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:14 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:15.455416 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-724eaa33-9f18-4736-acb8-a40889c842a6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:15.456028 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-724eaa33-9f18-4736-acb8-a40889c842a6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:15.462739 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-724eaa33-9f18-4736-acb8-a40889c842a6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:15.463125 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-724eaa33-9f18-4736-acb8-a40889c842a6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:15.463912 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-724eaa33-9f18-4736-acb8-a40889c842a6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:15.464346 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-724eaa33-9f18-4736-acb8-a40889c842a6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:15.587823 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-724eaa33-9f18-4736-acb8-a40889c842a6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:15.595450 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-724eaa33-9f18-4736-acb8-a40889c842a6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.143723 Jan 11 15:35:15.596006 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 863/1978] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:15 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:16.612639 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3a6b3b1d-d015-4190-8f01-f8704612a738 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:16.613192 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3a6b3b1d-d015-4190-8f01-f8704612a738 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:16.619519 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3a6b3b1d-d015-4190-8f01-f8704612a738 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:16.619978 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3a6b3b1d-d015-4190-8f01-f8704612a738 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:16.620758 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3a6b3b1d-d015-4190-8f01-f8704612a738 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:16.621199 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3a6b3b1d-d015-4190-8f01-f8704612a738 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:16.755641 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3a6b3b1d-d015-4190-8f01-f8704612a738 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:16.764144 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3a6b3b1d-d015-4190-8f01-f8704612a738 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.155145 Jan 11 15:35:16.764707 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1116/1979] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:16 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:17.780861 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f262694b-fcff-4f3a-bd07-4d20323a3794 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:17.781478 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f262694b-fcff-4f3a-bd07-4d20323a3794 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:17.787659 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f262694b-fcff-4f3a-bd07-4d20323a3794 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:17.788116 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f262694b-fcff-4f3a-bd07-4d20323a3794 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:17.789251 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f262694b-fcff-4f3a-bd07-4d20323a3794 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:17.789692 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f262694b-fcff-4f3a-bd07-4d20323a3794 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:17.917612 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-f262694b-fcff-4f3a-bd07-4d20323a3794 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:17.925601 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f262694b-fcff-4f3a-bd07-4d20323a3794 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.148313 Jan 11 15:35:17.926156 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 864/1980] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:17 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:18.941590 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c913d1ca-4eea-42bf-8686-b111a7d844e5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:18.942285 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c913d1ca-4eea-42bf-8686-b111a7d844e5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:18.949154 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c913d1ca-4eea-42bf-8686-b111a7d844e5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:18.949606 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c913d1ca-4eea-42bf-8686-b111a7d844e5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:18.950379 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c913d1ca-4eea-42bf-8686-b111a7d844e5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:18.950813 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c913d1ca-4eea-42bf-8686-b111a7d844e5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:19.079770 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c913d1ca-4eea-42bf-8686-b111a7d844e5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:19.087649 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c913d1ca-4eea-42bf-8686-b111a7d844e5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.149613 Jan 11 15:35:19.088161 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1117/1981] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:18 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:20.105533 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f9767fcf-af2e-4bac-8f72-0919a4835fa5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:20.106116 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f9767fcf-af2e-4bac-8f72-0919a4835fa5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:20.112294 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f9767fcf-af2e-4bac-8f72-0919a4835fa5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:20.112747 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f9767fcf-af2e-4bac-8f72-0919a4835fa5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:20.113536 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f9767fcf-af2e-4bac-8f72-0919a4835fa5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:20.113976 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f9767fcf-af2e-4bac-8f72-0919a4835fa5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:20.307209 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-f9767fcf-af2e-4bac-8f72-0919a4835fa5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:20.314852 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f9767fcf-af2e-4bac-8f72-0919a4835fa5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.213730 Jan 11 15:35:20.315447 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 865/1982] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:20 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:21.333190 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e4e987ff-519d-47e7-9bc0-6c5dd312950e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:21.333825 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e4e987ff-519d-47e7-9bc0-6c5dd312950e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:21.340713 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e4e987ff-519d-47e7-9bc0-6c5dd312950e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:21.341163 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e4e987ff-519d-47e7-9bc0-6c5dd312950e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:21.341927 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e4e987ff-519d-47e7-9bc0-6c5dd312950e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:21.342362 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e4e987ff-519d-47e7-9bc0-6c5dd312950e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:21.469418 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e4e987ff-519d-47e7-9bc0-6c5dd312950e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:21.477189 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e4e987ff-519d-47e7-9bc0-6c5dd312950e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.147652 Jan 11 15:35:21.478306 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1118/1983] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:21 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:22.495191 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3f250a15-6a0d-4a99-9e42-a894d1502154 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:22.495761 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3f250a15-6a0d-4a99-9e42-a894d1502154 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:22.501990 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3f250a15-6a0d-4a99-9e42-a894d1502154 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:22.502443 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3f250a15-6a0d-4a99-9e42-a894d1502154 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:22.503219 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3f250a15-6a0d-4a99-9e42-a894d1502154 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:22.503681 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3f250a15-6a0d-4a99-9e42-a894d1502154 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:22.627954 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-3f250a15-6a0d-4a99-9e42-a894d1502154 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:22.635501 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3f250a15-6a0d-4a99-9e42-a894d1502154 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.144577 Jan 11 15:35:22.636064 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 866/1984] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:22 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:23.651639 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f89a4111-aee2-4746-8aa7-5a9abcb4ea1d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:23.652246 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f89a4111-aee2-4746-8aa7-5a9abcb4ea1d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:23.657993 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f89a4111-aee2-4746-8aa7-5a9abcb4ea1d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:23.658442 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f89a4111-aee2-4746-8aa7-5a9abcb4ea1d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:23.659217 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f89a4111-aee2-4746-8aa7-5a9abcb4ea1d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:23.659683 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f89a4111-aee2-4746-8aa7-5a9abcb4ea1d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:23.791278 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f89a4111-aee2-4746-8aa7-5a9abcb4ea1d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:23.799703 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f89a4111-aee2-4746-8aa7-5a9abcb4ea1d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.151927 Jan 11 15:35:23.800260 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1119/1985] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:23 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:24.817021 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-69f0a3b8-01b8-440e-8cb2-fa5e2073d92b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:24.817656 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-69f0a3b8-01b8-440e-8cb2-fa5e2073d92b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:24.824090 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-69f0a3b8-01b8-440e-8cb2-fa5e2073d92b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:24.824550 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-69f0a3b8-01b8-440e-8cb2-fa5e2073d92b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:24.825425 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-69f0a3b8-01b8-440e-8cb2-fa5e2073d92b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:24.825948 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-69f0a3b8-01b8-440e-8cb2-fa5e2073d92b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:24.954609 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-69f0a3b8-01b8-440e-8cb2-fa5e2073d92b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:24.962799 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-69f0a3b8-01b8-440e-8cb2-fa5e2073d92b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.149492 Jan 11 15:35:24.963368 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 867/1986] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:24 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:25.980048 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3c91e901-670f-4af4-a427-67494ca65570 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:25.980701 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3c91e901-670f-4af4-a427-67494ca65570 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:25.986868 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c91e901-670f-4af4-a427-67494ca65570 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:25.987346 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c91e901-670f-4af4-a427-67494ca65570 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:25.988124 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c91e901-670f-4af4-a427-67494ca65570 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:25.988568 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3c91e901-670f-4af4-a427-67494ca65570 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:26.112384 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3c91e901-670f-4af4-a427-67494ca65570 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:26.120123 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3c91e901-670f-4af4-a427-67494ca65570 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.144197 Jan 11 15:35:26.120690 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1120/1987] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:25 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:27.137068 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4c8fba25-e302-40bf-975b-31e1ee544c12 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:27.137609 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4c8fba25-e302-40bf-975b-31e1ee544c12 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:27.144157 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4c8fba25-e302-40bf-975b-31e1ee544c12 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:27.144674 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4c8fba25-e302-40bf-975b-31e1ee544c12 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:27.145451 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4c8fba25-e302-40bf-975b-31e1ee544c12 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:27.145889 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4c8fba25-e302-40bf-975b-31e1ee544c12 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:27.281770 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-4c8fba25-e302-40bf-975b-31e1ee544c12 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:27.289807 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4c8fba25-e302-40bf-975b-31e1ee544c12 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.156502 Jan 11 15:35:27.290371 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 868/1988] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:27 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:28.308041 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8e17c329-48eb-4c3e-9e27-04095a9ebf5f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:28.308655 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8e17c329-48eb-4c3e-9e27-04095a9ebf5f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:28.314883 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8e17c329-48eb-4c3e-9e27-04095a9ebf5f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:28.315370 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8e17c329-48eb-4c3e-9e27-04095a9ebf5f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:28.316149 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8e17c329-48eb-4c3e-9e27-04095a9ebf5f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:28.316588 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8e17c329-48eb-4c3e-9e27-04095a9ebf5f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:28.444315 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-8e17c329-48eb-4c3e-9e27-04095a9ebf5f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:28.451982 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8e17c329-48eb-4c3e-9e27-04095a9ebf5f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.148268 Jan 11 15:35:28.461480 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1121/1989] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:28 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:29.468627 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3cb4b7fb-af86-4e01-b582-91a1d274fa81 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:29.469249 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3cb4b7fb-af86-4e01-b582-91a1d274fa81 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:29.475571 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3cb4b7fb-af86-4e01-b582-91a1d274fa81 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:29.476028 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3cb4b7fb-af86-4e01-b582-91a1d274fa81 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:29.476825 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3cb4b7fb-af86-4e01-b582-91a1d274fa81 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:29.477271 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3cb4b7fb-af86-4e01-b582-91a1d274fa81 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:29.606659 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-3cb4b7fb-af86-4e01-b582-91a1d274fa81 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:29.616168 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3cb4b7fb-af86-4e01-b582-91a1d274fa81 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.151120 Jan 11 15:35:29.616884 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 869/1990] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:29 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:30.633008 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-fd3221c7-ec75-4c9d-b53f-001dbf779e1c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:30.633654 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-fd3221c7-ec75-4c9d-b53f-001dbf779e1c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:30.639889 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fd3221c7-ec75-4c9d-b53f-001dbf779e1c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:30.640338 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fd3221c7-ec75-4c9d-b53f-001dbf779e1c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:30.641114 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fd3221c7-ec75-4c9d-b53f-001dbf779e1c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:30.641555 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fd3221c7-ec75-4c9d-b53f-001dbf779e1c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:30.771729 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-fd3221c7-ec75-4c9d-b53f-001dbf779e1c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:30.782102 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-fd3221c7-ec75-4c9d-b53f-001dbf779e1c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.152488 Jan 11 15:35:30.782632 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1122/1991] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:30 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:31.799376 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d7dc0466-6cf1-4220-bf92-1ec4e9abcdd2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:31.800129 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d7dc0466-6cf1-4220-bf92-1ec4e9abcdd2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:31.806301 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d7dc0466-6cf1-4220-bf92-1ec4e9abcdd2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:31.806746 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d7dc0466-6cf1-4220-bf92-1ec4e9abcdd2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:31.807622 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d7dc0466-6cf1-4220-bf92-1ec4e9abcdd2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:31.808057 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d7dc0466-6cf1-4220-bf92-1ec4e9abcdd2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:31.934981 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-d7dc0466-6cf1-4220-bf92-1ec4e9abcdd2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:31.942867 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d7dc0466-6cf1-4220-bf92-1ec4e9abcdd2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.147348 Jan 11 15:35:31.943460 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 870/1992] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:31 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:32.958938 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-94fdd487-6893-446a-800f-eb7c2912325a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:32.959490 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-94fdd487-6893-446a-800f-eb7c2912325a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:32.966349 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-94fdd487-6893-446a-800f-eb7c2912325a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:32.966798 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-94fdd487-6893-446a-800f-eb7c2912325a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:32.967602 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-94fdd487-6893-446a-800f-eb7c2912325a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:32.968046 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-94fdd487-6893-446a-800f-eb7c2912325a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:33.094619 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-94fdd487-6893-446a-800f-eb7c2912325a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:33.102342 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-94fdd487-6893-446a-800f-eb7c2912325a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.147107 Jan 11 15:35:33.102907 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1123/1993] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:32 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:34.119577 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-72fce1ed-2ca9-48e4-92c5-8384e0ec1909 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:34.120229 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-72fce1ed-2ca9-48e4-92c5-8384e0ec1909 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:34.126470 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-72fce1ed-2ca9-48e4-92c5-8384e0ec1909 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:34.126916 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-72fce1ed-2ca9-48e4-92c5-8384e0ec1909 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:34.127719 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-72fce1ed-2ca9-48e4-92c5-8384e0ec1909 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:34.128158 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-72fce1ed-2ca9-48e4-92c5-8384e0ec1909 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:34.256735 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-72fce1ed-2ca9-48e4-92c5-8384e0ec1909 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:34.265430 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-72fce1ed-2ca9-48e4-92c5-8384e0ec1909 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.150068 Jan 11 15:35:34.265987 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 871/1994] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:34 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:35.281686 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-15a62ee1-dbf7-475b-8514-f604287a5a82 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:35.282358 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-15a62ee1-dbf7-475b-8514-f604287a5a82 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:35.288580 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-15a62ee1-dbf7-475b-8514-f604287a5a82 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:35.289024 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-15a62ee1-dbf7-475b-8514-f604287a5a82 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:35.289794 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-15a62ee1-dbf7-475b-8514-f604287a5a82 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:35.290232 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-15a62ee1-dbf7-475b-8514-f604287a5a82 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:35.417544 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-15a62ee1-dbf7-475b-8514-f604287a5a82 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:35.425509 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-15a62ee1-dbf7-475b-8514-f604287a5a82 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.147482 Jan 11 15:35:35.426082 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1124/1995] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:35 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:36.442140 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-011083e1-ee5a-4bc1-bba9-04ff93d4aee1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:36.442786 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-011083e1-ee5a-4bc1-bba9-04ff93d4aee1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:36.450091 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-011083e1-ee5a-4bc1-bba9-04ff93d4aee1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:36.450546 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-011083e1-ee5a-4bc1-bba9-04ff93d4aee1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:36.451348 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-011083e1-ee5a-4bc1-bba9-04ff93d4aee1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:36.451794 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-011083e1-ee5a-4bc1-bba9-04ff93d4aee1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:36.574922 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-011083e1-ee5a-4bc1-bba9-04ff93d4aee1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:36.582642 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-011083e1-ee5a-4bc1-bba9-04ff93d4aee1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.144192 Jan 11 15:35:36.583207 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 872/1996] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:36 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:37.601188 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c42d40a1-4b53-4350-a868-7db6cf6a8dfb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:37.601713 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c42d40a1-4b53-4350-a868-7db6cf6a8dfb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:37.608552 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c42d40a1-4b53-4350-a868-7db6cf6a8dfb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:37.609003 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c42d40a1-4b53-4350-a868-7db6cf6a8dfb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:37.609779 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c42d40a1-4b53-4350-a868-7db6cf6a8dfb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:37.610217 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c42d40a1-4b53-4350-a868-7db6cf6a8dfb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:37.734679 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c42d40a1-4b53-4350-a868-7db6cf6a8dfb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:37.742298 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c42d40a1-4b53-4350-a868-7db6cf6a8dfb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.144921 Jan 11 15:35:37.742862 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1125/1997] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:37 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:38.759930 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3b895a32-d5c0-465a-af45-f2c17dcae984 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:38.760546 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3b895a32-d5c0-465a-af45-f2c17dcae984 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:38.766778 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3b895a32-d5c0-465a-af45-f2c17dcae984 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:38.767228 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3b895a32-d5c0-465a-af45-f2c17dcae984 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:38.768033 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3b895a32-d5c0-465a-af45-f2c17dcae984 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:38.768473 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3b895a32-d5c0-465a-af45-f2c17dcae984 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:38.902926 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-3b895a32-d5c0-465a-af45-f2c17dcae984 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:38.916489 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3b895a32-d5c0-465a-af45-f2c17dcae984 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.160135 Jan 11 15:35:38.917057 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 873/1998] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:38 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:39.933058 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-cea6aa16-0d73-472e-b083-6995d149bca1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:39.933595 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-cea6aa16-0d73-472e-b083-6995d149bca1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:39.939893 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cea6aa16-0d73-472e-b083-6995d149bca1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:39.940344 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cea6aa16-0d73-472e-b083-6995d149bca1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:39.941114 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cea6aa16-0d73-472e-b083-6995d149bca1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:39.941551 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cea6aa16-0d73-472e-b083-6995d149bca1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:40.066079 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-cea6aa16-0d73-472e-b083-6995d149bca1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:40.074285 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-cea6aa16-0d73-472e-b083-6995d149bca1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.144982 Jan 11 15:35:40.074844 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1126/1999] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:39 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:41.091483 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-80982a6f-1635-4721-9617-16079263bce0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:41.092203 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-80982a6f-1635-4721-9617-16079263bce0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:41.098420 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-80982a6f-1635-4721-9617-16079263bce0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:41.098872 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-80982a6f-1635-4721-9617-16079263bce0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:41.099684 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-80982a6f-1635-4721-9617-16079263bce0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:41.100124 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-80982a6f-1635-4721-9617-16079263bce0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:41.230877 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-80982a6f-1635-4721-9617-16079263bce0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:41.239331 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-80982a6f-1635-4721-9617-16079263bce0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.151361 Jan 11 15:35:41.245949 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 874/2000] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:41 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:42.255843 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ebb47bdc-9444-4bf6-b0dc-b53c5943cb9a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:42.256454 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ebb47bdc-9444-4bf6-b0dc-b53c5943cb9a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:42.263631 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ebb47bdc-9444-4bf6-b0dc-b53c5943cb9a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:42.264230 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ebb47bdc-9444-4bf6-b0dc-b53c5943cb9a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:42.273856 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ebb47bdc-9444-4bf6-b0dc-b53c5943cb9a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:42.273856 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ebb47bdc-9444-4bf6-b0dc-b53c5943cb9a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:42.393683 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ebb47bdc-9444-4bf6-b0dc-b53c5943cb9a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:42.401885 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ebb47bdc-9444-4bf6-b0dc-b53c5943cb9a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.149667 Jan 11 15:35:42.402449 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1127/2001] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:42 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:43.418063 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-61975de3-cc31-4a0d-b006-72d13f527835 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:43.418754 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-61975de3-cc31-4a0d-b006-72d13f527835 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:43.425338 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-61975de3-cc31-4a0d-b006-72d13f527835 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:43.425878 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-61975de3-cc31-4a0d-b006-72d13f527835 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:43.426721 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-61975de3-cc31-4a0d-b006-72d13f527835 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:43.427229 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-61975de3-cc31-4a0d-b006-72d13f527835 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:43.554941 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-61975de3-cc31-4a0d-b006-72d13f527835 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:43.563366 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-61975de3-cc31-4a0d-b006-72d13f527835 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.149368 Jan 11 15:35:43.563945 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 875/2002] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:43 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:44.580515 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-aeab253c-ffaf-4367-b6ad-4eca791a6dc6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:44.581104 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-aeab253c-ffaf-4367-b6ad-4eca791a6dc6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:44.587816 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aeab253c-ffaf-4367-b6ad-4eca791a6dc6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:44.588261 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aeab253c-ffaf-4367-b6ad-4eca791a6dc6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:44.589028 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aeab253c-ffaf-4367-b6ad-4eca791a6dc6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:44.589462 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aeab253c-ffaf-4367-b6ad-4eca791a6dc6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:44.719434 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-aeab253c-ffaf-4367-b6ad-4eca791a6dc6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:44.727130 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-aeab253c-ffaf-4367-b6ad-4eca791a6dc6 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.150368 Jan 11 15:35:44.728333 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1128/2003] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:44 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:45.744802 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-0ca544c4-e9e6-448f-8f21-65bfe22f8730 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:45.745442 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-0ca544c4-e9e6-448f-8f21-65bfe22f8730 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:45.751612 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0ca544c4-e9e6-448f-8f21-65bfe22f8730 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:45.752057 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0ca544c4-e9e6-448f-8f21-65bfe22f8730 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:45.752822 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0ca544c4-e9e6-448f-8f21-65bfe22f8730 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:45.753256 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0ca544c4-e9e6-448f-8f21-65bfe22f8730 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:45.879241 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-0ca544c4-e9e6-448f-8f21-65bfe22f8730 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:45.886940 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-0ca544c4-e9e6-448f-8f21-65bfe22f8730 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1560 microversion: 2.1 time: 0.146280 Jan 11 15:35:45.887535 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 876/2004] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:45 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:46.690460 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-f404d4d7-0c2f-4aed-9bef-9532b86e45c9 req-e631a9d9-5393-4f02-b05b-be6b63fbd992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92cb3dbf-b655-497a-9d23-6036c8b622f6", "name": "network-vif-deleted", "tag": "8ee4bfe2-ea98-4f3d-aa81-10433dea4b21"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:35:46.692045 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:35:46.692045 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:35:46.698727 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-f404d4d7-0c2f-4aed-9bef-9532b86e45c9 req-e631a9d9-5393-4f02-b05b-be6b63fbd992 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:46.700023 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-f404d4d7-0c2f-4aed-9bef-9532b86e45c9 req-e631a9d9-5393-4f02-b05b-be6b63fbd992 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:46.709895 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-f404d4d7-0c2f-4aed-9bef-9532b86e45c9 req-e631a9d9-5393-4f02-b05b-be6b63fbd992 service nova] Creating event network-vif-deleted:8ee4bfe2-ea98-4f3d-aa81-10433dea4b21 for instance 92cb3dbf-b655-497a-9d23-6036c8b622f6 on hv-cinder-82418 Jan 11 15:35:46.715870 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [req-f404d4d7-0c2f-4aed-9bef-9532b86e45c9 req-e631a9d9-5393-4f02-b05b-be6b63fbd992 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144097 Jan 11 15:35:46.716451 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1129/2005] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:35:46.904049 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c145fbf6-c7d1-4509-841a-38f501f11a1c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:46.904665 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c145fbf6-c7d1-4509-841a-38f501f11a1c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:46.910954 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c145fbf6-c7d1-4509-841a-38f501f11a1c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:46.911453 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c145fbf6-c7d1-4509-841a-38f501f11a1c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:46.912242 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c145fbf6-c7d1-4509-841a-38f501f11a1c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:46.912684 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c145fbf6-c7d1-4509-841a-38f501f11a1c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:46.975540 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-c145fbf6-c7d1-4509-841a-38f501f11a1c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:46.983952 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c145fbf6-c7d1-4509-841a-38f501f11a1c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.083544 Jan 11 15:35:46.984513 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 877/2006] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:46 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:48.001705 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-cc4ccc20-7df0-4ff8-906d-7bed8277a103 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:48.002414 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-cc4ccc20-7df0-4ff8-906d-7bed8277a103 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:48.008810 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cc4ccc20-7df0-4ff8-906d-7bed8277a103 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:48.009258 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cc4ccc20-7df0-4ff8-906d-7bed8277a103 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:48.010025 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cc4ccc20-7df0-4ff8-906d-7bed8277a103 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:48.010458 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cc4ccc20-7df0-4ff8-906d-7bed8277a103 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:48.068593 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-cc4ccc20-7df0-4ff8-906d-7bed8277a103 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:48.076135 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-cc4ccc20-7df0-4ff8-906d-7bed8277a103 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.079068 Jan 11 15:35:48.076699 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1130/2007] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:47 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:49.093248 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-077aa855-9a3e-460f-9f42-3626883fb7f4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:49.093780 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-077aa855-9a3e-460f-9f42-3626883fb7f4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:49.100025 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-077aa855-9a3e-460f-9f42-3626883fb7f4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:49.100476 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-077aa855-9a3e-460f-9f42-3626883fb7f4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:49.101253 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-077aa855-9a3e-460f-9f42-3626883fb7f4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:49.101720 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-077aa855-9a3e-460f-9f42-3626883fb7f4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:49.157964 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-077aa855-9a3e-460f-9f42-3626883fb7f4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:49.166157 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-077aa855-9a3e-460f-9f42-3626883fb7f4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.076634 Jan 11 15:35:49.166718 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 878/2008] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:49 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:50.183836 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-330575ef-84d1-492c-8e7c-4592c332bf4f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:50.184444 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-330575ef-84d1-492c-8e7c-4592c332bf4f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:50.190391 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-330575ef-84d1-492c-8e7c-4592c332bf4f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:50.190835 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-330575ef-84d1-492c-8e7c-4592c332bf4f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:50.191632 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-330575ef-84d1-492c-8e7c-4592c332bf4f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:50.192068 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-330575ef-84d1-492c-8e7c-4592c332bf4f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:50.252918 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-330575ef-84d1-492c-8e7c-4592c332bf4f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:50.261008 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-330575ef-84d1-492c-8e7c-4592c332bf4f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.081569 Jan 11 15:35:50.261575 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1131/2009] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:50 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:51.278027 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7150cbbf-e20c-4cc7-8d04-5f670dbdb7f9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:51.278640 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7150cbbf-e20c-4cc7-8d04-5f670dbdb7f9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:51.284868 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7150cbbf-e20c-4cc7-8d04-5f670dbdb7f9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:51.285318 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7150cbbf-e20c-4cc7-8d04-5f670dbdb7f9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:51.286093 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7150cbbf-e20c-4cc7-8d04-5f670dbdb7f9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:51.286543 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7150cbbf-e20c-4cc7-8d04-5f670dbdb7f9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:51.343351 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-7150cbbf-e20c-4cc7-8d04-5f670dbdb7f9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:51.350890 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7150cbbf-e20c-4cc7-8d04-5f670dbdb7f9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.077033 Jan 11 15:35:51.351481 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 879/2010] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:51 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:52.368314 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1ae2e33b-3f85-4551-ab93-e2cad46c09bc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:52.368924 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1ae2e33b-3f85-4551-ab93-e2cad46c09bc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:52.374867 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1ae2e33b-3f85-4551-ab93-e2cad46c09bc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:52.375334 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1ae2e33b-3f85-4551-ab93-e2cad46c09bc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:52.376105 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1ae2e33b-3f85-4551-ab93-e2cad46c09bc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:52.376539 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1ae2e33b-3f85-4551-ab93-e2cad46c09bc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:52.432931 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1ae2e33b-3f85-4551-ab93-e2cad46c09bc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:52.440669 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1ae2e33b-3f85-4551-ab93-e2cad46c09bc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.076136 Jan 11 15:35:52.441264 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1132/2011] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:52 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:35:53.457562 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-95e091e0-b11f-41cb-9d4d-1e13243785ab tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:53.458197 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-95e091e0-b11f-41cb-9d4d-1e13243785ab tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:53.464123 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-95e091e0-b11f-41cb-9d4d-1e13243785ab tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:53.464570 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-95e091e0-b11f-41cb-9d4d-1e13243785ab tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:53.465339 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-95e091e0-b11f-41cb-9d4d-1e13243785ab tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:53.465773 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-95e091e0-b11f-41cb-9d4d-1e13243785ab tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:53.522256 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-95e091e0-b11f-41cb-9d4d-1e13243785ab tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:53.530239 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-95e091e0-b11f-41cb-9d4d-1e13243785ab tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.076485 Jan 11 15:35:53.530794 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 880/2012] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:53 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:54.547807 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f01f0223-a689-43b6-acd5-13c66b383e63 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:54.548478 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f01f0223-a689-43b6-acd5-13c66b383e63 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:54.554786 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f01f0223-a689-43b6-acd5-13c66b383e63 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:54.555760 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f01f0223-a689-43b6-acd5-13c66b383e63 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:54.556539 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f01f0223-a689-43b6-acd5-13c66b383e63 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:54.556961 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f01f0223-a689-43b6-acd5-13c66b383e63 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:54.613601 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f01f0223-a689-43b6-acd5-13c66b383e63 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:54.621742 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f01f0223-a689-43b6-acd5-13c66b383e63 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.078039 Jan 11 15:35:54.622309 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1133/2013] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:54 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:55.639063 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-9d7c9a88-8563-4a33-802b-b5140fdbd263 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:55.639701 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-9d7c9a88-8563-4a33-802b-b5140fdbd263 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:55.645994 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9d7c9a88-8563-4a33-802b-b5140fdbd263 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:55.646432 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9d7c9a88-8563-4a33-802b-b5140fdbd263 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:55.647208 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9d7c9a88-8563-4a33-802b-b5140fdbd263 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:55.647751 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9d7c9a88-8563-4a33-802b-b5140fdbd263 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:55.705122 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-9d7c9a88-8563-4a33-802b-b5140fdbd263 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:55.713336 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-9d7c9a88-8563-4a33-802b-b5140fdbd263 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.077928 Jan 11 15:35:55.713895 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 881/2014] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:55 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:56.730487 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1f2edf28-7d3a-40bf-968e-454a574e8a93 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:56.731100 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1f2edf28-7d3a-40bf-968e-454a574e8a93 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:56.737380 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1f2edf28-7d3a-40bf-968e-454a574e8a93 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:56.737824 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1f2edf28-7d3a-40bf-968e-454a574e8a93 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:56.738592 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1f2edf28-7d3a-40bf-968e-454a574e8a93 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:56.739026 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1f2edf28-7d3a-40bf-968e-454a574e8a93 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:56.798979 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1f2edf28-7d3a-40bf-968e-454a574e8a93 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:56.806662 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1f2edf28-7d3a-40bf-968e-454a574e8a93 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.080429 Jan 11 15:35:56.807224 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1134/2015] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:56 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:57.823746 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-9bfa7d7f-6b31-4efc-919c-51c63c86d4c8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:57.824366 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-9bfa7d7f-6b31-4efc-919c-51c63c86d4c8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:57.830587 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9bfa7d7f-6b31-4efc-919c-51c63c86d4c8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:57.831046 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9bfa7d7f-6b31-4efc-919c-51c63c86d4c8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:57.831868 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9bfa7d7f-6b31-4efc-919c-51c63c86d4c8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:57.832315 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9bfa7d7f-6b31-4efc-919c-51c63c86d4c8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:57.889899 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-9bfa7d7f-6b31-4efc-919c-51c63c86d4c8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:57.897471 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-9bfa7d7f-6b31-4efc-919c-51c63c86d4c8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.077356 Jan 11 15:35:57.898035 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 882/2016] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:57 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:35:58.913243 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d51a4ac1-9868-45ee-80ae-210d2645d75a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:35:58.913867 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d51a4ac1-9868-45ee-80ae-210d2645d75a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:35:58.920801 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d51a4ac1-9868-45ee-80ae-210d2645d75a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:58.921249 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d51a4ac1-9868-45ee-80ae-210d2645d75a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:58.922024 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d51a4ac1-9868-45ee-80ae-210d2645d75a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:35:58.922459 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d51a4ac1-9868-45ee-80ae-210d2645d75a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:35:58.982476 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d51a4ac1-9868-45ee-80ae-210d2645d75a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:35:58.990287 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d51a4ac1-9868-45ee-80ae-210d2645d75a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.080770 Jan 11 15:35:58.990852 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1135/2017] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:35:58 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:00.007440 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-16997607-3d97-40ff-9b53-1854e7a2c7e4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:00.008612 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-16997607-3d97-40ff-9b53-1854e7a2c7e4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:00.014740 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-16997607-3d97-40ff-9b53-1854e7a2c7e4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:00.015190 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-16997607-3d97-40ff-9b53-1854e7a2c7e4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:00.016001 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-16997607-3d97-40ff-9b53-1854e7a2c7e4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:00.016444 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-16997607-3d97-40ff-9b53-1854e7a2c7e4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:00.073117 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-16997607-3d97-40ff-9b53-1854e7a2c7e4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:00.080861 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-16997607-3d97-40ff-9b53-1854e7a2c7e4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.077268 Jan 11 15:36:00.081439 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 883/2018] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:00 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:01.097621 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3f4ee173-ead3-4418-bcc5-f22cae01c62a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:01.098230 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3f4ee173-ead3-4418-bcc5-f22cae01c62a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:01.105019 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3f4ee173-ead3-4418-bcc5-f22cae01c62a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:01.105464 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3f4ee173-ead3-4418-bcc5-f22cae01c62a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:01.106259 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3f4ee173-ead3-4418-bcc5-f22cae01c62a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:01.106696 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3f4ee173-ead3-4418-bcc5-f22cae01c62a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:01.163405 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3f4ee173-ead3-4418-bcc5-f22cae01c62a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:01.172795 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3f4ee173-ead3-4418-bcc5-f22cae01c62a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.078375 Jan 11 15:36:01.173884 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1136/2019] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:01 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:02.191403 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-8f300405-7617-4e39-8bea-09c3e4a29cbd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:02.192012 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-8f300405-7617-4e39-8bea-09c3e4a29cbd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:02.198264 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8f300405-7617-4e39-8bea-09c3e4a29cbd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:02.198714 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8f300405-7617-4e39-8bea-09c3e4a29cbd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:02.199524 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8f300405-7617-4e39-8bea-09c3e4a29cbd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:02.199964 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8f300405-7617-4e39-8bea-09c3e4a29cbd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:02.257426 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-8f300405-7617-4e39-8bea-09c3e4a29cbd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:02.265365 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-8f300405-7617-4e39-8bea-09c3e4a29cbd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.077537 Jan 11 15:36:02.265921 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 884/2020] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:02 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:03.281935 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-67c3c8bf-b42b-4f97-8fab-51f6bdf8d1e2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:03.282555 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-67c3c8bf-b42b-4f97-8fab-51f6bdf8d1e2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:03.288836 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-67c3c8bf-b42b-4f97-8fab-51f6bdf8d1e2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:03.289852 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-67c3c8bf-b42b-4f97-8fab-51f6bdf8d1e2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:03.290632 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-67c3c8bf-b42b-4f97-8fab-51f6bdf8d1e2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:03.291076 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-67c3c8bf-b42b-4f97-8fab-51f6bdf8d1e2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:03.350461 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-67c3c8bf-b42b-4f97-8fab-51f6bdf8d1e2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:03.358791 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-67c3c8bf-b42b-4f97-8fab-51f6bdf8d1e2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.080544 Jan 11 15:36:03.359384 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1137/2021] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:03 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:04.375093 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d8aac198-deee-4764-bcd3-7080d66b51e5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:04.375747 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d8aac198-deee-4764-bcd3-7080d66b51e5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:04.381942 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d8aac198-deee-4764-bcd3-7080d66b51e5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:04.382410 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d8aac198-deee-4764-bcd3-7080d66b51e5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:04.383846 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d8aac198-deee-4764-bcd3-7080d66b51e5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:04.384289 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d8aac198-deee-4764-bcd3-7080d66b51e5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:04.441349 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-d8aac198-deee-4764-bcd3-7080d66b51e5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:04.448965 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d8aac198-deee-4764-bcd3-7080d66b51e5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.077458 Jan 11 15:36:04.449531 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 885/2022] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:04 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:05.465824 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-64043a68-19bd-4961-9c7b-8db89207442a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:05.466431 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-64043a68-19bd-4961-9c7b-8db89207442a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:05.472363 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-64043a68-19bd-4961-9c7b-8db89207442a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:05.472811 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-64043a68-19bd-4961-9c7b-8db89207442a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:05.473611 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-64043a68-19bd-4961-9c7b-8db89207442a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:05.474051 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-64043a68-19bd-4961-9c7b-8db89207442a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:05.530751 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-64043a68-19bd-4961-9c7b-8db89207442a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:05.538360 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-64043a68-19bd-4961-9c7b-8db89207442a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.076102 Jan 11 15:36:05.538949 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1138/2023] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:05 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:06.554277 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-93d71391-89f9-49d7-b0fb-2b73f3b40377 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:06.554879 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-93d71391-89f9-49d7-b0fb-2b73f3b40377 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:06.561360 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-93d71391-89f9-49d7-b0fb-2b73f3b40377 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:06.563417 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-93d71391-89f9-49d7-b0fb-2b73f3b40377 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:06.563417 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-93d71391-89f9-49d7-b0fb-2b73f3b40377 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:06.563417 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-93d71391-89f9-49d7-b0fb-2b73f3b40377 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:06.630224 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-93d71391-89f9-49d7-b0fb-2b73f3b40377 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:06.637926 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-93d71391-89f9-49d7-b0fb-2b73f3b40377 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.087411 Jan 11 15:36:06.638482 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 886/2024] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:06 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:07.017199 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:36:07.017789 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: Tue Jan 11 15:36:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:36:07.654085 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-083a40a7-6afe-400e-9b61-265a6e411678 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:07.654611 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-083a40a7-6afe-400e-9b61-265a6e411678 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:07.660802 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-083a40a7-6afe-400e-9b61-265a6e411678 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:07.661248 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-083a40a7-6afe-400e-9b61-265a6e411678 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:07.662016 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-083a40a7-6afe-400e-9b61-265a6e411678 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:07.662449 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-083a40a7-6afe-400e-9b61-265a6e411678 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:07.719209 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-083a40a7-6afe-400e-9b61-265a6e411678 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:07.727227 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-083a40a7-6afe-400e-9b61-265a6e411678 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.076864 Jan 11 15:36:07.727815 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1139/2025] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:07 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:08.743864 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f656e424-e15f-4427-adc4-7505cff9f647 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:08.744412 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f656e424-e15f-4427-adc4-7505cff9f647 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:08.750636 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f656e424-e15f-4427-adc4-7505cff9f647 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:08.751043 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f656e424-e15f-4427-adc4-7505cff9f647 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:08.751848 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f656e424-e15f-4427-adc4-7505cff9f647 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:08.752290 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f656e424-e15f-4427-adc4-7505cff9f647 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:08.809458 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-f656e424-e15f-4427-adc4-7505cff9f647 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:08.817125 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f656e424-e15f-4427-adc4-7505cff9f647 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.077159 Jan 11 15:36:08.817686 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 887/2026] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:08 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:09.833754 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2d6b67b1-3cc9-4d4c-897d-f36a324905c1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:09.834361 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2d6b67b1-3cc9-4d4c-897d-f36a324905c1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:09.841434 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2d6b67b1-3cc9-4d4c-897d-f36a324905c1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:09.841881 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2d6b67b1-3cc9-4d4c-897d-f36a324905c1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:09.842650 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2d6b67b1-3cc9-4d4c-897d-f36a324905c1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:09.843089 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2d6b67b1-3cc9-4d4c-897d-f36a324905c1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:09.903075 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-2d6b67b1-3cc9-4d4c-897d-f36a324905c1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:09.910775 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2d6b67b1-3cc9-4d4c-897d-f36a324905c1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.080727 Jan 11 15:36:09.911358 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1140/2027] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:09 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:10.928423 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-12b16ee1-344b-4280-a6b3-9a19363ccf8c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:10.929095 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-12b16ee1-344b-4280-a6b3-9a19363ccf8c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:10.935380 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-12b16ee1-344b-4280-a6b3-9a19363ccf8c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:10.936008 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-12b16ee1-344b-4280-a6b3-9a19363ccf8c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:10.936789 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-12b16ee1-344b-4280-a6b3-9a19363ccf8c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:10.937225 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-12b16ee1-344b-4280-a6b3-9a19363ccf8c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:11.000437 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-12b16ee1-344b-4280-a6b3-9a19363ccf8c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:11.009563 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-12b16ee1-344b-4280-a6b3-9a19363ccf8c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.084900 Jan 11 15:36:11.010269 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 888/2028] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:10 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:12.026242 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5be48f1f-2a11-45e1-8c95-f06c35ec206a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:12.027550 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5be48f1f-2a11-45e1-8c95-f06c35ec206a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:12.033137 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5be48f1f-2a11-45e1-8c95-f06c35ec206a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:12.033581 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5be48f1f-2a11-45e1-8c95-f06c35ec206a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:12.034346 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5be48f1f-2a11-45e1-8c95-f06c35ec206a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:12.034781 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5be48f1f-2a11-45e1-8c95-f06c35ec206a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:12.093412 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-5be48f1f-2a11-45e1-8c95-f06c35ec206a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:12.101682 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5be48f1f-2a11-45e1-8c95-f06c35ec206a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.078537 Jan 11 15:36:12.102367 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1141/2029] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:12 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:13.118531 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2d00a5d4-2c3c-43ad-a58c-6028236addf1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:13.119150 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2d00a5d4-2c3c-43ad-a58c-6028236addf1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:13.125589 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2d00a5d4-2c3c-43ad-a58c-6028236addf1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:13.126050 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2d00a5d4-2c3c-43ad-a58c-6028236addf1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:13.126841 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2d00a5d4-2c3c-43ad-a58c-6028236addf1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:13.127331 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2d00a5d4-2c3c-43ad-a58c-6028236addf1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:13.186382 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-2d00a5d4-2c3c-43ad-a58c-6028236addf1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:13.194218 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2d00a5d4-2c3c-43ad-a58c-6028236addf1 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.079886 Jan 11 15:36:13.195434 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 889/2030] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:13 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:14.210434 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5c89e02a-8df2-451f-b41c-2ac1dfcded77 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:14.211084 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5c89e02a-8df2-451f-b41c-2ac1dfcded77 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:14.217910 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5c89e02a-8df2-451f-b41c-2ac1dfcded77 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:14.218358 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5c89e02a-8df2-451f-b41c-2ac1dfcded77 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:14.219127 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5c89e02a-8df2-451f-b41c-2ac1dfcded77 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:14.219596 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5c89e02a-8df2-451f-b41c-2ac1dfcded77 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:14.286878 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-5c89e02a-8df2-451f-b41c-2ac1dfcded77 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:14.295479 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5c89e02a-8df2-451f-b41c-2ac1dfcded77 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.088614 Jan 11 15:36:14.296072 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1142/2031] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:14 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:15.311954 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f0819964-c4f5-4ff2-91e2-a4a0925c7b19 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:15.313962 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f0819964-c4f5-4ff2-91e2-a4a0925c7b19 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:15.319513 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f0819964-c4f5-4ff2-91e2-a4a0925c7b19 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:15.320091 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f0819964-c4f5-4ff2-91e2-a4a0925c7b19 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:15.320878 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f0819964-c4f5-4ff2-91e2-a4a0925c7b19 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:15.321324 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f0819964-c4f5-4ff2-91e2-a4a0925c7b19 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:15.380675 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-f0819964-c4f5-4ff2-91e2-a4a0925c7b19 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:15.388322 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f0819964-c4f5-4ff2-91e2-a4a0925c7b19 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.079931 Jan 11 15:36:15.388872 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 890/2032] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:15 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:36:16.405359 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-46f70b70-b325-440b-ba52-8ecf0375effd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:16.405969 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-46f70b70-b325-440b-ba52-8ecf0375effd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:16.412230 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-46f70b70-b325-440b-ba52-8ecf0375effd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:16.412686 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-46f70b70-b325-440b-ba52-8ecf0375effd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:16.413464 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-46f70b70-b325-440b-ba52-8ecf0375effd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:16.413904 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-46f70b70-b325-440b-ba52-8ecf0375effd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:16.473722 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-46f70b70-b325-440b-ba52-8ecf0375effd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:16.481990 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-46f70b70-b325-440b-ba52-8ecf0375effd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.080238 Jan 11 15:36:16.482545 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1143/2033] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:16 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:17.498027 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-44c171ba-a49d-420f-9b47-bfbb039b1ec4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:17.498697 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-44c171ba-a49d-420f-9b47-bfbb039b1ec4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:17.504915 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-44c171ba-a49d-420f-9b47-bfbb039b1ec4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:17.505367 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-44c171ba-a49d-420f-9b47-bfbb039b1ec4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:17.506144 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-44c171ba-a49d-420f-9b47-bfbb039b1ec4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:17.506582 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-44c171ba-a49d-420f-9b47-bfbb039b1ec4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:17.562933 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-44c171ba-a49d-420f-9b47-bfbb039b1ec4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:17.571114 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-44c171ba-a49d-420f-9b47-bfbb039b1ec4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.076103 Jan 11 15:36:17.571666 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 891/2034] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:17 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:18.587262 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9c305068-7c32-496b-89e5-9f2e2336b35a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:18.587898 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9c305068-7c32-496b-89e5-9f2e2336b35a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:18.593930 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9c305068-7c32-496b-89e5-9f2e2336b35a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:18.594385 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9c305068-7c32-496b-89e5-9f2e2336b35a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:18.595172 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9c305068-7c32-496b-89e5-9f2e2336b35a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:18.595642 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9c305068-7c32-496b-89e5-9f2e2336b35a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:18.652679 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-9c305068-7c32-496b-89e5-9f2e2336b35a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:18.660327 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9c305068-7c32-496b-89e5-9f2e2336b35a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.076711 Jan 11 15:36:18.660891 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1144/2035] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:18 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:19.678136 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-871a4bc5-54fa-4a0a-b8b9-9c8f7b4d8af8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:19.678766 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-871a4bc5-54fa-4a0a-b8b9-9c8f7b4d8af8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:19.685582 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-871a4bc5-54fa-4a0a-b8b9-9c8f7b4d8af8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:19.686026 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-871a4bc5-54fa-4a0a-b8b9-9c8f7b4d8af8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:19.686812 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-871a4bc5-54fa-4a0a-b8b9-9c8f7b4d8af8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:19.687245 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-871a4bc5-54fa-4a0a-b8b9-9c8f7b4d8af8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:19.747862 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-871a4bc5-54fa-4a0a-b8b9-9c8f7b4d8af8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:19.755665 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-871a4bc5-54fa-4a0a-b8b9-9c8f7b4d8af8 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.081555 Jan 11 15:36:19.756232 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 892/2036] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:19 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:20.772532 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-66b7a35f-149a-4c56-8399-c9a406d23bf0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:20.773166 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-66b7a35f-149a-4c56-8399-c9a406d23bf0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:20.779683 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-66b7a35f-149a-4c56-8399-c9a406d23bf0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:20.780076 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-66b7a35f-149a-4c56-8399-c9a406d23bf0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:20.780872 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-66b7a35f-149a-4c56-8399-c9a406d23bf0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:20.781304 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-66b7a35f-149a-4c56-8399-c9a406d23bf0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:20.841625 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-66b7a35f-149a-4c56-8399-c9a406d23bf0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:20.849434 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-66b7a35f-149a-4c56-8399-c9a406d23bf0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.080427 Jan 11 15:36:20.849992 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1145/2037] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:20 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:21.866030 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-0bbcd468-2788-4d62-95c3-0e4f5784c49b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:21.873587 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-0bbcd468-2788-4d62-95c3-0e4f5784c49b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:21.874491 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0bbcd468-2788-4d62-95c3-0e4f5784c49b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:21.874949 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0bbcd468-2788-4d62-95c3-0e4f5784c49b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:21.876211 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0bbcd468-2788-4d62-95c3-0e4f5784c49b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:21.876740 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0bbcd468-2788-4d62-95c3-0e4f5784c49b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:21.946482 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-0bbcd468-2788-4d62-95c3-0e4f5784c49b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:21.954272 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-0bbcd468-2788-4d62-95c3-0e4f5784c49b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.092131 Jan 11 15:36:21.955037 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 893/2038] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:21 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:22.971687 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0003b4ac-16fb-419c-bc2f-df2135163e45 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:22.972283 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0003b4ac-16fb-419c-bc2f-df2135163e45 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:22.978891 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0003b4ac-16fb-419c-bc2f-df2135163e45 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:22.979367 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0003b4ac-16fb-419c-bc2f-df2135163e45 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:22.980135 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0003b4ac-16fb-419c-bc2f-df2135163e45 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:22.980572 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0003b4ac-16fb-419c-bc2f-df2135163e45 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:23.036691 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0003b4ac-16fb-419c-bc2f-df2135163e45 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:23.045518 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0003b4ac-16fb-419c-bc2f-df2135163e45 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.077573 Jan 11 15:36:23.046082 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1146/2039] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:22 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:24.061988 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a995b2df-689b-494c-ba64-d3b03d3ebd12 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:24.062609 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a995b2df-689b-494c-ba64-d3b03d3ebd12 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:24.068551 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a995b2df-689b-494c-ba64-d3b03d3ebd12 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:24.069005 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a995b2df-689b-494c-ba64-d3b03d3ebd12 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:24.069783 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a995b2df-689b-494c-ba64-d3b03d3ebd12 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:24.070228 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a995b2df-689b-494c-ba64-d3b03d3ebd12 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:24.127282 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-a995b2df-689b-494c-ba64-d3b03d3ebd12 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:24.135020 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a995b2df-689b-494c-ba64-d3b03d3ebd12 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.077194 Jan 11 15:36:24.135604 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 894/2040] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:24 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:25.152100 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c757b73c-36a4-4768-b8b3-c4e6b60f4272 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:25.152717 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c757b73c-36a4-4768-b8b3-c4e6b60f4272 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:25.159246 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c757b73c-36a4-4768-b8b3-c4e6b60f4272 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:25.159828 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c757b73c-36a4-4768-b8b3-c4e6b60f4272 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:25.160615 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c757b73c-36a4-4768-b8b3-c4e6b60f4272 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:25.161056 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c757b73c-36a4-4768-b8b3-c4e6b60f4272 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:25.219269 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c757b73c-36a4-4768-b8b3-c4e6b60f4272 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:25.227582 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c757b73c-36a4-4768-b8b3-c4e6b60f4272 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.079119 Jan 11 15:36:25.228142 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1147/2041] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:25 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:26.244154 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-57b2e3d6-4562-4a96-9d83-e947ca760751 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:26.244788 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-57b2e3d6-4562-4a96-9d83-e947ca760751 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:26.251041 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-57b2e3d6-4562-4a96-9d83-e947ca760751 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:26.251527 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-57b2e3d6-4562-4a96-9d83-e947ca760751 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:26.253641 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-57b2e3d6-4562-4a96-9d83-e947ca760751 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:26.253641 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-57b2e3d6-4562-4a96-9d83-e947ca760751 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:26.319653 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-57b2e3d6-4562-4a96-9d83-e947ca760751 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:26.328456 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-57b2e3d6-4562-4a96-9d83-e947ca760751 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.087976 Jan 11 15:36:26.329032 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 895/2042] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:26 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:27.345652 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-30d28fd0-663a-4118-a976-345ab8a7b582 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:27.346263 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-30d28fd0-663a-4118-a976-345ab8a7b582 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:27.353310 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-30d28fd0-663a-4118-a976-345ab8a7b582 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:27.353757 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-30d28fd0-663a-4118-a976-345ab8a7b582 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:27.354527 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-30d28fd0-663a-4118-a976-345ab8a7b582 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:27.355067 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-30d28fd0-663a-4118-a976-345ab8a7b582 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:27.416956 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-30d28fd0-663a-4118-a976-345ab8a7b582 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:27.424881 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-30d28fd0-663a-4118-a976-345ab8a7b582 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.083316 Jan 11 15:36:27.425452 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1148/2043] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:27 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:28.441310 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b75a3d79-e525-4c36-89bf-1bf5f4e0c87e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:28.441924 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b75a3d79-e525-4c36-89bf-1bf5f4e0c87e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:28.448140 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b75a3d79-e525-4c36-89bf-1bf5f4e0c87e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:28.448625 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b75a3d79-e525-4c36-89bf-1bf5f4e0c87e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:28.449401 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b75a3d79-e525-4c36-89bf-1bf5f4e0c87e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:28.449846 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b75a3d79-e525-4c36-89bf-1bf5f4e0c87e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:28.505947 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-b75a3d79-e525-4c36-89bf-1bf5f4e0c87e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:28.513593 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b75a3d79-e525-4c36-89bf-1bf5f4e0c87e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.075894 Jan 11 15:36:28.514094 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 896/2044] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:28 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:29.530125 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0bfaad1d-3d8d-40ac-a20e-bdc135248582 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:29.530735 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0bfaad1d-3d8d-40ac-a20e-bdc135248582 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:29.536948 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0bfaad1d-3d8d-40ac-a20e-bdc135248582 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:29.537399 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0bfaad1d-3d8d-40ac-a20e-bdc135248582 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:29.538177 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0bfaad1d-3d8d-40ac-a20e-bdc135248582 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:29.538613 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0bfaad1d-3d8d-40ac-a20e-bdc135248582 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:29.595355 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0bfaad1d-3d8d-40ac-a20e-bdc135248582 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:29.603724 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0bfaad1d-3d8d-40ac-a20e-bdc135248582 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.077189 Jan 11 15:36:29.604285 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1149/2045] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:29 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:30.620805 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c10c700a-659c-46bb-a88a-0d06dcf50f4e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:30.621415 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c10c700a-659c-46bb-a88a-0d06dcf50f4e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:30.627975 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c10c700a-659c-46bb-a88a-0d06dcf50f4e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:30.628357 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c10c700a-659c-46bb-a88a-0d06dcf50f4e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:30.629132 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c10c700a-659c-46bb-a88a-0d06dcf50f4e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:30.629566 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c10c700a-659c-46bb-a88a-0d06dcf50f4e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:30.687087 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-c10c700a-659c-46bb-a88a-0d06dcf50f4e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:30.694680 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c10c700a-659c-46bb-a88a-0d06dcf50f4e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.078012 Jan 11 15:36:30.695240 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 897/2046] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:30 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:31.711640 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2b2bcdc7-2c0b-4b7e-bc92-282b7bcb2cf9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:31.712203 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2b2bcdc7-2c0b-4b7e-bc92-282b7bcb2cf9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:31.718474 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2b2bcdc7-2c0b-4b7e-bc92-282b7bcb2cf9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:31.718930 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2b2bcdc7-2c0b-4b7e-bc92-282b7bcb2cf9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:31.719745 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2b2bcdc7-2c0b-4b7e-bc92-282b7bcb2cf9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:31.720194 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2b2bcdc7-2c0b-4b7e-bc92-282b7bcb2cf9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:31.778246 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-2b2bcdc7-2c0b-4b7e-bc92-282b7bcb2cf9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:31.785958 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2b2bcdc7-2c0b-4b7e-bc92-282b7bcb2cf9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.078762 Jan 11 15:36:31.786519 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1150/2047] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:31 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:32.802849 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-8bcd799e-da6b-4219-bd6e-f88b3cc603e0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:32.803501 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-8bcd799e-da6b-4219-bd6e-f88b3cc603e0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:32.810223 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8bcd799e-da6b-4219-bd6e-f88b3cc603e0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:32.810678 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8bcd799e-da6b-4219-bd6e-f88b3cc603e0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:32.811504 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8bcd799e-da6b-4219-bd6e-f88b3cc603e0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:32.811952 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8bcd799e-da6b-4219-bd6e-f88b3cc603e0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:32.868253 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-8bcd799e-da6b-4219-bd6e-f88b3cc603e0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:32.875760 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-8bcd799e-da6b-4219-bd6e-f88b3cc603e0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.076554 Jan 11 15:36:32.876316 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 898/2048] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:32 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:33.893210 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-cb775e5a-de8c-4021-816b-0d3ce5f4104c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:33.893766 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-cb775e5a-de8c-4021-816b-0d3ce5f4104c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:33.899969 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cb775e5a-de8c-4021-816b-0d3ce5f4104c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:33.900417 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cb775e5a-de8c-4021-816b-0d3ce5f4104c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:33.901179 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cb775e5a-de8c-4021-816b-0d3ce5f4104c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:33.901613 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-cb775e5a-de8c-4021-816b-0d3ce5f4104c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:33.961035 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-cb775e5a-de8c-4021-816b-0d3ce5f4104c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:33.968947 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-cb775e5a-de8c-4021-816b-0d3ce5f4104c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.079617 Jan 11 15:36:33.969501 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1151/2049] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:33 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:34.672641 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:36:34.673166 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: Tue Jan 11 15:36:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:36:34.985722 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-6df8ef15-5303-42cd-b7b7-625ab971bb6c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:34.986246 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-6df8ef15-5303-42cd-b7b7-625ab971bb6c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:34.993430 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6df8ef15-5303-42cd-b7b7-625ab971bb6c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:34.994218 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6df8ef15-5303-42cd-b7b7-625ab971bb6c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:34.995538 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6df8ef15-5303-42cd-b7b7-625ab971bb6c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:34.995991 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6df8ef15-5303-42cd-b7b7-625ab971bb6c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:35.054817 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-6df8ef15-5303-42cd-b7b7-625ab971bb6c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:35.062441 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-6df8ef15-5303-42cd-b7b7-625ab971bb6c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.080472 Jan 11 15:36:35.062995 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 899/2050] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:34 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:36.087032 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-45f6022e-63c3-4f84-bfcf-78636c1629b4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:36.087659 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-45f6022e-63c3-4f84-bfcf-78636c1629b4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:36.093895 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-45f6022e-63c3-4f84-bfcf-78636c1629b4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:36.094347 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-45f6022e-63c3-4f84-bfcf-78636c1629b4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:36.095193 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-45f6022e-63c3-4f84-bfcf-78636c1629b4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:36.095735 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-45f6022e-63c3-4f84-bfcf-78636c1629b4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:36.152213 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-45f6022e-63c3-4f84-bfcf-78636c1629b4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:36.159688 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-45f6022e-63c3-4f84-bfcf-78636c1629b4 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.076400 Jan 11 15:36:36.160248 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1152/2051] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:36 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:37.177176 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-1ffa11c0-d2e2-4fb2-aa85-f618c7ba154e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:37.177812 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-1ffa11c0-d2e2-4fb2-aa85-f618c7ba154e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:37.184314 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1ffa11c0-d2e2-4fb2-aa85-f618c7ba154e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:37.184757 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1ffa11c0-d2e2-4fb2-aa85-f618c7ba154e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:37.185524 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1ffa11c0-d2e2-4fb2-aa85-f618c7ba154e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:37.185960 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1ffa11c0-d2e2-4fb2-aa85-f618c7ba154e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:37.244149 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-1ffa11c0-d2e2-4fb2-aa85-f618c7ba154e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:37.252324 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-1ffa11c0-d2e2-4fb2-aa85-f618c7ba154e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.078782 Jan 11 15:36:37.252912 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 900/2052] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:37 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:38.269540 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-08dc1653-fc04-4699-9ba4-55d5985972cd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:38.270146 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-08dc1653-fc04-4699-9ba4-55d5985972cd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:38.277021 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-08dc1653-fc04-4699-9ba4-55d5985972cd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:38.277471 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-08dc1653-fc04-4699-9ba4-55d5985972cd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:38.278238 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-08dc1653-fc04-4699-9ba4-55d5985972cd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:38.278675 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-08dc1653-fc04-4699-9ba4-55d5985972cd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:38.334693 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-08dc1653-fc04-4699-9ba4-55d5985972cd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:38.342870 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-08dc1653-fc04-4699-9ba4-55d5985972cd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.077000 Jan 11 15:36:38.343448 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1153/2053] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:38 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:39.359612 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4bfedd5f-64c8-411a-9ffc-a7bde1341193 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:39.360227 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4bfedd5f-64c8-411a-9ffc-a7bde1341193 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:39.366397 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4bfedd5f-64c8-411a-9ffc-a7bde1341193 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:39.366855 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4bfedd5f-64c8-411a-9ffc-a7bde1341193 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:39.367660 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4bfedd5f-64c8-411a-9ffc-a7bde1341193 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:39.368104 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4bfedd5f-64c8-411a-9ffc-a7bde1341193 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:39.424963 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-4bfedd5f-64c8-411a-9ffc-a7bde1341193 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:39.432641 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4bfedd5f-64c8-411a-9ffc-a7bde1341193 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.076801 Jan 11 15:36:39.433195 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 901/2054] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:39 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:40.449986 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ff28112e-246f-40cd-a1d2-e13074b6a866 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:40.450597 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ff28112e-246f-40cd-a1d2-e13074b6a866 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:40.456819 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ff28112e-246f-40cd-a1d2-e13074b6a866 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:40.457274 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ff28112e-246f-40cd-a1d2-e13074b6a866 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:40.458047 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ff28112e-246f-40cd-a1d2-e13074b6a866 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:40.458487 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ff28112e-246f-40cd-a1d2-e13074b6a866 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:40.517461 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ff28112e-246f-40cd-a1d2-e13074b6a866 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:40.525748 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ff28112e-246f-40cd-a1d2-e13074b6a866 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.079419 Jan 11 15:36:40.526316 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1154/2055] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:40 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:41.542309 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-07b587f2-fb37-4570-bbd4-742384fdeedd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:41.542886 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-07b587f2-fb37-4570-bbd4-742384fdeedd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:41.550038 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-07b587f2-fb37-4570-bbd4-742384fdeedd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:41.550490 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-07b587f2-fb37-4570-bbd4-742384fdeedd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:41.551268 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-07b587f2-fb37-4570-bbd4-742384fdeedd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:41.551733 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-07b587f2-fb37-4570-bbd4-742384fdeedd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:41.608401 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-07b587f2-fb37-4570-bbd4-742384fdeedd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:41.615966 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-07b587f2-fb37-4570-bbd4-742384fdeedd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.077412 Jan 11 15:36:41.616526 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 902/2056] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:41 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:42.633081 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b8e8c5fd-5c99-4667-9671-42f2cfac7d28 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:42.633626 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b8e8c5fd-5c99-4667-9671-42f2cfac7d28 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:42.639968 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b8e8c5fd-5c99-4667-9671-42f2cfac7d28 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:42.640421 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b8e8c5fd-5c99-4667-9671-42f2cfac7d28 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:42.641197 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b8e8c5fd-5c99-4667-9671-42f2cfac7d28 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:42.641636 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b8e8c5fd-5c99-4667-9671-42f2cfac7d28 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:42.698642 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b8e8c5fd-5c99-4667-9671-42f2cfac7d28 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:42.706248 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b8e8c5fd-5c99-4667-9671-42f2cfac7d28 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.077407 Jan 11 15:36:42.706803 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1155/2057] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:42 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:43.723565 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-cbabae77-cafa-4038-8da0-0120f11aa9cc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:43.724117 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-cbabae77-cafa-4038-8da0-0120f11aa9cc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:43.730317 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cbabae77-cafa-4038-8da0-0120f11aa9cc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:43.730771 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cbabae77-cafa-4038-8da0-0120f11aa9cc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:43.731574 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cbabae77-cafa-4038-8da0-0120f11aa9cc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:43.732016 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cbabae77-cafa-4038-8da0-0120f11aa9cc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:43.914071 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-cbabae77-cafa-4038-8da0-0120f11aa9cc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:43.922252 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-cbabae77-cafa-4038-8da0-0120f11aa9cc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.202539 Jan 11 15:36:43.922807 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 903/2058] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:43 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:44.940961 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-46953939-0ae9-48c2-8d22-4b3b34613bcf tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:44.941576 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-46953939-0ae9-48c2-8d22-4b3b34613bcf tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:44.948318 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-46953939-0ae9-48c2-8d22-4b3b34613bcf tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:44.948768 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-46953939-0ae9-48c2-8d22-4b3b34613bcf tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:44.949536 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-46953939-0ae9-48c2-8d22-4b3b34613bcf tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:44.949975 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-46953939-0ae9-48c2-8d22-4b3b34613bcf tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:45.006580 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-46953939-0ae9-48c2-8d22-4b3b34613bcf tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:45.014912 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-46953939-0ae9-48c2-8d22-4b3b34613bcf tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.077611 Jan 11 15:36:45.015516 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1156/2059] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:44 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:46.032035 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b7d5e68c-9468-44bf-949c-5132a857965d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:46.032635 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b7d5e68c-9468-44bf-949c-5132a857965d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:46.038812 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b7d5e68c-9468-44bf-949c-5132a857965d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:46.039257 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b7d5e68c-9468-44bf-949c-5132a857965d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:46.040059 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b7d5e68c-9468-44bf-949c-5132a857965d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:46.040495 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b7d5e68c-9468-44bf-949c-5132a857965d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:46.100179 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-b7d5e68c-9468-44bf-949c-5132a857965d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:46.107877 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b7d5e68c-9468-44bf-949c-5132a857965d tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.079435 Jan 11 15:36:46.108790 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 904/2060] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:46 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:47.124863 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b83b60b5-5bdd-4bd7-a758-e5db7c52dc50 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:47.125502 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b83b60b5-5bdd-4bd7-a758-e5db7c52dc50 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:47.132132 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b83b60b5-5bdd-4bd7-a758-e5db7c52dc50 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:47.132638 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b83b60b5-5bdd-4bd7-a758-e5db7c52dc50 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:47.133457 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b83b60b5-5bdd-4bd7-a758-e5db7c52dc50 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:47.133894 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b83b60b5-5bdd-4bd7-a758-e5db7c52dc50 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:47.195756 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b83b60b5-5bdd-4bd7-a758-e5db7c52dc50 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:47.203617 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b83b60b5-5bdd-4bd7-a758-e5db7c52dc50 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.082466 Jan 11 15:36:47.204182 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1157/2061] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:47 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:48.220165 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d8a36e61-48a1-4ab0-9e36-eaaa3fe57f66 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:48.220778 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d8a36e61-48a1-4ab0-9e36-eaaa3fe57f66 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:48.227838 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d8a36e61-48a1-4ab0-9e36-eaaa3fe57f66 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:48.228294 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d8a36e61-48a1-4ab0-9e36-eaaa3fe57f66 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:48.229084 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d8a36e61-48a1-4ab0-9e36-eaaa3fe57f66 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:48.229779 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d8a36e61-48a1-4ab0-9e36-eaaa3fe57f66 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:48.290007 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-d8a36e61-48a1-4ab0-9e36-eaaa3fe57f66 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:48.298152 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d8a36e61-48a1-4ab0-9e36-eaaa3fe57f66 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.081687 Jan 11 15:36:48.298723 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 905/2062] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:48 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:49.315046 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1f44d46f-5f53-4918-aa52-85e35ad6057a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:49.315906 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1f44d46f-5f53-4918-aa52-85e35ad6057a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:49.323063 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1f44d46f-5f53-4918-aa52-85e35ad6057a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:49.323621 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1f44d46f-5f53-4918-aa52-85e35ad6057a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:49.324488 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1f44d46f-5f53-4918-aa52-85e35ad6057a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:49.325150 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1f44d46f-5f53-4918-aa52-85e35ad6057a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:49.388725 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1f44d46f-5f53-4918-aa52-85e35ad6057a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:49.396774 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1f44d46f-5f53-4918-aa52-85e35ad6057a tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.085415 Jan 11 15:36:49.397562 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1158/2063] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:49 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:50.413160 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e0347dae-61c7-4380-84c4-2f4d9956571f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:50.413785 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e0347dae-61c7-4380-84c4-2f4d9956571f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:50.420638 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e0347dae-61c7-4380-84c4-2f4d9956571f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:50.421098 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e0347dae-61c7-4380-84c4-2f4d9956571f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:50.421891 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e0347dae-61c7-4380-84c4-2f4d9956571f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:50.422333 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e0347dae-61c7-4380-84c4-2f4d9956571f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:50.480899 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-e0347dae-61c7-4380-84c4-2f4d9956571f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:50.488434 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e0347dae-61c7-4380-84c4-2f4d9956571f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.078872 Jan 11 15:36:50.488999 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 906/2064] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:50 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:51.505412 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-37c17fe2-9355-4354-9802-a3d3455b3f07 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:51.506025 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-37c17fe2-9355-4354-9802-a3d3455b3f07 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:51.512291 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-37c17fe2-9355-4354-9802-a3d3455b3f07 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:51.512745 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-37c17fe2-9355-4354-9802-a3d3455b3f07 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:51.513520 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-37c17fe2-9355-4354-9802-a3d3455b3f07 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:51.513953 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-37c17fe2-9355-4354-9802-a3d3455b3f07 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:51.573522 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-37c17fe2-9355-4354-9802-a3d3455b3f07 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:51.581119 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-37c17fe2-9355-4354-9802-a3d3455b3f07 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.079266 Jan 11 15:36:51.581669 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1159/2065] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:51 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:52.597404 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d3bf6ef0-6b14-4ae1-9101-7055224e87f7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:52.598024 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d3bf6ef0-6b14-4ae1-9101-7055224e87f7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:52.604546 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d3bf6ef0-6b14-4ae1-9101-7055224e87f7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:52.605000 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d3bf6ef0-6b14-4ae1-9101-7055224e87f7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:52.605783 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d3bf6ef0-6b14-4ae1-9101-7055224e87f7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:52.606219 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d3bf6ef0-6b14-4ae1-9101-7055224e87f7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:52.663517 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-d3bf6ef0-6b14-4ae1-9101-7055224e87f7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:52.671946 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d3bf6ef0-6b14-4ae1-9101-7055224e87f7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.078077 Jan 11 15:36:52.672690 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 907/2066] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:52 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:53.689717 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4072258e-2ea1-4c06-965b-d525005d8145 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:53.690426 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-4072258e-2ea1-4c06-965b-d525005d8145 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:53.697374 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4072258e-2ea1-4c06-965b-d525005d8145 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:53.697818 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4072258e-2ea1-4c06-965b-d525005d8145 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:53.698586 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4072258e-2ea1-4c06-965b-d525005d8145 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:53.699021 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4072258e-2ea1-4c06-965b-d525005d8145 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:53.767799 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-4072258e-2ea1-4c06-965b-d525005d8145 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:53.775304 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4072258e-2ea1-4c06-965b-d525005d8145 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.089524 Jan 11 15:36:53.775879 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1160/2067] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:53 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:54.792097 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-6df3edbb-af18-49a0-9c93-e28d0e959adb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:54.792787 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-6df3edbb-af18-49a0-9c93-e28d0e959adb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:54.798976 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6df3edbb-af18-49a0-9c93-e28d0e959adb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:54.807827 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6df3edbb-af18-49a0-9c93-e28d0e959adb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:54.808702 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6df3edbb-af18-49a0-9c93-e28d0e959adb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:54.809158 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6df3edbb-af18-49a0-9c93-e28d0e959adb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:54.866293 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-6df3edbb-af18-49a0-9c93-e28d0e959adb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:54.874557 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-6df3edbb-af18-49a0-9c93-e28d0e959adb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.086608 Jan 11 15:36:54.875118 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 908/2068] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:54 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:55.890975 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-fb090e70-200a-4b66-9a9f-84e1dd6c5656 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:55.891543 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-fb090e70-200a-4b66-9a9f-84e1dd6c5656 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:55.897703 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fb090e70-200a-4b66-9a9f-84e1dd6c5656 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:55.898234 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fb090e70-200a-4b66-9a9f-84e1dd6c5656 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:55.899031 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fb090e70-200a-4b66-9a9f-84e1dd6c5656 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:55.899494 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fb090e70-200a-4b66-9a9f-84e1dd6c5656 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:55.956557 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-fb090e70-200a-4b66-9a9f-84e1dd6c5656 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:55.964064 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-fb090e70-200a-4b66-9a9f-84e1dd6c5656 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.076779 Jan 11 15:36:55.964623 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1161/2069] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:55 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:56.982606 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f70463a4-4569-427d-b125-371ccd660f66 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:56.982606 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f70463a4-4569-427d-b125-371ccd660f66 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:56.987517 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f70463a4-4569-427d-b125-371ccd660f66 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:56.987966 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f70463a4-4569-427d-b125-371ccd660f66 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:56.988730 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f70463a4-4569-427d-b125-371ccd660f66 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:56.989165 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f70463a4-4569-427d-b125-371ccd660f66 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:57.046187 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-f70463a4-4569-427d-b125-371ccd660f66 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:57.053730 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f70463a4-4569-427d-b125-371ccd660f66 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.076969 Jan 11 15:36:57.054316 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 909/2070] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:56 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:58.070756 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1fcb30a1-c108-4a8e-bc1e-fa75f46864c0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:58.071358 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1fcb30a1-c108-4a8e-bc1e-fa75f46864c0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:58.077892 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1fcb30a1-c108-4a8e-bc1e-fa75f46864c0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:58.078363 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1fcb30a1-c108-4a8e-bc1e-fa75f46864c0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:58.079146 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1fcb30a1-c108-4a8e-bc1e-fa75f46864c0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:58.079628 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1fcb30a1-c108-4a8e-bc1e-fa75f46864c0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:58.136763 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1fcb30a1-c108-4a8e-bc1e-fa75f46864c0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:58.144815 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1fcb30a1-c108-4a8e-bc1e-fa75f46864c0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.078393 Jan 11 15:36:58.145378 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1162/2071] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:58 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:36:59.161487 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c9d23fcc-ccb7-4f21-ae35-1ef9336f435b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:36:59.162035 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c9d23fcc-ccb7-4f21-ae35-1ef9336f435b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:36:59.168630 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c9d23fcc-ccb7-4f21-ae35-1ef9336f435b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:59.169081 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c9d23fcc-ccb7-4f21-ae35-1ef9336f435b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:59.169853 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c9d23fcc-ccb7-4f21-ae35-1ef9336f435b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:36:59.170297 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c9d23fcc-ccb7-4f21-ae35-1ef9336f435b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:36:59.228262 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-c9d23fcc-ccb7-4f21-ae35-1ef9336f435b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:36:59.236220 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c9d23fcc-ccb7-4f21-ae35-1ef9336f435b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.078419 Jan 11 15:36:59.236789 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 910/2072] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:36:59 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:00.253144 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c52e1c9b-1ff7-42fc-a5d0-df0c461d3326 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:00.253694 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c52e1c9b-1ff7-42fc-a5d0-df0c461d3326 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:00.260822 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c52e1c9b-1ff7-42fc-a5d0-df0c461d3326 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:00.261277 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c52e1c9b-1ff7-42fc-a5d0-df0c461d3326 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:00.262085 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c52e1c9b-1ff7-42fc-a5d0-df0c461d3326 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:00.262502 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c52e1c9b-1ff7-42fc-a5d0-df0c461d3326 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:00.322409 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c52e1c9b-1ff7-42fc-a5d0-df0c461d3326 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:00.330036 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c52e1c9b-1ff7-42fc-a5d0-df0c461d3326 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.080758 Jan 11 15:37:00.330598 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1163/2073] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:00 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:01.345841 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d23a5fa4-fba7-4e59-8578-5c1bc9e6612b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:01.346491 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d23a5fa4-fba7-4e59-8578-5c1bc9e6612b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:01.353406 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d23a5fa4-fba7-4e59-8578-5c1bc9e6612b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:01.353866 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d23a5fa4-fba7-4e59-8578-5c1bc9e6612b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:01.354648 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d23a5fa4-fba7-4e59-8578-5c1bc9e6612b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:01.355090 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d23a5fa4-fba7-4e59-8578-5c1bc9e6612b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:01.411242 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-d23a5fa4-fba7-4e59-8578-5c1bc9e6612b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:01.419920 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d23a5fa4-fba7-4e59-8578-5c1bc9e6612b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.077701 Jan 11 15:37:01.420496 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 911/2074] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:01 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:02.436820 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-bf7e8563-e498-4e36-88cf-4ed4c10cafbd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:02.437345 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-bf7e8563-e498-4e36-88cf-4ed4c10cafbd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:02.443723 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bf7e8563-e498-4e36-88cf-4ed4c10cafbd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:02.444177 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bf7e8563-e498-4e36-88cf-4ed4c10cafbd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:02.444950 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bf7e8563-e498-4e36-88cf-4ed4c10cafbd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:02.445389 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bf7e8563-e498-4e36-88cf-4ed4c10cafbd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:02.502456 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-bf7e8563-e498-4e36-88cf-4ed4c10cafbd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:02.510748 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-bf7e8563-e498-4e36-88cf-4ed4c10cafbd tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.077686 Jan 11 15:37:02.511356 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1164/2075] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:02 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:03.527379 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-adbd51d9-db8a-4c86-a5c1-c933a5100e7c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:03.528029 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-adbd51d9-db8a-4c86-a5c1-c933a5100e7c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:03.534311 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-adbd51d9-db8a-4c86-a5c1-c933a5100e7c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:03.534769 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-adbd51d9-db8a-4c86-a5c1-c933a5100e7c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:03.535579 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-adbd51d9-db8a-4c86-a5c1-c933a5100e7c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:03.536023 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-adbd51d9-db8a-4c86-a5c1-c933a5100e7c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:03.593717 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-adbd51d9-db8a-4c86-a5c1-c933a5100e7c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:03.601514 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-adbd51d9-db8a-4c86-a5c1-c933a5100e7c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.078350 Jan 11 15:37:03.602083 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 912/2076] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:03 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:04.618907 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f9deff2a-96f3-4d42-9e7c-c487da8747cc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:04.619552 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f9deff2a-96f3-4d42-9e7c-c487da8747cc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:04.626066 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f9deff2a-96f3-4d42-9e7c-c487da8747cc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:04.626525 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f9deff2a-96f3-4d42-9e7c-c487da8747cc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:04.627334 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f9deff2a-96f3-4d42-9e7c-c487da8747cc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:04.627778 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f9deff2a-96f3-4d42-9e7c-c487da8747cc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:04.686548 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f9deff2a-96f3-4d42-9e7c-c487da8747cc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:04.694325 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f9deff2a-96f3-4d42-9e7c-c487da8747cc tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.080152 Jan 11 15:37:04.694886 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1165/2077] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:04 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:05.711550 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-6027240b-f105-421c-b36a-bec3ca6d44c5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:05.712157 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-6027240b-f105-421c-b36a-bec3ca6d44c5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:05.718421 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6027240b-f105-421c-b36a-bec3ca6d44c5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:05.718874 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6027240b-f105-421c-b36a-bec3ca6d44c5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:05.719693 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6027240b-f105-421c-b36a-bec3ca6d44c5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:05.720134 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6027240b-f105-421c-b36a-bec3ca6d44c5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:05.776521 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-6027240b-f105-421c-b36a-bec3ca6d44c5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:05.783966 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-6027240b-f105-421c-b36a-bec3ca6d44c5 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.076622 Jan 11 15:37:05.784531 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 913/2078] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:05 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:06.801416 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1097ff86-865c-4b0f-b74c-f12142578434 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:06.802035 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1097ff86-865c-4b0f-b74c-f12142578434 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:06.808463 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1097ff86-865c-4b0f-b74c-f12142578434 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:06.808920 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1097ff86-865c-4b0f-b74c-f12142578434 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:06.809700 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1097ff86-865c-4b0f-b74c-f12142578434 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:06.810143 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1097ff86-865c-4b0f-b74c-f12142578434 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:06.869872 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1097ff86-865c-4b0f-b74c-f12142578434 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:06.877556 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1097ff86-865c-4b0f-b74c-f12142578434 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.079762 Jan 11 15:37:06.878122 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1166/2079] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:06 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:07.894035 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7affab33-0082-499d-b212-31c01067e7ed tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:07.894591 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7affab33-0082-499d-b212-31c01067e7ed tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:07.901414 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7affab33-0082-499d-b212-31c01067e7ed tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:07.901872 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7affab33-0082-499d-b212-31c01067e7ed tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:07.902657 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7affab33-0082-499d-b212-31c01067e7ed tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:07.903105 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7affab33-0082-499d-b212-31c01067e7ed tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:07.959930 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-7affab33-0082-499d-b212-31c01067e7ed tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:07.968168 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7affab33-0082-499d-b212-31c01067e7ed tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.077889 Jan 11 15:37:07.968767 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 914/2080] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:07 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:08.985501 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c30cb99b-bdab-4966-aaa8-151065ae0855 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:08.986068 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c30cb99b-bdab-4966-aaa8-151065ae0855 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:08.993016 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c30cb99b-bdab-4966-aaa8-151065ae0855 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:08.993462 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c30cb99b-bdab-4966-aaa8-151065ae0855 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:08.994238 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c30cb99b-bdab-4966-aaa8-151065ae0855 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:08.994678 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c30cb99b-bdab-4966-aaa8-151065ae0855 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:09.050996 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c30cb99b-bdab-4966-aaa8-151065ae0855 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:09.059338 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c30cb99b-bdab-4966-aaa8-151065ae0855 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.077555 Jan 11 15:37:09.059932 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1167/2081] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:08 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:37:10.076569 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f4150d32-8953-409a-a5ef-93ae540aacf0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:10.077189 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f4150d32-8953-409a-a5ef-93ae540aacf0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:10.083431 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f4150d32-8953-409a-a5ef-93ae540aacf0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:10.083890 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f4150d32-8953-409a-a5ef-93ae540aacf0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:10.084679 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f4150d32-8953-409a-a5ef-93ae540aacf0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:10.085121 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f4150d32-8953-409a-a5ef-93ae540aacf0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:10.141570 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-f4150d32-8953-409a-a5ef-93ae540aacf0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:10.149145 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f4150d32-8953-409a-a5ef-93ae540aacf0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.076215 Jan 11 15:37:10.149725 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 915/2082] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:10 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:10.760873 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:37:10.761051 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: Tue Jan 11 15:37:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:37:11.165666 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5eb3ed25-7c2a-4304-8f8e-ea6a8ba1516c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:11.166279 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5eb3ed25-7c2a-4304-8f8e-ea6a8ba1516c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:11.172783 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5eb3ed25-7c2a-4304-8f8e-ea6a8ba1516c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:11.173234 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5eb3ed25-7c2a-4304-8f8e-ea6a8ba1516c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:11.174008 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5eb3ed25-7c2a-4304-8f8e-ea6a8ba1516c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:11.174459 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5eb3ed25-7c2a-4304-8f8e-ea6a8ba1516c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:11.231918 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-5eb3ed25-7c2a-4304-8f8e-ea6a8ba1516c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:11.240151 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5eb3ed25-7c2a-4304-8f8e-ea6a8ba1516c tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.078064 Jan 11 15:37:11.240729 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1168/2083] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:11 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:12.262093 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-62a59ab6-b2d9-4286-a37a-ff72f58849e2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:12.262654 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-62a59ab6-b2d9-4286-a37a-ff72f58849e2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:12.269258 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-62a59ab6-b2d9-4286-a37a-ff72f58849e2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:12.269705 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-62a59ab6-b2d9-4286-a37a-ff72f58849e2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:12.270479 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-62a59ab6-b2d9-4286-a37a-ff72f58849e2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:12.271010 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-62a59ab6-b2d9-4286-a37a-ff72f58849e2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:12.329449 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-62a59ab6-b2d9-4286-a37a-ff72f58849e2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:12.337983 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-62a59ab6-b2d9-4286-a37a-ff72f58849e2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.079877 Jan 11 15:37:12.338550 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 916/2084] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:12 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:13.355157 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6b01f204-ecc0-4368-bb6c-f196973d5772 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:13.355803 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6b01f204-ecc0-4368-bb6c-f196973d5772 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:13.362098 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6b01f204-ecc0-4368-bb6c-f196973d5772 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:13.362556 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6b01f204-ecc0-4368-bb6c-f196973d5772 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:13.363359 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6b01f204-ecc0-4368-bb6c-f196973d5772 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:13.363805 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6b01f204-ecc0-4368-bb6c-f196973d5772 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:13.424690 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6b01f204-ecc0-4368-bb6c-f196973d5772 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:13.433091 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6b01f204-ecc0-4368-bb6c-f196973d5772 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.082234 Jan 11 15:37:13.433650 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1169/2085] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:13 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:14.450135 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-428c099c-e5aa-4142-82d2-e44e8776441e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:14.450785 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-428c099c-e5aa-4142-82d2-e44e8776441e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:14.457024 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-428c099c-e5aa-4142-82d2-e44e8776441e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:14.457469 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-428c099c-e5aa-4142-82d2-e44e8776441e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:14.458241 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-428c099c-e5aa-4142-82d2-e44e8776441e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:14.458677 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-428c099c-e5aa-4142-82d2-e44e8776441e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:14.750181 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-428c099c-e5aa-4142-82d2-e44e8776441e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:14.758645 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-428c099c-e5aa-4142-82d2-e44e8776441e tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.312130 Jan 11 15:37:14.759205 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 917/2086] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:14 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:37:15.775772 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b108990f-0550-46fc-875c-0f9385682618 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:15.776383 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b108990f-0550-46fc-875c-0f9385682618 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:15.782616 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b108990f-0550-46fc-875c-0f9385682618 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:15.783066 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b108990f-0550-46fc-875c-0f9385682618 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:15.783873 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b108990f-0550-46fc-875c-0f9385682618 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:15.784318 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b108990f-0550-46fc-875c-0f9385682618 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:15.840948 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b108990f-0550-46fc-875c-0f9385682618 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:15.848679 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b108990f-0550-46fc-875c-0f9385682618 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.077305 Jan 11 15:37:15.849249 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1170/2087] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:15 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:16.864324 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-27b9bec6-097c-47f2-b512-e7aa905b2829 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:16.864920 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-27b9bec6-097c-47f2-b512-e7aa905b2829 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:16.871182 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-27b9bec6-097c-47f2-b512-e7aa905b2829 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:16.871675 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-27b9bec6-097c-47f2-b512-e7aa905b2829 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:16.872450 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-27b9bec6-097c-47f2-b512-e7aa905b2829 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:16.872890 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-27b9bec6-097c-47f2-b512-e7aa905b2829 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:16.936631 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-27b9bec6-097c-47f2-b512-e7aa905b2829 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:16.944273 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-27b9bec6-097c-47f2-b512-e7aa905b2829 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.083582 Jan 11 15:37:16.944871 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 918/2088] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:16 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:17.962104 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a643af90-d6b4-49f7-97b8-608358f2a43f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:17.962104 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a643af90-d6b4-49f7-97b8-608358f2a43f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:17.968322 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a643af90-d6b4-49f7-97b8-608358f2a43f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:17.968769 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a643af90-d6b4-49f7-97b8-608358f2a43f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:17.970137 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a643af90-d6b4-49f7-97b8-608358f2a43f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:17.970576 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a643af90-d6b4-49f7-97b8-608358f2a43f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:18.028541 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a643af90-d6b4-49f7-97b8-608358f2a43f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:18.036557 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a643af90-d6b4-49f7-97b8-608358f2a43f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.079385 Jan 11 15:37:18.037225 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1171/2089] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:17 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:19.055337 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d21ae28a-4c8f-47f5-8814-49e3cadc0149 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:19.055827 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d21ae28a-4c8f-47f5-8814-49e3cadc0149 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:19.062416 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d21ae28a-4c8f-47f5-8814-49e3cadc0149 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:19.062870 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d21ae28a-4c8f-47f5-8814-49e3cadc0149 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:19.063679 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d21ae28a-4c8f-47f5-8814-49e3cadc0149 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:19.064242 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d21ae28a-4c8f-47f5-8814-49e3cadc0149 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:19.125623 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-d21ae28a-4c8f-47f5-8814-49e3cadc0149 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:19.133816 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d21ae28a-4c8f-47f5-8814-49e3cadc0149 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.084085 Jan 11 15:37:19.134376 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 919/2090] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:19 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:20.150054 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1b964c96-250b-4c90-82b1-c0021260c558 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:20.150890 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1b964c96-250b-4c90-82b1-c0021260c558 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:20.157177 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1b964c96-250b-4c90-82b1-c0021260c558 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:20.157631 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1b964c96-250b-4c90-82b1-c0021260c558 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:20.158415 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1b964c96-250b-4c90-82b1-c0021260c558 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:20.158856 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1b964c96-250b-4c90-82b1-c0021260c558 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:20.222799 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1b964c96-250b-4c90-82b1-c0021260c558 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:20.229130 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1b964c96-250b-4c90-82b1-c0021260c558 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.083227 Jan 11 15:37:20.229841 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1172/2091] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:20 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:21.246304 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-1ea37a18-c0f8-43c1-ae20-a4a4df4d5303 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:21.247002 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-1ea37a18-c0f8-43c1-ae20-a4a4df4d5303 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:21.254842 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1ea37a18-c0f8-43c1-ae20-a4a4df4d5303 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:21.255315 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1ea37a18-c0f8-43c1-ae20-a4a4df4d5303 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:21.259518 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1ea37a18-c0f8-43c1-ae20-a4a4df4d5303 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:21.259518 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1ea37a18-c0f8-43c1-ae20-a4a4df4d5303 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:21.316829 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-1ea37a18-c0f8-43c1-ae20-a4a4df4d5303 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:21.325062 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-1ea37a18-c0f8-43c1-ae20-a4a4df4d5303 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.083070 Jan 11 15:37:21.325622 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 920/2092] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:21 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:22.341505 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5897ccb4-29be-4565-8e45-278ab95a69e7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:22.342112 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5897ccb4-29be-4565-8e45-278ab95a69e7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:22.347800 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5897ccb4-29be-4565-8e45-278ab95a69e7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:22.348252 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5897ccb4-29be-4565-8e45-278ab95a69e7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:22.349031 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5897ccb4-29be-4565-8e45-278ab95a69e7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:22.349465 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5897ccb4-29be-4565-8e45-278ab95a69e7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:22.407858 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-5897ccb4-29be-4565-8e45-278ab95a69e7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:22.416117 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5897ccb4-29be-4565-8e45-278ab95a69e7 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.078353 Jan 11 15:37:22.416678 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1173/2093] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:22 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:23.433440 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a0464aa8-6726-447b-817c-982f1b497336 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:23.434043 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a0464aa8-6726-447b-817c-982f1b497336 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:23.440282 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a0464aa8-6726-447b-817c-982f1b497336 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:23.440739 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a0464aa8-6726-447b-817c-982f1b497336 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:23.441519 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a0464aa8-6726-447b-817c-982f1b497336 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:23.441959 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a0464aa8-6726-447b-817c-982f1b497336 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:23.499477 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-a0464aa8-6726-447b-817c-982f1b497336 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:23.506998 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a0464aa8-6726-447b-817c-982f1b497336 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.077797 Jan 11 15:37:23.507587 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 921/2094] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:23 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:24.524556 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-280d96ee-8f12-49d3-916b-95d625df47a9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:24.525260 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-280d96ee-8f12-49d3-916b-95d625df47a9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:24.531334 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-280d96ee-8f12-49d3-916b-95d625df47a9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:24.531786 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-280d96ee-8f12-49d3-916b-95d625df47a9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:24.532840 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-280d96ee-8f12-49d3-916b-95d625df47a9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:24.533330 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-280d96ee-8f12-49d3-916b-95d625df47a9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:24.595102 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-280d96ee-8f12-49d3-916b-95d625df47a9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:24.603500 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-280d96ee-8f12-49d3-916b-95d625df47a9 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.082724 Jan 11 15:37:24.604073 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1174/2095] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:24 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:37:25.619779 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-bb218ecf-9351-47ae-a9f3-dac623d38a60 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:25.620405 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-bb218ecf-9351-47ae-a9f3-dac623d38a60 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:25.627065 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bb218ecf-9351-47ae-a9f3-dac623d38a60 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:25.627542 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bb218ecf-9351-47ae-a9f3-dac623d38a60 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:25.628320 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bb218ecf-9351-47ae-a9f3-dac623d38a60 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:25.628751 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bb218ecf-9351-47ae-a9f3-dac623d38a60 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:25.687173 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-bb218ecf-9351-47ae-a9f3-dac623d38a60 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:25.694908 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-bb218ecf-9351-47ae-a9f3-dac623d38a60 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.078712 Jan 11 15:37:25.696237 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 922/2096] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:25 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:26.712489 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-78b12d4e-7b8e-4021-b5a1-d21c67e1e320 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:26.713100 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-78b12d4e-7b8e-4021-b5a1-d21c67e1e320 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:26.719313 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-78b12d4e-7b8e-4021-b5a1-d21c67e1e320 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:26.719911 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-78b12d4e-7b8e-4021-b5a1-d21c67e1e320 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:26.720688 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-78b12d4e-7b8e-4021-b5a1-d21c67e1e320 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:26.721133 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-78b12d4e-7b8e-4021-b5a1-d21c67e1e320 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:26.779599 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-78b12d4e-7b8e-4021-b5a1-d21c67e1e320 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:26.787346 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-78b12d4e-7b8e-4021-b5a1-d21c67e1e320 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.078987 Jan 11 15:37:26.787917 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1175/2097] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:26 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:27.804035 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4cb0bf72-7643-4c45-bfad-209168867730 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:27.804653 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4cb0bf72-7643-4c45-bfad-209168867730 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:27.810891 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4cb0bf72-7643-4c45-bfad-209168867730 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:27.811376 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4cb0bf72-7643-4c45-bfad-209168867730 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:27.812164 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4cb0bf72-7643-4c45-bfad-209168867730 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:27.812608 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4cb0bf72-7643-4c45-bfad-209168867730 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:27.869458 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-4cb0bf72-7643-4c45-bfad-209168867730 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:27.877069 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4cb0bf72-7643-4c45-bfad-209168867730 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.076756 Jan 11 15:37:27.877636 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 923/2098] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:27 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:28.894574 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-16fd67fa-ec5a-48a4-90e6-bf48f96c84fa tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:28.895134 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-16fd67fa-ec5a-48a4-90e6-bf48f96c84fa tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:28.902004 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-16fd67fa-ec5a-48a4-90e6-bf48f96c84fa tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:28.902448 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-16fd67fa-ec5a-48a4-90e6-bf48f96c84fa tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:28.903214 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-16fd67fa-ec5a-48a4-90e6-bf48f96c84fa tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:28.903673 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-16fd67fa-ec5a-48a4-90e6-bf48f96c84fa tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:28.962523 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-16fd67fa-ec5a-48a4-90e6-bf48f96c84fa tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:28.970642 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-16fd67fa-ec5a-48a4-90e6-bf48f96c84fa tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.080156 Jan 11 15:37:28.971208 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1176/2099] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:28 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:29.987960 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-86bc5ea7-8bbe-4d4f-9b24-86eebc768657 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:29.988500 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-86bc5ea7-8bbe-4d4f-9b24-86eebc768657 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:29.995271 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-86bc5ea7-8bbe-4d4f-9b24-86eebc768657 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:29.995754 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-86bc5ea7-8bbe-4d4f-9b24-86eebc768657 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:29.996531 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-86bc5ea7-8bbe-4d4f-9b24-86eebc768657 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:29.996970 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-86bc5ea7-8bbe-4d4f-9b24-86eebc768657 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:30.052985 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-86bc5ea7-8bbe-4d4f-9b24-86eebc768657 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:30.061184 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-86bc5ea7-8bbe-4d4f-9b24-86eebc768657 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.076877 Jan 11 15:37:30.061746 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 924/2100] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:29 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:31.078033 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-29c20e11-d7d2-4acd-9a87-56eaac3ac03b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:31.078650 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-29c20e11-d7d2-4acd-9a87-56eaac3ac03b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:31.085151 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-29c20e11-d7d2-4acd-9a87-56eaac3ac03b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:31.085602 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-29c20e11-d7d2-4acd-9a87-56eaac3ac03b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:31.086395 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-29c20e11-d7d2-4acd-9a87-56eaac3ac03b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:31.086828 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-29c20e11-d7d2-4acd-9a87-56eaac3ac03b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:31.146199 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-29c20e11-d7d2-4acd-9a87-56eaac3ac03b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:31.153899 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-29c20e11-d7d2-4acd-9a87-56eaac3ac03b tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.079512 Jan 11 15:37:31.154464 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1177/2101] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:31 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:32.170921 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-0f995235-7356-4f5d-9897-4ed327ab2850 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:32.171497 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-0f995235-7356-4f5d-9897-4ed327ab2850 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:32.177649 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0f995235-7356-4f5d-9897-4ed327ab2850 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:32.178093 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0f995235-7356-4f5d-9897-4ed327ab2850 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:32.178859 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0f995235-7356-4f5d-9897-4ed327ab2850 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:32.179315 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0f995235-7356-4f5d-9897-4ed327ab2850 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:32.236609 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-0f995235-7356-4f5d-9897-4ed327ab2850 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:32.244747 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-0f995235-7356-4f5d-9897-4ed327ab2850 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.077892 Jan 11 15:37:32.245306 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 925/2102] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:32 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:33.261248 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9a126395-3aa1-4a63-87d6-5f5a8dbad101 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:33.261895 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9a126395-3aa1-4a63-87d6-5f5a8dbad101 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:33.268184 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9a126395-3aa1-4a63-87d6-5f5a8dbad101 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:33.268636 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9a126395-3aa1-4a63-87d6-5f5a8dbad101 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:33.269414 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9a126395-3aa1-4a63-87d6-5f5a8dbad101 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:33.269855 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9a126395-3aa1-4a63-87d6-5f5a8dbad101 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:33.326798 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-9a126395-3aa1-4a63-87d6-5f5a8dbad101 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:33.334413 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9a126395-3aa1-4a63-87d6-5f5a8dbad101 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.076841 Jan 11 15:37:33.334979 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1178/2103] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:33 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:34.356289 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-63a94577-e22f-4cf9-8c98-4f971ac42dd2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:34.356929 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-63a94577-e22f-4cf9-8c98-4f971ac42dd2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:34.363069 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-63a94577-e22f-4cf9-8c98-4f971ac42dd2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:34.363556 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-63a94577-e22f-4cf9-8c98-4f971ac42dd2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:34.364322 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-63a94577-e22f-4cf9-8c98-4f971ac42dd2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:34.364754 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-63a94577-e22f-4cf9-8c98-4f971ac42dd2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:34.421795 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-63a94577-e22f-4cf9-8c98-4f971ac42dd2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:34.430096 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-63a94577-e22f-4cf9-8c98-4f971ac42dd2 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.076753 Jan 11 15:37:34.430661 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 926/2104] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:34 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:35.447437 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-151d03ef-75cf-4913-8381-ec63ce7d9428 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:35.448050 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-151d03ef-75cf-4913-8381-ec63ce7d9428 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:35.454319 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-151d03ef-75cf-4913-8381-ec63ce7d9428 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:35.454768 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-151d03ef-75cf-4913-8381-ec63ce7d9428 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:35.455567 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-151d03ef-75cf-4913-8381-ec63ce7d9428 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:35.456007 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-151d03ef-75cf-4913-8381-ec63ce7d9428 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:35.513030 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-151d03ef-75cf-4913-8381-ec63ce7d9428 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:35.520541 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-151d03ef-75cf-4913-8381-ec63ce7d9428 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.077445 Jan 11 15:37:35.521095 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1179/2105] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:35 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:36.536069 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f9126e98-652e-479c-a4a7-e79c033ff4eb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:36.536723 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f9126e98-652e-479c-a4a7-e79c033ff4eb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:36.543983 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f9126e98-652e-479c-a4a7-e79c033ff4eb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:36.544442 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f9126e98-652e-479c-a4a7-e79c033ff4eb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:36.545220 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f9126e98-652e-479c-a4a7-e79c033ff4eb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:36.545665 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f9126e98-652e-479c-a4a7-e79c033ff4eb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:36.602374 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-f9126e98-652e-479c-a4a7-e79c033ff4eb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:36.609918 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f9126e98-652e-479c-a4a7-e79c033ff4eb tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.077526 Jan 11 15:37:36.610494 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 927/2106] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:36 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:37.626474 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-31045c29-21fe-416d-be5d-b2230991fa75 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:37.627736 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-31045c29-21fe-416d-be5d-b2230991fa75 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:37.634749 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-31045c29-21fe-416d-be5d-b2230991fa75 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:37.635223 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-31045c29-21fe-416d-be5d-b2230991fa75 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:37.636042 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-31045c29-21fe-416d-be5d-b2230991fa75 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:37.636479 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-31045c29-21fe-416d-be5d-b2230991fa75 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:37.697263 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-31045c29-21fe-416d-be5d-b2230991fa75 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:37.704914 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-31045c29-21fe-416d-be5d-b2230991fa75 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.082107 Jan 11 15:37:37.705474 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1180/2107] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:37 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:38.720861 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b360f481-336f-4015-bc4a-131f47bb8699 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:38.721486 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b360f481-336f-4015-bc4a-131f47bb8699 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:38.728452 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b360f481-336f-4015-bc4a-131f47bb8699 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:38.728908 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b360f481-336f-4015-bc4a-131f47bb8699 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:38.729688 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b360f481-336f-4015-bc4a-131f47bb8699 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:38.730126 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b360f481-336f-4015-bc4a-131f47bb8699 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:38.787780 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-b360f481-336f-4015-bc4a-131f47bb8699 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:38.795976 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b360f481-336f-4015-bc4a-131f47bb8699 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.078821 Jan 11 15:37:38.796579 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 928/2108] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:38 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:39.812327 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4906f5d8-9b6e-4ccd-af32-55c9c2d80433 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:39.812939 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-4906f5d8-9b6e-4ccd-af32-55c9c2d80433 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:39.819167 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4906f5d8-9b6e-4ccd-af32-55c9c2d80433 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:39.819658 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4906f5d8-9b6e-4ccd-af32-55c9c2d80433 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:39.820431 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4906f5d8-9b6e-4ccd-af32-55c9c2d80433 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:39.820870 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4906f5d8-9b6e-4ccd-af32-55c9c2d80433 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:39.877579 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-4906f5d8-9b6e-4ccd-af32-55c9c2d80433 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:39.885674 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4906f5d8-9b6e-4ccd-af32-55c9c2d80433 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.076969 Jan 11 15:37:39.886237 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1181/2109] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:39 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:40.902542 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d414c040-6bfe-4ca1-bd2c-321a99ad2e21 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:40.903219 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d414c040-6bfe-4ca1-bd2c-321a99ad2e21 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:40.909428 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d414c040-6bfe-4ca1-bd2c-321a99ad2e21 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:40.909884 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d414c040-6bfe-4ca1-bd2c-321a99ad2e21 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:40.910674 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d414c040-6bfe-4ca1-bd2c-321a99ad2e21 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:40.911100 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d414c040-6bfe-4ca1-bd2c-321a99ad2e21 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:40.969007 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-d414c040-6bfe-4ca1-bd2c-321a99ad2e21 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:40.976639 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d414c040-6bfe-4ca1-bd2c-321a99ad2e21 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.078259 Jan 11 15:37:40.977201 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 929/2110] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:40 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:41.994600 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0a0b1f72-042d-4564-bad4-2eb39c3882a0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:41.995145 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0a0b1f72-042d-4564-bad4-2eb39c3882a0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:42.001390 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0a0b1f72-042d-4564-bad4-2eb39c3882a0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:42.001848 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0a0b1f72-042d-4564-bad4-2eb39c3882a0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:42.002631 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0a0b1f72-042d-4564-bad4-2eb39c3882a0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:42.003076 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0a0b1f72-042d-4564-bad4-2eb39c3882a0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:42.060043 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0a0b1f72-042d-4564-bad4-2eb39c3882a0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:42.067537 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0a0b1f72-042d-4564-bad4-2eb39c3882a0 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.077340 Jan 11 15:37:42.068100 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1182/2111] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:41 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:43.084042 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-feecbff2-48ed-4953-bb18-1c2a12af6954 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:43.084646 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-feecbff2-48ed-4953-bb18-1c2a12af6954 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:43.090937 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-feecbff2-48ed-4953-bb18-1c2a12af6954 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:43.091423 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-feecbff2-48ed-4953-bb18-1c2a12af6954 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:43.092211 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-feecbff2-48ed-4953-bb18-1c2a12af6954 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:43.092656 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-feecbff2-48ed-4953-bb18-1c2a12af6954 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:43.149556 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-feecbff2-48ed-4953-bb18-1c2a12af6954 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:43.157061 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-feecbff2-48ed-4953-bb18-1c2a12af6954 tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.076708 Jan 11 15:37:43.157630 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 930/2112] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:43 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:44.173685 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ce5e443d-d625-4baf-b13b-0b549f50986f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:37:44.174376 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ce5e443d-d625-4baf-b13b-0b549f50986f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] [instance: 92cb3dbf-b655-497a-9d23-6036c8b622f6] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:37:44.181246 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ce5e443d-d625-4baf-b13b-0b549f50986f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:44.181704 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ce5e443d-d625-4baf-b13b-0b549f50986f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:44.182486 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ce5e443d-d625-4baf-b13b-0b549f50986f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:37:44.182930 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ce5e443d-d625-4baf-b13b-0b549f50986f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:37:44.242478 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ce5e443d-d625-4baf-b13b-0b549f50986f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8720d62426cf424b9f254574a9babf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc45775f6e34afd92637df5539194e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:37:44.251235 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ce5e443d-d625-4baf-b13b-0b549f50986f tempest-VolumesSnapshotTestJSON-1974446707 tempest-VolumesSnapshotTestJSON-1974446707-project] 10.222.0.52 "GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6" status: 200 len: 1350 microversion: 2.1 time: 0.081252 Jan 11 15:37:44.254812 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1183/2113] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:37:44 2022] GET /compute/v2.1/servers/92cb3dbf-b655-497a-9d23-6036c8b622f6 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:37:45.225322 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:37:45.226223 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: Tue Jan 11 15:37:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:37:45.325775 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:37:45.326244 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: Tue Jan 11 15:37:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:39:05.570124 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f3c26510-9898-4d7d-aea0-a6e08fedc56d tempest-TestVolumeBootPattern-1049221927 tempest-TestVolumeBootPattern-1049221927-project] Action: 'create', calling method: .version_select at 0x7f16ba6ea1f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1763941462"}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:39:05.588600 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.quota [None req-f3c26510-9898-4d7d-aea0-a6e08fedc56d tempest-TestVolumeBootPattern-1049221927 tempest-TestVolumeBootPattern-1049221927-project] Getting quotas for project f31c9233f808402dac7116ed122dd033. Resources: {'key_pairs'} {{(pid=116903) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 15:39:05.592403 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.quota [None req-f3c26510-9898-4d7d-aea0-a6e08fedc56d tempest-TestVolumeBootPattern-1049221927 tempest-TestVolumeBootPattern-1049221927-project] Getting quotas for user 574122deca044c429defe1ba93f6697b and project f31c9233f808402dac7116ed122dd033. Resources: {'key_pairs'} {{(pid=116903) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 15:39:06.018773 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.quota [None req-f3c26510-9898-4d7d-aea0-a6e08fedc56d tempest-TestVolumeBootPattern-1049221927 tempest-TestVolumeBootPattern-1049221927-project] Getting quotas for project f31c9233f808402dac7116ed122dd033. Resources: {'key_pairs'} {{(pid=116903) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 15:39:06.022658 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.quota [None req-f3c26510-9898-4d7d-aea0-a6e08fedc56d tempest-TestVolumeBootPattern-1049221927 tempest-TestVolumeBootPattern-1049221927-project] Getting quotas for user 574122deca044c429defe1ba93f6697b and project f31c9233f808402dac7116ed122dd033. Resources: {'key_pairs'} {{(pid=116903) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 15:39:06.036607 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f3c26510-9898-4d7d-aea0-a6e08fedc56d tempest-TestVolumeBootPattern-1049221927 tempest-TestVolumeBootPattern-1049221927-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.672125 Jan 11 15:39:06.037234 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 931/2114] 10.222.0.52 () {60 vars in 1157 bytes} [Tue Jan 11 15:39:05 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:39:27.025146 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:39:27.025721 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: Tue Jan 11 15:39:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:39:54.681941 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:39:54.682508 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: Tue Jan 11 15:39:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:40:52.360174 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: ERROR oslo.messaging._drivers.impl_rabbit [-] [15385ebf-4fdc-42ea-ab6b-3ea64d361e55] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 11 15:40:52.363508 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c571905c-6e6d-4a4a-997d-b163b46077a4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:40:52.364042 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c571905c-6e6d-4a4a-997d-b163b46077a4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:40:52.374637 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c571905c-6e6d-4a4a-997d-b163b46077a4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:40:52.375085 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c571905c-6e6d-4a4a-997d-b163b46077a4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:40:52.375894 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c571905c-6e6d-4a4a-997d-b163b46077a4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:40:52.376334 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c571905c-6e6d-4a4a-997d-b163b46077a4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:40:52.411046 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c571905c-6e6d-4a4a-997d-b163b46077a4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Going to try to terminate instance {{(pid=116902) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 15:40:52.607052 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c571905c-6e6d-4a4a-997d-b163b46077a4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [a5d44606-fd1c-4213-acda-c02d2fc82212] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 11 15:40:53.375918 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO oslo.messaging._drivers.impl_rabbit [-] [15385ebf-4fdc-42ea-ab6b-3ea64d361e55] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 49936. Jan 11 15:40:53.614203 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO oslo.messaging._drivers.impl_rabbit [None req-c571905c-6e6d-4a4a-997d-b163b46077a4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [a5d44606-fd1c-4213-acda-c02d2fc82212] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 49938. Jan 11 15:40:53.682622 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c571905c-6e6d-4a4a-997d-b163b46077a4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 204 len: 0 microversion: 2.1 time: 1.324612 Jan 11 15:40:53.683513 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1184/2115] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jan 11 15:40:52 2022] DELETE /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 0 bytes in 1326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 15:40:53.689448 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84edaab3-8fd4-4fe8-afdc-3f0d3b8de5ac] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 11 15:40:53.699620 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-856c991c-f578-4135-ad61-c3e6342e6421 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:40:53.699620 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-856c991c-f578-4135-ad61-c3e6342e6421 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:40:53.699861 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-856c991c-f578-4135-ad61-c3e6342e6421 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:40:53.700132 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-856c991c-f578-4135-ad61-c3e6342e6421 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:40:53.700927 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-856c991c-f578-4135-ad61-c3e6342e6421 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:40:53.701362 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-856c991c-f578-4135-ad61-c3e6342e6421 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:40:53.828405 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-856c991c-f578-4135-ad61-c3e6342e6421 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:40:53.835527 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-856c991c-f578-4135-ad61-c3e6342e6421 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1507 microversion: 2.1 time: 0.147775 Jan 11 15:40:53.836081 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 932/2116] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:40:53 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:40:54.852706 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b97b7874-e821-4dbf-8e30-ad76faa2ee39 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:40:54.853339 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b97b7874-e821-4dbf-8e30-ad76faa2ee39 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:40:54.861290 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b97b7874-e821-4dbf-8e30-ad76faa2ee39 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:40:54.861739 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b97b7874-e821-4dbf-8e30-ad76faa2ee39 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:40:54.862511 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b97b7874-e821-4dbf-8e30-ad76faa2ee39 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:40:54.862947 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b97b7874-e821-4dbf-8e30-ad76faa2ee39 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:40:55.029916 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO oslo.messaging._drivers.impl_rabbit [-] [84edaab3-8fd4-4fe8-afdc-3f0d3b8de5ac] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 49964. Jan 11 15:40:55.052574 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b97b7874-e821-4dbf-8e30-ad76faa2ee39 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:40:55.062083 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b97b7874-e821-4dbf-8e30-ad76faa2ee39 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 200 len: 1465 microversion: 2.1 time: 0.213415 Jan 11 15:40:55.063201 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1185/2117] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:40:54 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 1465 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:40:55.087610 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [req-a0ef2774-d2f3-49b0-a5c5-e2aec6c9a02a req-2ddb8c04-cb98-4241-a65a-687e8feeb5bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2127507f-81ad-406d-a9fa-9e4c615184ba", "name": "network-vif-deleted", "tag": "8258f5fe-4e30-4513-9898-eab0cc1ce678"}]} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:40:55.089696 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:40:55.089696 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: warnings.warn(msg) Jan 11 15:40:55.098087 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-a0ef2774-d2f3-49b0-a5c5-e2aec6c9a02a req-2ddb8c04-cb98-4241-a65a-687e8feeb5bc service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:40:55.098862 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-a0ef2774-d2f3-49b0-a5c5-e2aec6c9a02a req-2ddb8c04-cb98-4241-a65a-687e8feeb5bc service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:40:55.110930 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.compute.server_external_events [req-a0ef2774-d2f3-49b0-a5c5-e2aec6c9a02a req-2ddb8c04-cb98-4241-a65a-687e8feeb5bc service nova] Creating event network-vif-deleted:8258f5fe-4e30-4513-9898-eab0cc1ce678 for instance 2127507f-81ad-406d-a9fa-9e4c615184ba on hv-cinder-82418 Jan 11 15:40:55.116785 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [req-a0ef2774-d2f3-49b0-a5c5-e2aec6c9a02a req-2ddb8c04-cb98-4241-a65a-687e8feeb5bc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101315 Jan 11 15:40:55.118145 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 933/2118] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:40:56.079385 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-32047d99-d8a6-44c2-b97c-8259dd6c41a1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:40:56.079991 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-32047d99-d8a6-44c2-b97c-8259dd6c41a1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 2127507f-81ad-406d-a9fa-9e4c615184ba] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:40:56.087024 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-32047d99-d8a6-44c2-b97c-8259dd6c41a1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:40:56.087525 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-32047d99-d8a6-44c2-b97c-8259dd6c41a1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:40:56.088311 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-32047d99-d8a6-44c2-b97c-8259dd6c41a1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:40:56.088755 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-32047d99-d8a6-44c2-b97c-8259dd6c41a1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:40:56.101657 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.wsgi [None req-32047d99-d8a6-44c2-b97c-8259dd6c41a1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] HTTP exception thrown: Instance 2127507f-81ad-406d-a9fa-9e4c615184ba could not be found. Jan 11 15:40:56.102245 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-32047d99-d8a6-44c2-b97c-8259dd6c41a1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Returning 404 to user: Instance 2127507f-81ad-406d-a9fa-9e4c615184ba could not be found. {{(pid=116902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:40:56.103060 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-32047d99-d8a6-44c2-b97c-8259dd6c41a1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba" status: 404 len: 111 microversion: 2.1 time: 0.027391 Jan 11 15:40:56.103616 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1186/2119] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:40:56 2022] GET /compute/v2.1/servers/2127507f-81ad-406d-a9fa-9e4c615184ba => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 15:40:56.112470 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-66ed86ef-ed03-4db2-8d1d-7282315d5eef tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:40:56.117618 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-66ed86ef-ed03-4db2-8d1d-7282315d5eef tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:40:56.119092 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-66ed86ef-ed03-4db2-8d1d-7282315d5eef tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:40:56.119567 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-66ed86ef-ed03-4db2-8d1d-7282315d5eef tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:40:56.120357 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-66ed86ef-ed03-4db2-8d1d-7282315d5eef tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:40:56.120790 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-66ed86ef-ed03-4db2-8d1d-7282315d5eef tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:40:56.144717 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-66ed86ef-ed03-4db2-8d1d-7282315d5eef tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Going to try to terminate instance {{(pid=116903) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 15:40:56.403903 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-66ed86ef-ed03-4db2-8d1d-7282315d5eef tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 204 len: 0 microversion: 2.1 time: 0.295453 Jan 11 15:40:56.404395 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 934/2120] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jan 11 15:40:56 2022] DELETE /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 15:40:56.412353 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5ac1a395-e477-4540-af88-3149e84aa7d6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:40:56.412943 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5ac1a395-e477-4540-af88-3149e84aa7d6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:40:56.418749 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5ac1a395-e477-4540-af88-3149e84aa7d6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:40:56.419193 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5ac1a395-e477-4540-af88-3149e84aa7d6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:40:56.420029 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5ac1a395-e477-4540-af88-3149e84aa7d6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:40:56.420469 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5ac1a395-e477-4540-af88-3149e84aa7d6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:40:56.550022 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-5ac1a395-e477-4540-af88-3149e84aa7d6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:40:56.558298 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5ac1a395-e477-4540-af88-3149e84aa7d6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1568 microversion: 2.1 time: 0.149877 Jan 11 15:40:56.558964 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1187/2121] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:40:56 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:40:57.576335 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b4521e2a-511c-411f-a84b-3d19043372eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:40:57.577030 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b4521e2a-511c-411f-a84b-3d19043372eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:40:57.583230 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b4521e2a-511c-411f-a84b-3d19043372eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:40:57.583718 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b4521e2a-511c-411f-a84b-3d19043372eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:40:57.584507 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b4521e2a-511c-411f-a84b-3d19043372eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:40:57.584947 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b4521e2a-511c-411f-a84b-3d19043372eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:40:57.786952 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-b4521e2a-511c-411f-a84b-3d19043372eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:40:57.794933 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b4521e2a-511c-411f-a84b-3d19043372eb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1568 microversion: 2.1 time: 0.222685 Jan 11 15:40:57.795521 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 935/2122] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:40:57 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:40:58.037368 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-49af13e8-8812-4a35-9767-55e4fb8e3956 req-e46361ef-4161-4cc1-8a60-e4b24edf47c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b978091-0bf4-4e69-8053-76e49154df4c", "name": "network-vif-deleted", "tag": "bf027a14-5183-43e1-9c6a-261c8c11f0ec"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:40:58.039020 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:40:58.039020 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:40:58.046559 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-49af13e8-8812-4a35-9767-55e4fb8e3956 req-e46361ef-4161-4cc1-8a60-e4b24edf47c7 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:40:58.055766 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-49af13e8-8812-4a35-9767-55e4fb8e3956 req-e46361ef-4161-4cc1-8a60-e4b24edf47c7 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:40:58.058978 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-49af13e8-8812-4a35-9767-55e4fb8e3956 req-e46361ef-4161-4cc1-8a60-e4b24edf47c7 service nova] Creating event network-vif-deleted:bf027a14-5183-43e1-9c6a-261c8c11f0ec for instance 3b978091-0bf4-4e69-8053-76e49154df4c on hv-cinder-82418 Jan 11 15:40:58.064076 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [req-49af13e8-8812-4a35-9767-55e4fb8e3956 req-e46361ef-4161-4cc1-8a60-e4b24edf47c7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030539 Jan 11 15:40:58.064717 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1188/2123] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:40:58.811186 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-6be8b05b-2bca-4d91-a965-91297379583c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:40:58.811850 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-6be8b05b-2bca-4d91-a965-91297379583c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:40:58.818141 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6be8b05b-2bca-4d91-a965-91297379583c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:40:58.818596 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6be8b05b-2bca-4d91-a965-91297379583c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:40:58.819407 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6be8b05b-2bca-4d91-a965-91297379583c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:40:58.819861 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6be8b05b-2bca-4d91-a965-91297379583c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:40:58.878859 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-6be8b05b-2bca-4d91-a965-91297379583c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:40:58.886923 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-6be8b05b-2bca-4d91-a965-91297379583c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.079361 Jan 11 15:40:58.887518 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 936/2124] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:40:58 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:40:59.904459 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-bfbc489e-f1fc-4b8c-bde0-8275e2ae9422 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:40:59.905163 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-bfbc489e-f1fc-4b8c-bde0-8275e2ae9422 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:40:59.911883 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bfbc489e-f1fc-4b8c-bde0-8275e2ae9422 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:40:59.912339 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bfbc489e-f1fc-4b8c-bde0-8275e2ae9422 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:40:59.913114 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bfbc489e-f1fc-4b8c-bde0-8275e2ae9422 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:40:59.913557 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bfbc489e-f1fc-4b8c-bde0-8275e2ae9422 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:40:59.972092 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-bfbc489e-f1fc-4b8c-bde0-8275e2ae9422 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:40:59.979696 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-bfbc489e-f1fc-4b8c-bde0-8275e2ae9422 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.079852 Jan 11 15:40:59.980324 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1189/2125] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:40:59 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:00.995981 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-8939c915-768d-467b-a754-3aa9546b3da3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:00.996593 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-8939c915-768d-467b-a754-3aa9546b3da3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:01.002814 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8939c915-768d-467b-a754-3aa9546b3da3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:01.003266 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8939c915-768d-467b-a754-3aa9546b3da3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:01.004065 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8939c915-768d-467b-a754-3aa9546b3da3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:01.004502 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8939c915-768d-467b-a754-3aa9546b3da3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:01.061817 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-8939c915-768d-467b-a754-3aa9546b3da3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:01.069419 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-8939c915-768d-467b-a754-3aa9546b3da3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077124 Jan 11 15:41:01.069986 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 937/2126] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:00 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:02.086117 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a5925d0b-0620-4487-b552-3edf8b14f3ce tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:02.086715 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a5925d0b-0620-4487-b552-3edf8b14f3ce tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:02.093036 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a5925d0b-0620-4487-b552-3edf8b14f3ce tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:02.093489 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a5925d0b-0620-4487-b552-3edf8b14f3ce tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:02.094271 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a5925d0b-0620-4487-b552-3edf8b14f3ce tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:02.094721 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a5925d0b-0620-4487-b552-3edf8b14f3ce tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:02.157968 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a5925d0b-0620-4487-b552-3edf8b14f3ce tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:02.166543 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a5925d0b-0620-4487-b552-3edf8b14f3ce tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.083529 Jan 11 15:41:02.167104 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1190/2127] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:02 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:03.183402 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-98914ebd-28c8-43ea-8fc1-9b0c23987178 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:03.184017 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-98914ebd-28c8-43ea-8fc1-9b0c23987178 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:03.190331 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-98914ebd-28c8-43ea-8fc1-9b0c23987178 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:03.190790 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-98914ebd-28c8-43ea-8fc1-9b0c23987178 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:03.191593 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-98914ebd-28c8-43ea-8fc1-9b0c23987178 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:03.192038 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-98914ebd-28c8-43ea-8fc1-9b0c23987178 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:03.252344 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-98914ebd-28c8-43ea-8fc1-9b0c23987178 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:03.261562 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-98914ebd-28c8-43ea-8fc1-9b0c23987178 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.082298 Jan 11 15:41:03.263032 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 938/2128] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:03 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:04.278358 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-bb047c5b-d032-4e7f-b058-854ad403206d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:04.278978 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-bb047c5b-d032-4e7f-b058-854ad403206d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:04.285539 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bb047c5b-d032-4e7f-b058-854ad403206d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:04.285994 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bb047c5b-d032-4e7f-b058-854ad403206d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:04.286778 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bb047c5b-d032-4e7f-b058-854ad403206d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:04.287273 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bb047c5b-d032-4e7f-b058-854ad403206d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:04.344186 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-bb047c5b-d032-4e7f-b058-854ad403206d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:04.351949 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-bb047c5b-d032-4e7f-b058-854ad403206d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077959 Jan 11 15:41:04.352512 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1191/2129] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:04 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:05.233979 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:41:05.234256 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: Tue Jan 11 15:41:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:41:05.334869 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:41:05.335373 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: Tue Jan 11 15:41:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:41:05.367928 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-49551db0-999f-4b9d-b311-c6ef5aad7c4a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:05.368556 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-49551db0-999f-4b9d-b311-c6ef5aad7c4a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:05.375067 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-49551db0-999f-4b9d-b311-c6ef5aad7c4a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:05.375547 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-49551db0-999f-4b9d-b311-c6ef5aad7c4a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:05.376310 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-49551db0-999f-4b9d-b311-c6ef5aad7c4a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:05.376742 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-49551db0-999f-4b9d-b311-c6ef5aad7c4a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:05.436064 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-49551db0-999f-4b9d-b311-c6ef5aad7c4a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:05.443761 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-49551db0-999f-4b9d-b311-c6ef5aad7c4a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.079276 Jan 11 15:41:05.444319 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 939/2130] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:05 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:06.460280 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-062440a3-d108-4ac1-a487-58921bbc7fdb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:06.460880 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-062440a3-d108-4ac1-a487-58921bbc7fdb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:06.467435 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-062440a3-d108-4ac1-a487-58921bbc7fdb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:06.467841 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-062440a3-d108-4ac1-a487-58921bbc7fdb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:06.468620 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-062440a3-d108-4ac1-a487-58921bbc7fdb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:06.469070 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-062440a3-d108-4ac1-a487-58921bbc7fdb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:06.527429 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-062440a3-d108-4ac1-a487-58921bbc7fdb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:06.535237 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-062440a3-d108-4ac1-a487-58921bbc7fdb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.078720 Jan 11 15:41:06.535826 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1192/2131] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:06 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:07.552092 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a3b92e72-e9c1-438e-b1e8-1f0de616f3d4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:07.552690 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a3b92e72-e9c1-438e-b1e8-1f0de616f3d4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:07.558942 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a3b92e72-e9c1-438e-b1e8-1f0de616f3d4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:07.559427 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a3b92e72-e9c1-438e-b1e8-1f0de616f3d4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:07.560200 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a3b92e72-e9c1-438e-b1e8-1f0de616f3d4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:07.560636 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a3b92e72-e9c1-438e-b1e8-1f0de616f3d4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:07.616870 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-a3b92e72-e9c1-438e-b1e8-1f0de616f3d4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:07.624731 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a3b92e72-e9c1-438e-b1e8-1f0de616f3d4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076280 Jan 11 15:41:07.625294 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 940/2132] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:07 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:41:08.641235 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2797133e-0a9a-43d0-bb4a-778c38ec9349 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:08.641848 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2797133e-0a9a-43d0-bb4a-778c38ec9349 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:08.648036 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2797133e-0a9a-43d0-bb4a-778c38ec9349 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:08.648490 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2797133e-0a9a-43d0-bb4a-778c38ec9349 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:08.649264 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2797133e-0a9a-43d0-bb4a-778c38ec9349 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:08.649706 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2797133e-0a9a-43d0-bb4a-778c38ec9349 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:08.707380 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-2797133e-0a9a-43d0-bb4a-778c38ec9349 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:08.715015 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2797133e-0a9a-43d0-bb4a-778c38ec9349 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077410 Jan 11 15:41:08.715606 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1193/2133] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:08 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:09.731098 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-edc7433c-657b-4bb2-96f3-8c6496069f9e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:09.731739 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-edc7433c-657b-4bb2-96f3-8c6496069f9e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:09.737968 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-edc7433c-657b-4bb2-96f3-8c6496069f9e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:09.738412 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-edc7433c-657b-4bb2-96f3-8c6496069f9e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:09.739183 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-edc7433c-657b-4bb2-96f3-8c6496069f9e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:09.739651 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-edc7433c-657b-4bb2-96f3-8c6496069f9e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:09.800979 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-edc7433c-657b-4bb2-96f3-8c6496069f9e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:09.809138 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-edc7433c-657b-4bb2-96f3-8c6496069f9e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.081692 Jan 11 15:41:09.809694 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 941/2134] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:09 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:10.826007 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-bc4c0bf3-568d-4b74-91ae-f37522a9403e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:10.826650 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-bc4c0bf3-568d-4b74-91ae-f37522a9403e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:10.832915 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bc4c0bf3-568d-4b74-91ae-f37522a9403e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:10.833368 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bc4c0bf3-568d-4b74-91ae-f37522a9403e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:10.834133 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bc4c0bf3-568d-4b74-91ae-f37522a9403e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:10.834572 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bc4c0bf3-568d-4b74-91ae-f37522a9403e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:10.891085 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-bc4c0bf3-568d-4b74-91ae-f37522a9403e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:10.898684 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-bc4c0bf3-568d-4b74-91ae-f37522a9403e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076819 Jan 11 15:41:10.899238 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1194/2135] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:10 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:11.916497 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-6d788b71-5e9f-4aa0-96e0-47023d42c4b9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:11.917125 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-6d788b71-5e9f-4aa0-96e0-47023d42c4b9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:11.923503 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6d788b71-5e9f-4aa0-96e0-47023d42c4b9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:11.923977 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6d788b71-5e9f-4aa0-96e0-47023d42c4b9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:11.924718 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6d788b71-5e9f-4aa0-96e0-47023d42c4b9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:11.925152 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6d788b71-5e9f-4aa0-96e0-47023d42c4b9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:11.984422 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-6d788b71-5e9f-4aa0-96e0-47023d42c4b9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:11.992108 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-6d788b71-5e9f-4aa0-96e0-47023d42c4b9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.079926 Jan 11 15:41:11.992658 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 942/2136] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:11 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:41:13.009773 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-78547011-00b8-4fdf-98bb-657c06e1f888 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:13.010392 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-78547011-00b8-4fdf-98bb-657c06e1f888 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:13.016731 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-78547011-00b8-4fdf-98bb-657c06e1f888 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:13.017185 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-78547011-00b8-4fdf-98bb-657c06e1f888 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:13.017964 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-78547011-00b8-4fdf-98bb-657c06e1f888 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:13.018408 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-78547011-00b8-4fdf-98bb-657c06e1f888 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:13.075408 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-78547011-00b8-4fdf-98bb-657c06e1f888 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:13.082970 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-78547011-00b8-4fdf-98bb-657c06e1f888 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077505 Jan 11 15:41:13.083567 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1195/2137] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:13 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:14.100010 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-26fca9b7-7a30-4c9b-875f-80dfc27acc05 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:14.100622 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-26fca9b7-7a30-4c9b-875f-80dfc27acc05 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:14.107476 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-26fca9b7-7a30-4c9b-875f-80dfc27acc05 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:14.107927 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-26fca9b7-7a30-4c9b-875f-80dfc27acc05 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:14.108702 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-26fca9b7-7a30-4c9b-875f-80dfc27acc05 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:14.109147 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-26fca9b7-7a30-4c9b-875f-80dfc27acc05 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:14.168586 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-26fca9b7-7a30-4c9b-875f-80dfc27acc05 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:14.176182 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-26fca9b7-7a30-4c9b-875f-80dfc27acc05 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.079902 Jan 11 15:41:14.176736 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 943/2138] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:14 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:15.192231 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-61c2398a-9e4f-4a25-a11a-a0b3828ee655 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:15.192844 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-61c2398a-9e4f-4a25-a11a-a0b3828ee655 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:15.200123 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-61c2398a-9e4f-4a25-a11a-a0b3828ee655 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:15.200575 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-61c2398a-9e4f-4a25-a11a-a0b3828ee655 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:15.201345 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-61c2398a-9e4f-4a25-a11a-a0b3828ee655 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:15.201786 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-61c2398a-9e4f-4a25-a11a-a0b3828ee655 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:15.258432 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-61c2398a-9e4f-4a25-a11a-a0b3828ee655 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:15.266941 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-61c2398a-9e4f-4a25-a11a-a0b3828ee655 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.078444 Jan 11 15:41:15.267566 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1196/2139] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:15 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:16.284073 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-48671f24-6d7f-4833-a5b1-e94ca49586f3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:16.284682 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-48671f24-6d7f-4833-a5b1-e94ca49586f3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:16.291046 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-48671f24-6d7f-4833-a5b1-e94ca49586f3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:16.291538 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-48671f24-6d7f-4833-a5b1-e94ca49586f3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:16.292322 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-48671f24-6d7f-4833-a5b1-e94ca49586f3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:16.292766 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-48671f24-6d7f-4833-a5b1-e94ca49586f3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:16.352874 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-48671f24-6d7f-4833-a5b1-e94ca49586f3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:16.360586 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-48671f24-6d7f-4833-a5b1-e94ca49586f3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.080568 Jan 11 15:41:16.361146 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 944/2140] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:16 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:17.377077 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9a9b11cd-2810-424f-864b-ce07e38d6da1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:17.377685 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9a9b11cd-2810-424f-864b-ce07e38d6da1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:17.384327 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9a9b11cd-2810-424f-864b-ce07e38d6da1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:17.384771 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9a9b11cd-2810-424f-864b-ce07e38d6da1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:17.385616 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9a9b11cd-2810-424f-864b-ce07e38d6da1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:17.386050 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9a9b11cd-2810-424f-864b-ce07e38d6da1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:17.442636 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-9a9b11cd-2810-424f-864b-ce07e38d6da1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:17.450425 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9a9b11cd-2810-424f-864b-ce07e38d6da1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076988 Jan 11 15:41:17.450975 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1197/2141] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:17 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:18.466248 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2970034f-d41c-4691-a7b7-ccf6db3e7b3d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:18.466856 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2970034f-d41c-4691-a7b7-ccf6db3e7b3d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:18.473136 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2970034f-d41c-4691-a7b7-ccf6db3e7b3d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:18.473580 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2970034f-d41c-4691-a7b7-ccf6db3e7b3d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:18.474371 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2970034f-d41c-4691-a7b7-ccf6db3e7b3d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:18.474808 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2970034f-d41c-4691-a7b7-ccf6db3e7b3d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:18.531117 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-2970034f-d41c-4691-a7b7-ccf6db3e7b3d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:18.538826 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2970034f-d41c-4691-a7b7-ccf6db3e7b3d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076204 Jan 11 15:41:18.539386 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 945/2142] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:18 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:19.556149 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1ae239c7-9e76-4229-aa1e-0b2b20aaa38c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:19.556744 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1ae239c7-9e76-4229-aa1e-0b2b20aaa38c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:19.562875 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1ae239c7-9e76-4229-aa1e-0b2b20aaa38c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:19.563357 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1ae239c7-9e76-4229-aa1e-0b2b20aaa38c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:19.564137 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1ae239c7-9e76-4229-aa1e-0b2b20aaa38c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:19.564576 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1ae239c7-9e76-4229-aa1e-0b2b20aaa38c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:19.621674 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1ae239c7-9e76-4229-aa1e-0b2b20aaa38c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:19.629521 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1ae239c7-9e76-4229-aa1e-0b2b20aaa38c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077779 Jan 11 15:41:19.630062 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1198/2143] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:19 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:20.645651 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c946fff0-f3f4-4eff-8cf5-0302badc3985 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:20.650484 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c946fff0-f3f4-4eff-8cf5-0302badc3985 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:20.653144 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c946fff0-f3f4-4eff-8cf5-0302badc3985 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:20.653595 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c946fff0-f3f4-4eff-8cf5-0302badc3985 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:20.654392 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c946fff0-f3f4-4eff-8cf5-0302badc3985 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:20.654829 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c946fff0-f3f4-4eff-8cf5-0302badc3985 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:20.711348 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-c946fff0-f3f4-4eff-8cf5-0302badc3985 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:20.719601 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c946fff0-f3f4-4eff-8cf5-0302badc3985 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077600 Jan 11 15:41:20.720169 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 946/2144] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:20 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:21.736152 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ad05cf35-6512-4fd0-af18-824cf5ef77b3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:21.736716 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ad05cf35-6512-4fd0-af18-824cf5ef77b3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:21.743525 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ad05cf35-6512-4fd0-af18-824cf5ef77b3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:21.743986 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ad05cf35-6512-4fd0-af18-824cf5ef77b3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:21.744767 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ad05cf35-6512-4fd0-af18-824cf5ef77b3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:21.745213 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ad05cf35-6512-4fd0-af18-824cf5ef77b3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:21.804841 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ad05cf35-6512-4fd0-af18-824cf5ef77b3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:21.813156 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ad05cf35-6512-4fd0-af18-824cf5ef77b3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.080672 Jan 11 15:41:21.813753 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1199/2145] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:21 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:22.829368 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-cb566027-a066-459b-a44d-085dde45ebf0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:22.829980 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-cb566027-a066-459b-a44d-085dde45ebf0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:22.836262 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cb566027-a066-459b-a44d-085dde45ebf0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:22.836704 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cb566027-a066-459b-a44d-085dde45ebf0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:22.837478 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cb566027-a066-459b-a44d-085dde45ebf0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:22.837919 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cb566027-a066-459b-a44d-085dde45ebf0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:22.897525 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-cb566027-a066-459b-a44d-085dde45ebf0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:22.905102 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-cb566027-a066-459b-a44d-085dde45ebf0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.079380 Jan 11 15:41:22.905662 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 947/2146] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:22 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:23.921708 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c9fe9474-8f04-446d-ac74-77f66fa49bf1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:23.922317 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c9fe9474-8f04-446d-ac74-77f66fa49bf1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:23.928245 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c9fe9474-8f04-446d-ac74-77f66fa49bf1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:23.928690 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c9fe9474-8f04-446d-ac74-77f66fa49bf1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:23.929455 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c9fe9474-8f04-446d-ac74-77f66fa49bf1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:23.929892 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c9fe9474-8f04-446d-ac74-77f66fa49bf1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:23.986367 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c9fe9474-8f04-446d-ac74-77f66fa49bf1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:23.993994 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c9fe9474-8f04-446d-ac74-77f66fa49bf1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.075961 Jan 11 15:41:23.994549 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1200/2147] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:23 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:25.010455 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c4b45142-1c8c-4dfc-8f6b-351f5866c093 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:25.011188 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c4b45142-1c8c-4dfc-8f6b-351f5866c093 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:25.017520 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c4b45142-1c8c-4dfc-8f6b-351f5866c093 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:25.017969 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c4b45142-1c8c-4dfc-8f6b-351f5866c093 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:25.018759 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c4b45142-1c8c-4dfc-8f6b-351f5866c093 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:25.019197 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c4b45142-1c8c-4dfc-8f6b-351f5866c093 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:25.083820 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-c4b45142-1c8c-4dfc-8f6b-351f5866c093 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:25.091736 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c4b45142-1c8c-4dfc-8f6b-351f5866c093 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.085637 Jan 11 15:41:25.092900 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 948/2148] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:25 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:26.108358 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-74ecc570-4bab-4700-bf1f-b08bd1862295 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:26.108963 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-74ecc570-4bab-4700-bf1f-b08bd1862295 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:26.115128 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-74ecc570-4bab-4700-bf1f-b08bd1862295 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:26.115607 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-74ecc570-4bab-4700-bf1f-b08bd1862295 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:26.116368 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-74ecc570-4bab-4700-bf1f-b08bd1862295 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:26.116804 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-74ecc570-4bab-4700-bf1f-b08bd1862295 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:26.173509 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-74ecc570-4bab-4700-bf1f-b08bd1862295 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:26.181632 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-74ecc570-4bab-4700-bf1f-b08bd1862295 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077148 Jan 11 15:41:26.182189 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1201/2149] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:26 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:41:27.197638 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7d40f0c6-6bb4-4e38-b7e0-664652b49446 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:27.198260 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7d40f0c6-6bb4-4e38-b7e0-664652b49446 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:27.204494 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7d40f0c6-6bb4-4e38-b7e0-664652b49446 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:27.204983 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7d40f0c6-6bb4-4e38-b7e0-664652b49446 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:27.205756 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7d40f0c6-6bb4-4e38-b7e0-664652b49446 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:27.206198 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7d40f0c6-6bb4-4e38-b7e0-664652b49446 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:27.268429 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-7d40f0c6-6bb4-4e38-b7e0-664652b49446 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:27.276728 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7d40f0c6-6bb4-4e38-b7e0-664652b49446 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.082788 Jan 11 15:41:27.277302 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 949/2150] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:27 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:28.293493 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c32b44ec-3c4b-4257-bab0-c66aea34ea0c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:28.294102 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c32b44ec-3c4b-4257-bab0-c66aea34ea0c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:28.300367 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c32b44ec-3c4b-4257-bab0-c66aea34ea0c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:28.300815 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c32b44ec-3c4b-4257-bab0-c66aea34ea0c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:28.301584 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c32b44ec-3c4b-4257-bab0-c66aea34ea0c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:28.302022 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c32b44ec-3c4b-4257-bab0-c66aea34ea0c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:28.364900 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c32b44ec-3c4b-4257-bab0-c66aea34ea0c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:28.372725 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c32b44ec-3c4b-4257-bab0-c66aea34ea0c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.083010 Jan 11 15:41:28.373283 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1202/2151] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:28 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:29.389033 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d834d28f-f1b6-4f35-88fe-517633b01ee5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:29.392000 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d834d28f-f1b6-4f35-88fe-517633b01ee5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:29.396129 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d834d28f-f1b6-4f35-88fe-517633b01ee5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:29.396583 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d834d28f-f1b6-4f35-88fe-517633b01ee5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:29.397363 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d834d28f-f1b6-4f35-88fe-517633b01ee5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:29.397806 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-d834d28f-f1b6-4f35-88fe-517633b01ee5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:29.455150 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-d834d28f-f1b6-4f35-88fe-517633b01ee5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:29.463545 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d834d28f-f1b6-4f35-88fe-517633b01ee5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.078135 Jan 11 15:41:29.464111 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 950/2152] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:29 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:30.479886 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-26e0f899-3e00-4534-99c4-280faf5971c9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:30.480518 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-26e0f899-3e00-4534-99c4-280faf5971c9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:30.486955 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-26e0f899-3e00-4534-99c4-280faf5971c9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:30.487450 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-26e0f899-3e00-4534-99c4-280faf5971c9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:30.488246 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-26e0f899-3e00-4534-99c4-280faf5971c9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:30.488694 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-26e0f899-3e00-4534-99c4-280faf5971c9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:30.546016 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-26e0f899-3e00-4534-99c4-280faf5971c9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:30.553576 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-26e0f899-3e00-4534-99c4-280faf5971c9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077358 Jan 11 15:41:30.554135 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1203/2153] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:30 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:31.570333 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4d16b0b9-c241-4025-bbce-40c8f905a3fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:31.570876 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4d16b0b9-c241-4025-bbce-40c8f905a3fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:31.577175 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4d16b0b9-c241-4025-bbce-40c8f905a3fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:31.577626 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4d16b0b9-c241-4025-bbce-40c8f905a3fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:31.578414 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4d16b0b9-c241-4025-bbce-40c8f905a3fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:31.578850 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4d16b0b9-c241-4025-bbce-40c8f905a3fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:31.635420 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-4d16b0b9-c241-4025-bbce-40c8f905a3fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:31.643011 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4d16b0b9-c241-4025-bbce-40c8f905a3fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076430 Jan 11 15:41:31.643612 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 951/2154] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:31 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:32.660244 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6d2be8a3-264d-4024-a8c7-73c48f83b5d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:32.660815 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6d2be8a3-264d-4024-a8c7-73c48f83b5d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:32.667612 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6d2be8a3-264d-4024-a8c7-73c48f83b5d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:32.668066 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6d2be8a3-264d-4024-a8c7-73c48f83b5d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:32.668874 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6d2be8a3-264d-4024-a8c7-73c48f83b5d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:32.669318 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6d2be8a3-264d-4024-a8c7-73c48f83b5d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:32.725498 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6d2be8a3-264d-4024-a8c7-73c48f83b5d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:32.733640 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6d2be8a3-264d-4024-a8c7-73c48f83b5d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077420 Jan 11 15:41:32.734205 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1204/2155] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:32 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:33.750526 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-12e0233a-32f3-4751-b418-15453b1e7c75 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:33.751099 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-12e0233a-32f3-4751-b418-15453b1e7c75 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:33.757247 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-12e0233a-32f3-4751-b418-15453b1e7c75 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:33.757693 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-12e0233a-32f3-4751-b418-15453b1e7c75 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:33.758460 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-12e0233a-32f3-4751-b418-15453b1e7c75 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:33.758892 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-12e0233a-32f3-4751-b418-15453b1e7c75 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:33.817773 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-12e0233a-32f3-4751-b418-15453b1e7c75 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:33.825215 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-12e0233a-32f3-4751-b418-15453b1e7c75 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.078434 Jan 11 15:41:33.825777 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 952/2156] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:33 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:34.841332 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-fc02560b-cb1f-4abc-b4a1-d89b3d6a6835 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:34.841923 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-fc02560b-cb1f-4abc-b4a1-d89b3d6a6835 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:34.848329 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fc02560b-cb1f-4abc-b4a1-d89b3d6a6835 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:34.848777 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fc02560b-cb1f-4abc-b4a1-d89b3d6a6835 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:34.849545 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fc02560b-cb1f-4abc-b4a1-d89b3d6a6835 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:34.849981 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fc02560b-cb1f-4abc-b4a1-d89b3d6a6835 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:34.907447 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-fc02560b-cb1f-4abc-b4a1-d89b3d6a6835 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:34.915831 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-fc02560b-cb1f-4abc-b4a1-d89b3d6a6835 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.078132 Jan 11 15:41:34.916395 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1205/2157] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:34 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:35.931171 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-5c32db17-f790-4bfe-8693-937f4427061a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:35.931894 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-5c32db17-f790-4bfe-8693-937f4427061a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:35.938054 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5c32db17-f790-4bfe-8693-937f4427061a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:35.938500 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5c32db17-f790-4bfe-8693-937f4427061a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:35.939267 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5c32db17-f790-4bfe-8693-937f4427061a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:35.939721 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5c32db17-f790-4bfe-8693-937f4427061a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:35.996941 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-5c32db17-f790-4bfe-8693-937f4427061a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:36.004474 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-5c32db17-f790-4bfe-8693-937f4427061a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076977 Jan 11 15:41:36.005032 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 953/2158] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:35 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:37.020845 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-dee3fb79-8193-4577-81d5-6e7f205a4553 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:37.021455 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-dee3fb79-8193-4577-81d5-6e7f205a4553 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:37.027719 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dee3fb79-8193-4577-81d5-6e7f205a4553 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:37.028179 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dee3fb79-8193-4577-81d5-6e7f205a4553 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:37.028961 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dee3fb79-8193-4577-81d5-6e7f205a4553 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:37.029405 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dee3fb79-8193-4577-81d5-6e7f205a4553 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:37.087855 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-dee3fb79-8193-4577-81d5-6e7f205a4553 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:37.095453 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-dee3fb79-8193-4577-81d5-6e7f205a4553 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.078313 Jan 11 15:41:37.096025 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1206/2159] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:37 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:38.112215 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f4d1c7bd-750e-4174-b78b-33e81690fe99 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:38.112831 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f4d1c7bd-750e-4174-b78b-33e81690fe99 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:38.119006 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f4d1c7bd-750e-4174-b78b-33e81690fe99 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:38.119491 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f4d1c7bd-750e-4174-b78b-33e81690fe99 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:38.120261 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f4d1c7bd-750e-4174-b78b-33e81690fe99 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:38.120697 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f4d1c7bd-750e-4174-b78b-33e81690fe99 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:38.177196 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-f4d1c7bd-750e-4174-b78b-33e81690fe99 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:38.185283 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f4d1c7bd-750e-4174-b78b-33e81690fe99 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076712 Jan 11 15:41:38.185878 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 954/2160] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:38 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:39.201935 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2e7f7468-598e-405f-a02d-0835379418aa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:39.203170 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2e7f7468-598e-405f-a02d-0835379418aa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:39.209718 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2e7f7468-598e-405f-a02d-0835379418aa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:39.210188 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2e7f7468-598e-405f-a02d-0835379418aa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:39.211479 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2e7f7468-598e-405f-a02d-0835379418aa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:39.211923 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2e7f7468-598e-405f-a02d-0835379418aa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:39.270083 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-2e7f7468-598e-405f-a02d-0835379418aa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:39.278509 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2e7f7468-598e-405f-a02d-0835379418aa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.080277 Jan 11 15:41:39.279078 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1207/2161] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:39 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:40.295246 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-30dcbafa-752c-4ba2-b04e-0b0bbc1e093e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:40.295888 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-30dcbafa-752c-4ba2-b04e-0b0bbc1e093e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:40.302259 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-30dcbafa-752c-4ba2-b04e-0b0bbc1e093e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:40.302713 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-30dcbafa-752c-4ba2-b04e-0b0bbc1e093e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:40.303535 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-30dcbafa-752c-4ba2-b04e-0b0bbc1e093e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:40.303973 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-30dcbafa-752c-4ba2-b04e-0b0bbc1e093e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:40.363169 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-30dcbafa-752c-4ba2-b04e-0b0bbc1e093e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:40.370602 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-30dcbafa-752c-4ba2-b04e-0b0bbc1e093e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.079062 Jan 11 15:41:40.371152 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 955/2162] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:40 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:41.386993 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a9ffc87f-3a90-47d7-a5dd-03a195add734 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:41.387625 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a9ffc87f-3a90-47d7-a5dd-03a195add734 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:41.393840 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a9ffc87f-3a90-47d7-a5dd-03a195add734 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:41.394294 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a9ffc87f-3a90-47d7-a5dd-03a195add734 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:41.395066 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a9ffc87f-3a90-47d7-a5dd-03a195add734 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:41.395534 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a9ffc87f-3a90-47d7-a5dd-03a195add734 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:41.452270 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a9ffc87f-3a90-47d7-a5dd-03a195add734 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:41.459878 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a9ffc87f-3a90-47d7-a5dd-03a195add734 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076515 Jan 11 15:41:41.460436 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1208/2163] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:41 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:42.477188 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-dc155404-4d38-4050-b0d2-82807c330d59 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:42.477803 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-dc155404-4d38-4050-b0d2-82807c330d59 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:42.483999 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-dc155404-4d38-4050-b0d2-82807c330d59 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:42.484455 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-dc155404-4d38-4050-b0d2-82807c330d59 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:42.485228 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-dc155404-4d38-4050-b0d2-82807c330d59 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:42.485670 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-dc155404-4d38-4050-b0d2-82807c330d59 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:42.542058 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-dc155404-4d38-4050-b0d2-82807c330d59 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:42.549609 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-dc155404-4d38-4050-b0d2-82807c330d59 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076579 Jan 11 15:41:42.550164 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 956/2164] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:42 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:43.566618 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-33ffe1fa-0d0e-46c4-b13a-d0ab5e66c7da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:43.567170 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-33ffe1fa-0d0e-46c4-b13a-d0ab5e66c7da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:43.573983 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-33ffe1fa-0d0e-46c4-b13a-d0ab5e66c7da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:43.574439 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-33ffe1fa-0d0e-46c4-b13a-d0ab5e66c7da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:43.575214 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-33ffe1fa-0d0e-46c4-b13a-d0ab5e66c7da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:43.575686 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-33ffe1fa-0d0e-46c4-b13a-d0ab5e66c7da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:43.631932 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-33ffe1fa-0d0e-46c4-b13a-d0ab5e66c7da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:43.640608 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-33ffe1fa-0d0e-46c4-b13a-d0ab5e66c7da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077786 Jan 11 15:41:43.641179 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1209/2165] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:43 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:44.656888 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-342ee452-adaa-4fea-a746-b32f8ad7772f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:44.657778 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-342ee452-adaa-4fea-a746-b32f8ad7772f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:44.663982 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-342ee452-adaa-4fea-a746-b32f8ad7772f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:44.664427 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-342ee452-adaa-4fea-a746-b32f8ad7772f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:44.665198 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-342ee452-adaa-4fea-a746-b32f8ad7772f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:44.665630 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-342ee452-adaa-4fea-a746-b32f8ad7772f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:44.771962 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-342ee452-adaa-4fea-a746-b32f8ad7772f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:44.780931 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-342ee452-adaa-4fea-a746-b32f8ad7772f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.127696 Jan 11 15:41:44.783338 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 957/2166] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:44 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:45.797462 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4bb05244-c95c-4b59-9159-589f0a2e54be tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:45.798076 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-4bb05244-c95c-4b59-9159-589f0a2e54be tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:45.804888 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4bb05244-c95c-4b59-9159-589f0a2e54be tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:45.805341 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4bb05244-c95c-4b59-9159-589f0a2e54be tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:45.806117 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4bb05244-c95c-4b59-9159-589f0a2e54be tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:45.806556 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4bb05244-c95c-4b59-9159-589f0a2e54be tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:45.862207 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-4bb05244-c95c-4b59-9159-589f0a2e54be tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:45.870258 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4bb05244-c95c-4b59-9159-589f0a2e54be tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076571 Jan 11 15:41:45.870827 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1210/2167] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:45 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:46.899302 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-5f17f028-0184-49a1-809d-5af55a04a084 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:46.899965 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-5f17f028-0184-49a1-809d-5af55a04a084 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:46.906012 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5f17f028-0184-49a1-809d-5af55a04a084 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:46.906470 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5f17f028-0184-49a1-809d-5af55a04a084 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:46.907540 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5f17f028-0184-49a1-809d-5af55a04a084 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:46.916443 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5f17f028-0184-49a1-809d-5af55a04a084 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:46.978801 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-5f17f028-0184-49a1-809d-5af55a04a084 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:46.986835 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-5f17f028-0184-49a1-809d-5af55a04a084 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.103316 Jan 11 15:41:46.987656 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 958/2168] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:46 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:48.003407 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9adb49d6-19b4-4cc3-b0c7-2e2b06b4aa92 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:48.004012 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9adb49d6-19b4-4cc3-b0c7-2e2b06b4aa92 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:48.010415 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9adb49d6-19b4-4cc3-b0c7-2e2b06b4aa92 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:48.010875 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9adb49d6-19b4-4cc3-b0c7-2e2b06b4aa92 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:48.011713 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9adb49d6-19b4-4cc3-b0c7-2e2b06b4aa92 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:48.012292 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9adb49d6-19b4-4cc3-b0c7-2e2b06b4aa92 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:48.069515 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-9adb49d6-19b4-4cc3-b0c7-2e2b06b4aa92 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:48.077100 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9adb49d6-19b4-4cc3-b0c7-2e2b06b4aa92 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077479 Jan 11 15:41:48.077666 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1211/2169] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:47 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:49.094117 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f56657fb-b6b3-4be8-a001-b24f2e8ff747 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:49.094728 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f56657fb-b6b3-4be8-a001-b24f2e8ff747 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:49.101432 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f56657fb-b6b3-4be8-a001-b24f2e8ff747 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:49.101875 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f56657fb-b6b3-4be8-a001-b24f2e8ff747 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:49.102641 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f56657fb-b6b3-4be8-a001-b24f2e8ff747 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:49.103076 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f56657fb-b6b3-4be8-a001-b24f2e8ff747 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:49.161272 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-f56657fb-b6b3-4be8-a001-b24f2e8ff747 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:49.169097 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f56657fb-b6b3-4be8-a001-b24f2e8ff747 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.078667 Jan 11 15:41:49.169665 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 959/2170] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:49 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:50.187206 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1c21a5fa-0fe9-4ab4-9388-ab4c82de73bf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:50.187896 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1c21a5fa-0fe9-4ab4-9388-ab4c82de73bf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:50.194764 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1c21a5fa-0fe9-4ab4-9388-ab4c82de73bf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:50.195217 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1c21a5fa-0fe9-4ab4-9388-ab4c82de73bf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:50.196037 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1c21a5fa-0fe9-4ab4-9388-ab4c82de73bf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:50.196475 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1c21a5fa-0fe9-4ab4-9388-ab4c82de73bf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:50.257930 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1c21a5fa-0fe9-4ab4-9388-ab4c82de73bf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:50.265665 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1c21a5fa-0fe9-4ab4-9388-ab4c82de73bf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.082895 Jan 11 15:41:50.266222 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1212/2171] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:50 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:51.283207 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-8613fa29-e1c5-434b-a437-ae371708a585 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:51.283852 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-8613fa29-e1c5-434b-a437-ae371708a585 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:51.290595 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8613fa29-e1c5-434b-a437-ae371708a585 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:51.291039 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8613fa29-e1c5-434b-a437-ae371708a585 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:51.291840 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8613fa29-e1c5-434b-a437-ae371708a585 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:51.292274 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8613fa29-e1c5-434b-a437-ae371708a585 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:51.347991 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-8613fa29-e1c5-434b-a437-ae371708a585 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:51.356062 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-8613fa29-e1c5-434b-a437-ae371708a585 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076803 Jan 11 15:41:51.356613 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 960/2172] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:51 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:52.373544 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f87e7d1e-f8e1-493c-8503-bb316697f14e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:52.374164 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f87e7d1e-f8e1-493c-8503-bb316697f14e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:52.380442 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f87e7d1e-f8e1-493c-8503-bb316697f14e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:52.380931 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f87e7d1e-f8e1-493c-8503-bb316697f14e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:52.381775 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f87e7d1e-f8e1-493c-8503-bb316697f14e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:52.382286 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f87e7d1e-f8e1-493c-8503-bb316697f14e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:52.440387 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f87e7d1e-f8e1-493c-8503-bb316697f14e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:52.448593 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f87e7d1e-f8e1-493c-8503-bb316697f14e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.079036 Jan 11 15:41:52.449208 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1213/2173] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:52 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:53.464424 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3cfff5bb-177c-4043-9771-411f527f54ef tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:53.468786 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3cfff5bb-177c-4043-9771-411f527f54ef tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:53.471217 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3cfff5bb-177c-4043-9771-411f527f54ef tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:53.471707 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3cfff5bb-177c-4043-9771-411f527f54ef tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:53.472492 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3cfff5bb-177c-4043-9771-411f527f54ef tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:53.472932 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3cfff5bb-177c-4043-9771-411f527f54ef tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:53.545246 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-3cfff5bb-177c-4043-9771-411f527f54ef tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:53.553007 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3cfff5bb-177c-4043-9771-411f527f54ef tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.092249 Jan 11 15:41:53.553569 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 961/2174] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:53 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:54.570224 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-767324db-b21f-482b-8f9a-0ab2a611ba5b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:54.570829 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-767324db-b21f-482b-8f9a-0ab2a611ba5b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:54.577080 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-767324db-b21f-482b-8f9a-0ab2a611ba5b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:54.578047 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-767324db-b21f-482b-8f9a-0ab2a611ba5b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:54.578821 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-767324db-b21f-482b-8f9a-0ab2a611ba5b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:54.579263 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-767324db-b21f-482b-8f9a-0ab2a611ba5b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:54.636932 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-767324db-b21f-482b-8f9a-0ab2a611ba5b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:54.644523 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-767324db-b21f-482b-8f9a-0ab2a611ba5b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.078438 Jan 11 15:41:54.645080 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1214/2175] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:54 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:55.661268 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-66390c83-c123-41df-8630-23efa8fe8144 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:55.661808 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-66390c83-c123-41df-8630-23efa8fe8144 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:55.667637 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-66390c83-c123-41df-8630-23efa8fe8144 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:55.668094 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-66390c83-c123-41df-8630-23efa8fe8144 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:55.668867 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-66390c83-c123-41df-8630-23efa8fe8144 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:55.669309 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-66390c83-c123-41df-8630-23efa8fe8144 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:55.725539 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-66390c83-c123-41df-8630-23efa8fe8144 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:55.733036 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-66390c83-c123-41df-8630-23efa8fe8144 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.075929 Jan 11 15:41:55.733590 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 962/2176] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:55 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:56.749886 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-805ee9b1-ca8b-4b90-bf2f-6cb0856b5e2d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:56.750442 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-805ee9b1-ca8b-4b90-bf2f-6cb0856b5e2d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:56.757034 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-805ee9b1-ca8b-4b90-bf2f-6cb0856b5e2d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:56.757483 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-805ee9b1-ca8b-4b90-bf2f-6cb0856b5e2d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:56.758259 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-805ee9b1-ca8b-4b90-bf2f-6cb0856b5e2d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:56.758693 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-805ee9b1-ca8b-4b90-bf2f-6cb0856b5e2d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:56.815217 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-805ee9b1-ca8b-4b90-bf2f-6cb0856b5e2d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:56.823105 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-805ee9b1-ca8b-4b90-bf2f-6cb0856b5e2d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076980 Jan 11 15:41:56.823700 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1215/2177] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:56 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:57.839661 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7a2df1ac-3518-459b-b34d-3ceb035514f4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:57.840273 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7a2df1ac-3518-459b-b34d-3ceb035514f4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:57.846564 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7a2df1ac-3518-459b-b34d-3ceb035514f4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:57.847017 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7a2df1ac-3518-459b-b34d-3ceb035514f4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:57.847847 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7a2df1ac-3518-459b-b34d-3ceb035514f4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:57.848287 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7a2df1ac-3518-459b-b34d-3ceb035514f4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:57.904312 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-7a2df1ac-3518-459b-b34d-3ceb035514f4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:57.912086 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7a2df1ac-3518-459b-b34d-3ceb035514f4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076070 Jan 11 15:41:57.912640 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 963/2178] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:57 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:41:58.928588 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9a1e8d6b-49a7-4e53-9c66-ecd16d7a14ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:41:58.929801 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9a1e8d6b-49a7-4e53-9c66-ecd16d7a14ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:41:58.936072 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9a1e8d6b-49a7-4e53-9c66-ecd16d7a14ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:58.936533 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9a1e8d6b-49a7-4e53-9c66-ecd16d7a14ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:58.937314 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9a1e8d6b-49a7-4e53-9c66-ecd16d7a14ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:41:58.938032 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9a1e8d6b-49a7-4e53-9c66-ecd16d7a14ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:41:58.994489 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-9a1e8d6b-49a7-4e53-9c66-ecd16d7a14ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:41:59.002203 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9a1e8d6b-49a7-4e53-9c66-ecd16d7a14ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077268 Jan 11 15:41:59.002777 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1216/2179] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:41:58 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:00.017875 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7721e66e-3e4a-4d58-9ac1-80f16bf7940d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:00.018483 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7721e66e-3e4a-4d58-9ac1-80f16bf7940d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:00.025310 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7721e66e-3e4a-4d58-9ac1-80f16bf7940d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:00.025770 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7721e66e-3e4a-4d58-9ac1-80f16bf7940d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:00.026570 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7721e66e-3e4a-4d58-9ac1-80f16bf7940d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:00.027009 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7721e66e-3e4a-4d58-9ac1-80f16bf7940d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:00.086458 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-7721e66e-3e4a-4d58-9ac1-80f16bf7940d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:00.093986 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7721e66e-3e4a-4d58-9ac1-80f16bf7940d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.079766 Jan 11 15:42:00.094548 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 964/2180] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:00 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:01.111197 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3948642d-a298-4a5b-aa60-36347218d12b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:01.111825 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3948642d-a298-4a5b-aa60-36347218d12b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:01.118583 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3948642d-a298-4a5b-aa60-36347218d12b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:01.119054 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3948642d-a298-4a5b-aa60-36347218d12b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:01.119857 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3948642d-a298-4a5b-aa60-36347218d12b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:01.120295 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3948642d-a298-4a5b-aa60-36347218d12b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:01.176184 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3948642d-a298-4a5b-aa60-36347218d12b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:01.184369 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3948642d-a298-4a5b-aa60-36347218d12b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076930 Jan 11 15:42:01.184928 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1217/2181] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:01 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:02.201107 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-27444afa-befc-4bec-94f0-3b3a231101da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:02.201718 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-27444afa-befc-4bec-94f0-3b3a231101da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:02.207954 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-27444afa-befc-4bec-94f0-3b3a231101da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:02.208409 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-27444afa-befc-4bec-94f0-3b3a231101da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:02.209186 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-27444afa-befc-4bec-94f0-3b3a231101da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:02.209632 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-27444afa-befc-4bec-94f0-3b3a231101da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:02.266951 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-27444afa-befc-4bec-94f0-3b3a231101da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:02.274765 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-27444afa-befc-4bec-94f0-3b3a231101da tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077332 Jan 11 15:42:02.278142 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 965/2182] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:02 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:03.291516 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c19d50a7-1e0b-458c-8b87-a510f6955c30 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:03.292141 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c19d50a7-1e0b-458c-8b87-a510f6955c30 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:03.298490 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c19d50a7-1e0b-458c-8b87-a510f6955c30 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:03.298943 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c19d50a7-1e0b-458c-8b87-a510f6955c30 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:03.299790 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c19d50a7-1e0b-458c-8b87-a510f6955c30 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:03.300229 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c19d50a7-1e0b-458c-8b87-a510f6955c30 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:03.356926 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c19d50a7-1e0b-458c-8b87-a510f6955c30 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:03.364518 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c19d50a7-1e0b-458c-8b87-a510f6955c30 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076657 Jan 11 15:42:03.365076 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1218/2183] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:03 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:04.380891 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-08fab6ed-a581-405d-8525-6c53d6eda01d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:04.381498 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-08fab6ed-a581-405d-8525-6c53d6eda01d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:04.387875 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-08fab6ed-a581-405d-8525-6c53d6eda01d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:04.388337 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-08fab6ed-a581-405d-8525-6c53d6eda01d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:04.389120 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-08fab6ed-a581-405d-8525-6c53d6eda01d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:04.389564 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-08fab6ed-a581-405d-8525-6c53d6eda01d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:04.447405 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-08fab6ed-a581-405d-8525-6c53d6eda01d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:04.454911 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-08fab6ed-a581-405d-8525-6c53d6eda01d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077710 Jan 11 15:42:04.455504 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 966/2184] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:04 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:05.471840 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-79ad2609-e11b-413a-a73f-dff406b57de0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:05.472450 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-79ad2609-e11b-413a-a73f-dff406b57de0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:05.478765 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-79ad2609-e11b-413a-a73f-dff406b57de0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:05.479212 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-79ad2609-e11b-413a-a73f-dff406b57de0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:05.480008 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-79ad2609-e11b-413a-a73f-dff406b57de0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:05.480443 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-79ad2609-e11b-413a-a73f-dff406b57de0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:05.537442 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-79ad2609-e11b-413a-a73f-dff406b57de0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:05.545546 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-79ad2609-e11b-413a-a73f-dff406b57de0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077326 Jan 11 15:42:05.546108 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1219/2185] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:05 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:06.562036 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-8bf7101d-f1c7-4764-bd07-3708c2754f6e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:06.562593 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-8bf7101d-f1c7-4764-bd07-3708c2754f6e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:06.568707 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8bf7101d-f1c7-4764-bd07-3708c2754f6e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:06.569154 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8bf7101d-f1c7-4764-bd07-3708c2754f6e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:06.569920 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8bf7101d-f1c7-4764-bd07-3708c2754f6e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:06.570358 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8bf7101d-f1c7-4764-bd07-3708c2754f6e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:06.629456 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-8bf7101d-f1c7-4764-bd07-3708c2754f6e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:06.637050 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-8bf7101d-f1c7-4764-bd07-3708c2754f6e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.078732 Jan 11 15:42:06.637607 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 967/2186] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:06 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:07.653481 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-00dcb3e6-a829-445e-952c-0efd8c79c8d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:07.654017 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-00dcb3e6-a829-445e-952c-0efd8c79c8d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:07.660550 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-00dcb3e6-a829-445e-952c-0efd8c79c8d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:07.660992 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-00dcb3e6-a829-445e-952c-0efd8c79c8d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:07.661764 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-00dcb3e6-a829-445e-952c-0efd8c79c8d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:07.662200 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-00dcb3e6-a829-445e-952c-0efd8c79c8d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:07.719897 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-00dcb3e6-a829-445e-952c-0efd8c79c8d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:07.727535 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-00dcb3e6-a829-445e-952c-0efd8c79c8d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077742 Jan 11 15:42:07.728103 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1220/2187] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:07 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:08.744984 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-27be45bd-c5f2-40da-a595-a8f87ba4b626 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:08.745549 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-27be45bd-c5f2-40da-a595-a8f87ba4b626 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:08.751733 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-27be45bd-c5f2-40da-a595-a8f87ba4b626 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:08.752181 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-27be45bd-c5f2-40da-a595-a8f87ba4b626 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:08.752958 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-27be45bd-c5f2-40da-a595-a8f87ba4b626 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:08.753394 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-27be45bd-c5f2-40da-a595-a8f87ba4b626 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:08.810642 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-27be45bd-c5f2-40da-a595-a8f87ba4b626 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:08.818279 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-27be45bd-c5f2-40da-a595-a8f87ba4b626 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077664 Jan 11 15:42:08.818867 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 968/2188] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:08 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:09.834615 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-15fb9512-a0c8-4485-abe3-5f67dde4999b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:09.835220 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-15fb9512-a0c8-4485-abe3-5f67dde4999b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:09.841484 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-15fb9512-a0c8-4485-abe3-5f67dde4999b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:09.841938 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-15fb9512-a0c8-4485-abe3-5f67dde4999b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:09.842714 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-15fb9512-a0c8-4485-abe3-5f67dde4999b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:09.843157 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-15fb9512-a0c8-4485-abe3-5f67dde4999b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:09.899872 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-15fb9512-a0c8-4485-abe3-5f67dde4999b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:09.907726 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-15fb9512-a0c8-4485-abe3-5f67dde4999b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076833 Jan 11 15:42:09.908294 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1221/2189] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:09 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:10.770828 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:42:10.771432 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: Tue Jan 11 15:42:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:42:10.924219 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-67ad81d2-eab2-4a61-9396-bd2d47ccffa9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:10.924831 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-67ad81d2-eab2-4a61-9396-bd2d47ccffa9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:10.931130 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-67ad81d2-eab2-4a61-9396-bd2d47ccffa9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:10.931632 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-67ad81d2-eab2-4a61-9396-bd2d47ccffa9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:10.932416 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-67ad81d2-eab2-4a61-9396-bd2d47ccffa9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:10.932861 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-67ad81d2-eab2-4a61-9396-bd2d47ccffa9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:10.991055 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-67ad81d2-eab2-4a61-9396-bd2d47ccffa9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:10.998747 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-67ad81d2-eab2-4a61-9396-bd2d47ccffa9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.078268 Jan 11 15:42:10.999327 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 969/2190] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:10 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:42:12.015420 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6fb8f410-707a-4c22-9ad6-9d3eb89dc2ee tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:12.016133 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6fb8f410-707a-4c22-9ad6-9d3eb89dc2ee tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:12.022303 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6fb8f410-707a-4c22-9ad6-9d3eb89dc2ee tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:12.022759 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6fb8f410-707a-4c22-9ad6-9d3eb89dc2ee tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:12.024065 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6fb8f410-707a-4c22-9ad6-9d3eb89dc2ee tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:12.024508 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6fb8f410-707a-4c22-9ad6-9d3eb89dc2ee tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:12.080428 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6fb8f410-707a-4c22-9ad6-9d3eb89dc2ee tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:12.088553 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6fb8f410-707a-4c22-9ad6-9d3eb89dc2ee tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076751 Jan 11 15:42:12.089119 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1222/2191] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:12 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:13.104851 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-11673c95-7141-450a-82f8-6b13cdb78bf5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:13.105486 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-11673c95-7141-450a-82f8-6b13cdb78bf5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:13.111744 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-11673c95-7141-450a-82f8-6b13cdb78bf5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:13.112202 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-11673c95-7141-450a-82f8-6b13cdb78bf5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:13.112982 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-11673c95-7141-450a-82f8-6b13cdb78bf5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:13.113426 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-11673c95-7141-450a-82f8-6b13cdb78bf5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:13.173159 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-11673c95-7141-450a-82f8-6b13cdb78bf5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:13.180879 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-11673c95-7141-450a-82f8-6b13cdb78bf5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.079758 Jan 11 15:42:13.181439 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 970/2192] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:13 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:14.196634 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7d2b9396-1b81-4034-b5d8-c07d76f5dc86 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:14.197251 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-7d2b9396-1b81-4034-b5d8-c07d76f5dc86 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:14.203425 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7d2b9396-1b81-4034-b5d8-c07d76f5dc86 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:14.203880 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7d2b9396-1b81-4034-b5d8-c07d76f5dc86 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:14.204649 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7d2b9396-1b81-4034-b5d8-c07d76f5dc86 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:14.205088 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7d2b9396-1b81-4034-b5d8-c07d76f5dc86 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:14.263674 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-7d2b9396-1b81-4034-b5d8-c07d76f5dc86 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:14.271526 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7d2b9396-1b81-4034-b5d8-c07d76f5dc86 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.078447 Jan 11 15:42:14.274059 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1223/2193] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:14 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:15.289307 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ab0139bb-ba6b-4872-afee-2156fe929c79 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:15.290680 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-ab0139bb-ba6b-4872-afee-2156fe929c79 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:15.296162 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ab0139bb-ba6b-4872-afee-2156fe929c79 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:15.296652 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ab0139bb-ba6b-4872-afee-2156fe929c79 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:15.297423 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ab0139bb-ba6b-4872-afee-2156fe929c79 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:15.297859 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ab0139bb-ba6b-4872-afee-2156fe929c79 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:15.354920 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-ab0139bb-ba6b-4872-afee-2156fe929c79 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:15.362613 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-ab0139bb-ba6b-4872-afee-2156fe929c79 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077446 Jan 11 15:42:15.363164 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 971/2194] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:15 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:16.379658 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-04e83052-31fb-4ea4-92ff-49efc171fa2e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:16.380268 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-04e83052-31fb-4ea4-92ff-49efc171fa2e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:16.387255 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-04e83052-31fb-4ea4-92ff-49efc171fa2e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:16.387734 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-04e83052-31fb-4ea4-92ff-49efc171fa2e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:16.388517 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-04e83052-31fb-4ea4-92ff-49efc171fa2e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:16.388967 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-04e83052-31fb-4ea4-92ff-49efc171fa2e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:16.445835 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-04e83052-31fb-4ea4-92ff-49efc171fa2e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:16.453392 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-04e83052-31fb-4ea4-92ff-49efc171fa2e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077375 Jan 11 15:42:16.453954 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1224/2195] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:16 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:17.469780 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e9406d4d-4dd6-461b-9448-35930f8c1c4e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:17.470296 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e9406d4d-4dd6-461b-9448-35930f8c1c4e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:17.477181 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e9406d4d-4dd6-461b-9448-35930f8c1c4e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:17.477625 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e9406d4d-4dd6-461b-9448-35930f8c1c4e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:17.478390 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e9406d4d-4dd6-461b-9448-35930f8c1c4e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:17.478851 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e9406d4d-4dd6-461b-9448-35930f8c1c4e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:17.535331 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-e9406d4d-4dd6-461b-9448-35930f8c1c4e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:17.542786 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e9406d4d-4dd6-461b-9448-35930f8c1c4e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076764 Jan 11 15:42:17.543355 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 972/2196] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:17 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:18.559047 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b4874da0-2204-44fa-b60c-e296a36aab5a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:18.559647 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b4874da0-2204-44fa-b60c-e296a36aab5a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:18.565893 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b4874da0-2204-44fa-b60c-e296a36aab5a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:18.566350 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b4874da0-2204-44fa-b60c-e296a36aab5a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:18.567132 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b4874da0-2204-44fa-b60c-e296a36aab5a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:18.567606 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b4874da0-2204-44fa-b60c-e296a36aab5a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:18.625301 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b4874da0-2204-44fa-b60c-e296a36aab5a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:18.633721 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b4874da0-2204-44fa-b60c-e296a36aab5a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.078371 Jan 11 15:42:18.634294 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1225/2197] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:18 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:19.649883 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7529892b-74cd-44b8-8ca4-6e31ff6f66db tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:19.650448 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7529892b-74cd-44b8-8ca4-6e31ff6f66db tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:19.657021 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7529892b-74cd-44b8-8ca4-6e31ff6f66db tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:19.657472 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7529892b-74cd-44b8-8ca4-6e31ff6f66db tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:19.658250 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7529892b-74cd-44b8-8ca4-6e31ff6f66db tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:19.658689 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7529892b-74cd-44b8-8ca4-6e31ff6f66db tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:19.717780 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-7529892b-74cd-44b8-8ca4-6e31ff6f66db tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:19.725451 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7529892b-74cd-44b8-8ca4-6e31ff6f66db tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.079294 Jan 11 15:42:19.726530 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 973/2198] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:19 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:20.744762 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7bbdaeb1-8d02-4c6b-a76d-b492fadc4b7b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:20.745426 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-7bbdaeb1-8d02-4c6b-a76d-b492fadc4b7b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:20.751962 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7bbdaeb1-8d02-4c6b-a76d-b492fadc4b7b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:20.752384 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7bbdaeb1-8d02-4c6b-a76d-b492fadc4b7b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:20.753239 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7bbdaeb1-8d02-4c6b-a76d-b492fadc4b7b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:20.753692 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7bbdaeb1-8d02-4c6b-a76d-b492fadc4b7b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:20.815951 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-7bbdaeb1-8d02-4c6b-a76d-b492fadc4b7b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:20.823849 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7bbdaeb1-8d02-4c6b-a76d-b492fadc4b7b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.083470 Jan 11 15:42:20.824424 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1226/2199] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:20 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:21.842882 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-15546e8f-2cad-4086-9aa8-3ca4831b2d46 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:21.842882 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-15546e8f-2cad-4086-9aa8-3ca4831b2d46 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:21.847718 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-15546e8f-2cad-4086-9aa8-3ca4831b2d46 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:21.848165 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-15546e8f-2cad-4086-9aa8-3ca4831b2d46 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:21.848929 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-15546e8f-2cad-4086-9aa8-3ca4831b2d46 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:21.849364 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-15546e8f-2cad-4086-9aa8-3ca4831b2d46 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:21.956606 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-15546e8f-2cad-4086-9aa8-3ca4831b2d46 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:21.956606 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-15546e8f-2cad-4086-9aa8-3ca4831b2d46 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.078265 Jan 11 15:42:21.956606 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 974/2200] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:21 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:22.933134 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1ccd5112-5f90-4c0d-ade9-b9cc0e6c0e59 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:22.933750 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1ccd5112-5f90-4c0d-ade9-b9cc0e6c0e59 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:22.940081 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1ccd5112-5f90-4c0d-ade9-b9cc0e6c0e59 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:22.940541 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1ccd5112-5f90-4c0d-ade9-b9cc0e6c0e59 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:22.941323 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1ccd5112-5f90-4c0d-ade9-b9cc0e6c0e59 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:22.941769 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1ccd5112-5f90-4c0d-ade9-b9cc0e6c0e59 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:22.998778 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1ccd5112-5f90-4c0d-ade9-b9cc0e6c0e59 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:23.006494 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1ccd5112-5f90-4c0d-ade9-b9cc0e6c0e59 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077576 Jan 11 15:42:23.007063 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1227/2201] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:22 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:24.022853 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b38b5140-f9b0-453a-95d8-f86395abd596 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:24.023483 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b38b5140-f9b0-453a-95d8-f86395abd596 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:24.029623 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b38b5140-f9b0-453a-95d8-f86395abd596 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:24.030071 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b38b5140-f9b0-453a-95d8-f86395abd596 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:24.031104 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b38b5140-f9b0-453a-95d8-f86395abd596 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:24.031673 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b38b5140-f9b0-453a-95d8-f86395abd596 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:24.088812 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-b38b5140-f9b0-453a-95d8-f86395abd596 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:24.096229 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b38b5140-f9b0-453a-95d8-f86395abd596 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077026 Jan 11 15:42:24.096785 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 975/2202] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:24 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:25.112956 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e27e854f-2967-4033-ae79-06d59cc16ff7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:25.119105 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e27e854f-2967-4033-ae79-06d59cc16ff7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:25.120104 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e27e854f-2967-4033-ae79-06d59cc16ff7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:25.120562 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e27e854f-2967-4033-ae79-06d59cc16ff7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:25.121344 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e27e854f-2967-4033-ae79-06d59cc16ff7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:25.121791 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e27e854f-2967-4033-ae79-06d59cc16ff7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:25.177994 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e27e854f-2967-4033-ae79-06d59cc16ff7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:25.186312 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e27e854f-2967-4033-ae79-06d59cc16ff7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077158 Jan 11 15:42:25.187789 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1228/2203] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:25 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:26.202275 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3e0f1e5f-9760-4af0-bba5-77ea291ded9f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:26.202959 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3e0f1e5f-9760-4af0-bba5-77ea291ded9f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:26.209264 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3e0f1e5f-9760-4af0-bba5-77ea291ded9f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:26.209728 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3e0f1e5f-9760-4af0-bba5-77ea291ded9f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:26.210494 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3e0f1e5f-9760-4af0-bba5-77ea291ded9f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:26.210924 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3e0f1e5f-9760-4af0-bba5-77ea291ded9f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:26.273554 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-3e0f1e5f-9760-4af0-bba5-77ea291ded9f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:26.282780 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3e0f1e5f-9760-4af0-bba5-77ea291ded9f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.084238 Jan 11 15:42:26.283644 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 976/2204] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:26 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:27.300154 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-52c70295-00ed-4cfd-a794-e85ed94eea27 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:27.300763 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-52c70295-00ed-4cfd-a794-e85ed94eea27 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:27.307736 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-52c70295-00ed-4cfd-a794-e85ed94eea27 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:27.308209 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-52c70295-00ed-4cfd-a794-e85ed94eea27 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:27.308968 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-52c70295-00ed-4cfd-a794-e85ed94eea27 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:27.309406 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-52c70295-00ed-4cfd-a794-e85ed94eea27 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:27.366692 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-52c70295-00ed-4cfd-a794-e85ed94eea27 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:27.374843 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-52c70295-00ed-4cfd-a794-e85ed94eea27 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.078394 Jan 11 15:42:27.375430 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1229/2205] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:27 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:28.391337 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-aee3a6cc-37f3-4976-ad1e-ca38f27df5ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:28.391954 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-aee3a6cc-37f3-4976-ad1e-ca38f27df5ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:28.398229 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-aee3a6cc-37f3-4976-ad1e-ca38f27df5ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:28.398696 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-aee3a6cc-37f3-4976-ad1e-ca38f27df5ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:28.399499 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-aee3a6cc-37f3-4976-ad1e-ca38f27df5ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:28.399944 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-aee3a6cc-37f3-4976-ad1e-ca38f27df5ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:28.456065 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-aee3a6cc-37f3-4976-ad1e-ca38f27df5ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:28.463596 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-aee3a6cc-37f3-4976-ad1e-ca38f27df5ff tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.075877 Jan 11 15:42:28.464165 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 977/2206] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:28 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:29.479823 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e7dab702-c8ea-4546-bd6b-8ffbe6bfa9c3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:29.480438 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e7dab702-c8ea-4546-bd6b-8ffbe6bfa9c3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:29.486717 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e7dab702-c8ea-4546-bd6b-8ffbe6bfa9c3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:29.487169 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e7dab702-c8ea-4546-bd6b-8ffbe6bfa9c3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:29.487978 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e7dab702-c8ea-4546-bd6b-8ffbe6bfa9c3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:29.488422 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e7dab702-c8ea-4546-bd6b-8ffbe6bfa9c3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:29.545201 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e7dab702-c8ea-4546-bd6b-8ffbe6bfa9c3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:29.552816 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e7dab702-c8ea-4546-bd6b-8ffbe6bfa9c3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076674 Jan 11 15:42:29.553389 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1230/2207] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:29 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:30.568732 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7ab22c98-9094-4f74-b036-260a0836f325 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:30.569313 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7ab22c98-9094-4f74-b036-260a0836f325 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:30.576023 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7ab22c98-9094-4f74-b036-260a0836f325 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:30.576475 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7ab22c98-9094-4f74-b036-260a0836f325 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:30.577242 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7ab22c98-9094-4f74-b036-260a0836f325 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:30.577676 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7ab22c98-9094-4f74-b036-260a0836f325 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:30.636581 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-7ab22c98-9094-4f74-b036-260a0836f325 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:30.644086 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7ab22c98-9094-4f74-b036-260a0836f325 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.079088 Jan 11 15:42:30.644641 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 978/2208] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:30 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:31.660645 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-21fe77bf-00c6-461a-9240-d413e96467f1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:31.661198 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-21fe77bf-00c6-461a-9240-d413e96467f1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:31.668185 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-21fe77bf-00c6-461a-9240-d413e96467f1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:31.668644 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-21fe77bf-00c6-461a-9240-d413e96467f1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:31.669420 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-21fe77bf-00c6-461a-9240-d413e96467f1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:31.669866 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-21fe77bf-00c6-461a-9240-d413e96467f1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:31.726358 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-21fe77bf-00c6-461a-9240-d413e96467f1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:31.734180 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-21fe77bf-00c6-461a-9240-d413e96467f1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077296 Jan 11 15:42:31.734743 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1231/2209] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:31 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:32.751018 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c8373c83-3ec1-4289-976d-41a0bbeaabd5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:32.751760 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c8373c83-3ec1-4289-976d-41a0bbeaabd5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:32.757741 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c8373c83-3ec1-4289-976d-41a0bbeaabd5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:32.758188 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c8373c83-3ec1-4289-976d-41a0bbeaabd5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:32.758961 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c8373c83-3ec1-4289-976d-41a0bbeaabd5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:32.759533 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c8373c83-3ec1-4289-976d-41a0bbeaabd5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:32.819420 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-c8373c83-3ec1-4289-976d-41a0bbeaabd5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:32.827228 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c8373c83-3ec1-4289-976d-41a0bbeaabd5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.080225 Jan 11 15:42:32.831228 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 979/2210] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:32 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:33.843672 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-19f4243b-465f-4676-85cd-d403e13b97b2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:33.844290 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-19f4243b-465f-4676-85cd-d403e13b97b2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:33.850571 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-19f4243b-465f-4676-85cd-d403e13b97b2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:33.851023 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-19f4243b-465f-4676-85cd-d403e13b97b2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:33.851832 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-19f4243b-465f-4676-85cd-d403e13b97b2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:33.852907 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-19f4243b-465f-4676-85cd-d403e13b97b2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:33.909414 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-19f4243b-465f-4676-85cd-d403e13b97b2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:33.917579 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-19f4243b-465f-4676-85cd-d403e13b97b2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077534 Jan 11 15:42:33.918140 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1232/2211] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:33 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:34.934523 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-41002fb2-9de7-48f6-95e7-39389798be03 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:34.935149 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-41002fb2-9de7-48f6-95e7-39389798be03 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:34.941317 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-41002fb2-9de7-48f6-95e7-39389798be03 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:34.941763 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-41002fb2-9de7-48f6-95e7-39389798be03 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:34.942526 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-41002fb2-9de7-48f6-95e7-39389798be03 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:34.942959 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-41002fb2-9de7-48f6-95e7-39389798be03 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:34.999608 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-41002fb2-9de7-48f6-95e7-39389798be03 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:35.007143 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-41002fb2-9de7-48f6-95e7-39389798be03 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076871 Jan 11 15:42:35.007725 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 980/2212] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:34 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:36.023575 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-598039e2-9f36-4060-a0e2-8425ba8740de tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:36.024184 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-598039e2-9f36-4060-a0e2-8425ba8740de tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:36.030718 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-598039e2-9f36-4060-a0e2-8425ba8740de tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:36.031164 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-598039e2-9f36-4060-a0e2-8425ba8740de tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:36.031961 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-598039e2-9f36-4060-a0e2-8425ba8740de tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:36.032397 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-598039e2-9f36-4060-a0e2-8425ba8740de tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:36.088763 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-598039e2-9f36-4060-a0e2-8425ba8740de tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:36.096350 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-598039e2-9f36-4060-a0e2-8425ba8740de tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076441 Jan 11 15:42:36.096904 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1233/2213] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:36 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:37.112714 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c27bbe98-d5ab-4d35-9e2f-87b1d830ae01 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:37.113345 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c27bbe98-d5ab-4d35-9e2f-87b1d830ae01 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:37.120244 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c27bbe98-d5ab-4d35-9e2f-87b1d830ae01 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:37.120695 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c27bbe98-d5ab-4d35-9e2f-87b1d830ae01 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:37.121469 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c27bbe98-d5ab-4d35-9e2f-87b1d830ae01 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:37.121907 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c27bbe98-d5ab-4d35-9e2f-87b1d830ae01 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:37.181343 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-c27bbe98-d5ab-4d35-9e2f-87b1d830ae01 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:37.188829 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c27bbe98-d5ab-4d35-9e2f-87b1d830ae01 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.079750 Jan 11 15:42:37.189382 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 981/2214] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:37 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:38.205518 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e6533ef3-9ee8-4600-8c99-312dbe97041a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:38.206130 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e6533ef3-9ee8-4600-8c99-312dbe97041a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:38.212912 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e6533ef3-9ee8-4600-8c99-312dbe97041a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:38.213376 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e6533ef3-9ee8-4600-8c99-312dbe97041a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:38.214167 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e6533ef3-9ee8-4600-8c99-312dbe97041a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:38.214615 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e6533ef3-9ee8-4600-8c99-312dbe97041a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:38.272591 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e6533ef3-9ee8-4600-8c99-312dbe97041a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:38.280472 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e6533ef3-9ee8-4600-8c99-312dbe97041a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.078327 Jan 11 15:42:38.281021 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1234/2215] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:38 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:39.296822 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-bd4f3363-1af1-4486-86a9-36517981c315 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:39.297439 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-bd4f3363-1af1-4486-86a9-36517981c315 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:39.303787 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bd4f3363-1af1-4486-86a9-36517981c315 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:39.304246 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bd4f3363-1af1-4486-86a9-36517981c315 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:39.305026 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bd4f3363-1af1-4486-86a9-36517981c315 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:39.305471 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bd4f3363-1af1-4486-86a9-36517981c315 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:39.362257 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-bd4f3363-1af1-4486-86a9-36517981c315 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:39.369929 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-bd4f3363-1af1-4486-86a9-36517981c315 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076745 Jan 11 15:42:39.370496 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 982/2216] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:39 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:40.386460 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-66da67f6-4f70-4b0d-b872-4d4bf8883f31 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:40.387074 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-66da67f6-4f70-4b0d-b872-4d4bf8883f31 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:40.393877 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-66da67f6-4f70-4b0d-b872-4d4bf8883f31 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:40.394324 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-66da67f6-4f70-4b0d-b872-4d4bf8883f31 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:40.395104 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-66da67f6-4f70-4b0d-b872-4d4bf8883f31 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:40.395575 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-66da67f6-4f70-4b0d-b872-4d4bf8883f31 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:40.452385 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-66da67f6-4f70-4b0d-b872-4d4bf8883f31 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:40.459999 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-66da67f6-4f70-4b0d-b872-4d4bf8883f31 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077301 Jan 11 15:42:40.460569 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1235/2217] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:40 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:41.476414 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ab278d42-c5e3-4c6c-88f0-7179634a9fb3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:41.477015 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-ab278d42-c5e3-4c6c-88f0-7179634a9fb3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:41.483224 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ab278d42-c5e3-4c6c-88f0-7179634a9fb3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:41.483707 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ab278d42-c5e3-4c6c-88f0-7179634a9fb3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:41.484513 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ab278d42-c5e3-4c6c-88f0-7179634a9fb3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:41.484945 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ab278d42-c5e3-4c6c-88f0-7179634a9fb3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:41.542370 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-ab278d42-c5e3-4c6c-88f0-7179634a9fb3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:41.549919 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-ab278d42-c5e3-4c6c-88f0-7179634a9fb3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077184 Jan 11 15:42:41.550504 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 983/2218] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:41 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:42.566205 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-372d7491-ff3e-4cff-ab00-83fe481068e8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:42.566796 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-372d7491-ff3e-4cff-ab00-83fe481068e8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:42.573240 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-372d7491-ff3e-4cff-ab00-83fe481068e8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:42.573691 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-372d7491-ff3e-4cff-ab00-83fe481068e8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:42.574462 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-372d7491-ff3e-4cff-ab00-83fe481068e8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:42.574900 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-372d7491-ff3e-4cff-ab00-83fe481068e8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:42.632989 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-372d7491-ff3e-4cff-ab00-83fe481068e8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:42.640443 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-372d7491-ff3e-4cff-ab00-83fe481068e8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077969 Jan 11 15:42:42.641004 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1236/2219] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:42 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:43.657604 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2bdf1562-d5f0-4746-abbe-19503b06966c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:43.658158 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2bdf1562-d5f0-4746-abbe-19503b06966c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:43.664417 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2bdf1562-d5f0-4746-abbe-19503b06966c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:43.664869 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2bdf1562-d5f0-4746-abbe-19503b06966c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:43.665647 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2bdf1562-d5f0-4746-abbe-19503b06966c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:43.666087 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2bdf1562-d5f0-4746-abbe-19503b06966c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:43.725278 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-2bdf1562-d5f0-4746-abbe-19503b06966c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:43.733468 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2bdf1562-d5f0-4746-abbe-19503b06966c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.079830 Jan 11 15:42:43.734029 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 984/2220] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:43 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:44.750633 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7d96ce31-1b95-444c-875a-30a65986f7d5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:44.751191 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-7d96ce31-1b95-444c-875a-30a65986f7d5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:44.757412 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7d96ce31-1b95-444c-875a-30a65986f7d5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:44.758363 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7d96ce31-1b95-444c-875a-30a65986f7d5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:44.759129 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7d96ce31-1b95-444c-875a-30a65986f7d5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:44.759596 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7d96ce31-1b95-444c-875a-30a65986f7d5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:44.815417 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-7d96ce31-1b95-444c-875a-30a65986f7d5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:44.823608 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7d96ce31-1b95-444c-875a-30a65986f7d5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076676 Jan 11 15:42:44.824165 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1237/2221] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:44 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:45.840664 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-05aebb12-fc5a-4720-ba50-2e0421ed3bda tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:45.841278 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-05aebb12-fc5a-4720-ba50-2e0421ed3bda tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:45.847509 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-05aebb12-fc5a-4720-ba50-2e0421ed3bda tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:45.847961 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-05aebb12-fc5a-4720-ba50-2e0421ed3bda tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:45.848735 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-05aebb12-fc5a-4720-ba50-2e0421ed3bda tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:45.849175 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-05aebb12-fc5a-4720-ba50-2e0421ed3bda tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:45.906564 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-05aebb12-fc5a-4720-ba50-2e0421ed3bda tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:45.914196 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-05aebb12-fc5a-4720-ba50-2e0421ed3bda tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077195 Jan 11 15:42:45.914755 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 985/2222] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:45 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:46.930592 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-17127ba3-0a26-4c8c-9022-dac474101306 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:46.931222 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-17127ba3-0a26-4c8c-9022-dac474101306 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:46.937594 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-17127ba3-0a26-4c8c-9022-dac474101306 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:46.938052 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-17127ba3-0a26-4c8c-9022-dac474101306 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:46.938811 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-17127ba3-0a26-4c8c-9022-dac474101306 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:46.939249 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-17127ba3-0a26-4c8c-9022-dac474101306 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:46.996461 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-17127ba3-0a26-4c8c-9022-dac474101306 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:47.003943 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-17127ba3-0a26-4c8c-9022-dac474101306 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077023 Jan 11 15:42:47.004504 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1238/2223] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:46 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:47.033673 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:42:47.033851 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: Tue Jan 11 15:42:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:42:48.020484 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-89673649-b9f1-4591-8618-5b120a5225de tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:48.021108 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-89673649-b9f1-4591-8618-5b120a5225de tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:48.027987 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-89673649-b9f1-4591-8618-5b120a5225de tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:48.028447 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-89673649-b9f1-4591-8618-5b120a5225de tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:48.029227 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-89673649-b9f1-4591-8618-5b120a5225de tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:48.029672 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-89673649-b9f1-4591-8618-5b120a5225de tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:48.086269 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-89673649-b9f1-4591-8618-5b120a5225de tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:48.093822 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-89673649-b9f1-4591-8618-5b120a5225de tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076958 Jan 11 15:42:48.094409 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 986/2224] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:48 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:49.111108 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0d2aff05-a3ff-45e4-a731-2fecd85e2433 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:49.111790 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0d2aff05-a3ff-45e4-a731-2fecd85e2433 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:49.117996 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0d2aff05-a3ff-45e4-a731-2fecd85e2433 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:49.118445 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0d2aff05-a3ff-45e4-a731-2fecd85e2433 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:49.119219 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0d2aff05-a3ff-45e4-a731-2fecd85e2433 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:49.119702 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0d2aff05-a3ff-45e4-a731-2fecd85e2433 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:49.178379 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0d2aff05-a3ff-45e4-a731-2fecd85e2433 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:49.186144 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0d2aff05-a3ff-45e4-a731-2fecd85e2433 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.078738 Jan 11 15:42:49.186701 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1239/2225] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:49 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:50.202358 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-13f67a0f-8406-444d-8083-5fa0bce93669 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:50.202913 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-13f67a0f-8406-444d-8083-5fa0bce93669 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:50.209310 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-13f67a0f-8406-444d-8083-5fa0bce93669 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:50.210064 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-13f67a0f-8406-444d-8083-5fa0bce93669 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:50.210843 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-13f67a0f-8406-444d-8083-5fa0bce93669 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:50.211884 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-13f67a0f-8406-444d-8083-5fa0bce93669 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:50.271517 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-13f67a0f-8406-444d-8083-5fa0bce93669 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:50.280322 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-13f67a0f-8406-444d-8083-5fa0bce93669 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.081464 Jan 11 15:42:50.280876 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 987/2226] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:50 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:51.412314 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1a077c99-3761-499f-ab44-97bb145be378 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:51.412925 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1a077c99-3761-499f-ab44-97bb145be378 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:51.418722 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1a077c99-3761-499f-ab44-97bb145be378 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:51.419179 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1a077c99-3761-499f-ab44-97bb145be378 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:51.419986 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1a077c99-3761-499f-ab44-97bb145be378 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:51.420426 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1a077c99-3761-499f-ab44-97bb145be378 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:51.479593 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1a077c99-3761-499f-ab44-97bb145be378 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:51.487808 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1a077c99-3761-499f-ab44-97bb145be378 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.194835 Jan 11 15:42:51.488378 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1240/2227] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:51 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:52.504680 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-6e65125b-a8d1-446c-b87e-049570e7d498 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:52.505291 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-6e65125b-a8d1-446c-b87e-049570e7d498 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:52.511589 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6e65125b-a8d1-446c-b87e-049570e7d498 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:52.511981 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6e65125b-a8d1-446c-b87e-049570e7d498 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:52.512750 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6e65125b-a8d1-446c-b87e-049570e7d498 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:52.513186 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6e65125b-a8d1-446c-b87e-049570e7d498 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:52.570030 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-6e65125b-a8d1-446c-b87e-049570e7d498 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:52.577436 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-6e65125b-a8d1-446c-b87e-049570e7d498 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076401 Jan 11 15:42:52.577982 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 988/2228] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:52 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:53.593768 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0e6a9fb3-1a4a-49a9-adb1-d491c852a7cb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:53.594322 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0e6a9fb3-1a4a-49a9-adb1-d491c852a7cb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:53.600265 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0e6a9fb3-1a4a-49a9-adb1-d491c852a7cb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:53.600719 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0e6a9fb3-1a4a-49a9-adb1-d491c852a7cb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:53.601501 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0e6a9fb3-1a4a-49a9-adb1-d491c852a7cb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:53.602465 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0e6a9fb3-1a4a-49a9-adb1-d491c852a7cb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:53.658327 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0e6a9fb3-1a4a-49a9-adb1-d491c852a7cb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:53.666341 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0e6a9fb3-1a4a-49a9-adb1-d491c852a7cb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076321 Jan 11 15:42:53.666903 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1241/2229] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:53 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:54.683321 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3f10d1c6-89be-43b4-9c45-016cf1e54437 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:54.683943 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3f10d1c6-89be-43b4-9c45-016cf1e54437 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:54.690181 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3f10d1c6-89be-43b4-9c45-016cf1e54437 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:54.690630 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3f10d1c6-89be-43b4-9c45-016cf1e54437 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:54.691615 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3f10d1c6-89be-43b4-9c45-016cf1e54437 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:54.692059 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3f10d1c6-89be-43b4-9c45-016cf1e54437 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:54.748526 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-3f10d1c6-89be-43b4-9c45-016cf1e54437 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:54.756077 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3f10d1c6-89be-43b4-9c45-016cf1e54437 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076916 Jan 11 15:42:54.756632 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 989/2230] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:54 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:55.773072 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0b86b151-4d5c-48d8-8bb2-5e7614fdcd9d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:55.773827 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0b86b151-4d5c-48d8-8bb2-5e7614fdcd9d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:55.780380 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0b86b151-4d5c-48d8-8bb2-5e7614fdcd9d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:55.780831 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0b86b151-4d5c-48d8-8bb2-5e7614fdcd9d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:55.781600 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0b86b151-4d5c-48d8-8bb2-5e7614fdcd9d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:55.782036 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0b86b151-4d5c-48d8-8bb2-5e7614fdcd9d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:55.838467 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0b86b151-4d5c-48d8-8bb2-5e7614fdcd9d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:55.846041 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0b86b151-4d5c-48d8-8bb2-5e7614fdcd9d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076577 Jan 11 15:42:55.846605 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1242/2231] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:55 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:56.862307 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-43482adb-88b6-4cfb-a987-8529665891f5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:56.862900 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-43482adb-88b6-4cfb-a987-8529665891f5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:56.869300 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-43482adb-88b6-4cfb-a987-8529665891f5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:56.869747 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-43482adb-88b6-4cfb-a987-8529665891f5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:56.870513 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-43482adb-88b6-4cfb-a987-8529665891f5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:56.870948 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-43482adb-88b6-4cfb-a987-8529665891f5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:56.930698 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-43482adb-88b6-4cfb-a987-8529665891f5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:56.938235 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-43482adb-88b6-4cfb-a987-8529665891f5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.079793 Jan 11 15:42:56.938794 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 990/2232] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:56 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:57.956574 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b3fef260-5f54-45d4-a27f-fb8647ae82d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:57.957190 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b3fef260-5f54-45d4-a27f-fb8647ae82d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:57.964007 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b3fef260-5f54-45d4-a27f-fb8647ae82d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:57.964455 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b3fef260-5f54-45d4-a27f-fb8647ae82d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:57.965217 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b3fef260-5f54-45d4-a27f-fb8647ae82d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:57.965653 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b3fef260-5f54-45d4-a27f-fb8647ae82d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:58.022842 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b3fef260-5f54-45d4-a27f-fb8647ae82d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:58.031172 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b3fef260-5f54-45d4-a27f-fb8647ae82d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.079658 Jan 11 15:42:58.031757 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1243/2233] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:57 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:42:59.047699 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-bd8cdf3b-ef36-4a48-afc3-bf4b5e756cec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:42:59.048252 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-bd8cdf3b-ef36-4a48-afc3-bf4b5e756cec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:42:59.054376 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bd8cdf3b-ef36-4a48-afc3-bf4b5e756cec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:59.055507 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bd8cdf3b-ef36-4a48-afc3-bf4b5e756cec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:59.056298 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bd8cdf3b-ef36-4a48-afc3-bf4b5e756cec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:42:59.056738 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bd8cdf3b-ef36-4a48-afc3-bf4b5e756cec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:42:59.114140 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-bd8cdf3b-ef36-4a48-afc3-bf4b5e756cec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:42:59.122421 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-bd8cdf3b-ef36-4a48-afc3-bf4b5e756cec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.078456 Jan 11 15:42:59.122987 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 991/2234] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:42:59 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:00.139556 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4a3d1767-e4db-4327-8d61-749834464d12 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:00.140192 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-4a3d1767-e4db-4327-8d61-749834464d12 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:00.146754 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4a3d1767-e4db-4327-8d61-749834464d12 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:00.147231 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4a3d1767-e4db-4327-8d61-749834464d12 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:00.148033 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4a3d1767-e4db-4327-8d61-749834464d12 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:00.148504 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4a3d1767-e4db-4327-8d61-749834464d12 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:00.208431 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-4a3d1767-e4db-4327-8d61-749834464d12 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:00.216126 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4a3d1767-e4db-4327-8d61-749834464d12 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.080407 Jan 11 15:43:00.216676 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1244/2235] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:00 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:01.232323 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-6355cdf3-7b3a-44ea-bfae-a6825ec3d112 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:01.232946 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-6355cdf3-7b3a-44ea-bfae-a6825ec3d112 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:01.239409 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6355cdf3-7b3a-44ea-bfae-a6825ec3d112 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:01.239899 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6355cdf3-7b3a-44ea-bfae-a6825ec3d112 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:01.240664 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6355cdf3-7b3a-44ea-bfae-a6825ec3d112 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:01.241109 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6355cdf3-7b3a-44ea-bfae-a6825ec3d112 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:01.298459 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-6355cdf3-7b3a-44ea-bfae-a6825ec3d112 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:01.306669 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-6355cdf3-7b3a-44ea-bfae-a6825ec3d112 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077984 Jan 11 15:43:01.307230 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 992/2236] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:01 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:02.323058 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b83343eb-ba44-4b62-9d0d-c09e0d11f799 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:02.323696 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b83343eb-ba44-4b62-9d0d-c09e0d11f799 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:02.330325 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b83343eb-ba44-4b62-9d0d-c09e0d11f799 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:02.330775 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b83343eb-ba44-4b62-9d0d-c09e0d11f799 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:02.331566 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b83343eb-ba44-4b62-9d0d-c09e0d11f799 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:02.332006 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b83343eb-ba44-4b62-9d0d-c09e0d11f799 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:02.395551 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b83343eb-ba44-4b62-9d0d-c09e0d11f799 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:02.403553 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b83343eb-ba44-4b62-9d0d-c09e0d11f799 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.084139 Jan 11 15:43:02.404108 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1245/2237] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:02 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:03.420058 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-32c88a3f-726c-495d-ac4d-9ca7fdfce1e7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:03.420664 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-32c88a3f-726c-495d-ac4d-9ca7fdfce1e7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:03.426811 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-32c88a3f-726c-495d-ac4d-9ca7fdfce1e7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:03.427255 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-32c88a3f-726c-495d-ac4d-9ca7fdfce1e7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:03.428048 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-32c88a3f-726c-495d-ac4d-9ca7fdfce1e7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:03.428482 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-32c88a3f-726c-495d-ac4d-9ca7fdfce1e7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:03.484178 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-32c88a3f-726c-495d-ac4d-9ca7fdfce1e7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:03.492135 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-32c88a3f-726c-495d-ac4d-9ca7fdfce1e7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.075179 Jan 11 15:43:03.492648 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 993/2238] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:03 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:04.508268 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-52b8d0b9-4042-48cc-91b6-419942048572 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:04.509459 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-52b8d0b9-4042-48cc-91b6-419942048572 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:04.515591 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-52b8d0b9-4042-48cc-91b6-419942048572 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:04.516041 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-52b8d0b9-4042-48cc-91b6-419942048572 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:04.516809 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-52b8d0b9-4042-48cc-91b6-419942048572 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:04.517251 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-52b8d0b9-4042-48cc-91b6-419942048572 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:04.573646 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-52b8d0b9-4042-48cc-91b6-419942048572 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:04.581184 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-52b8d0b9-4042-48cc-91b6-419942048572 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076686 Jan 11 15:43:04.581741 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1246/2239] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:04 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:05.597592 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b56a971d-f9bd-4de1-8160-4f9642a476e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:05.598137 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b56a971d-f9bd-4de1-8160-4f9642a476e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:05.605060 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b56a971d-f9bd-4de1-8160-4f9642a476e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:05.605523 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b56a971d-f9bd-4de1-8160-4f9642a476e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:05.606310 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b56a971d-f9bd-4de1-8160-4f9642a476e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:05.606757 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b56a971d-f9bd-4de1-8160-4f9642a476e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:05.662731 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-b56a971d-f9bd-4de1-8160-4f9642a476e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:05.670880 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b56a971d-f9bd-4de1-8160-4f9642a476e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076991 Jan 11 15:43:05.671472 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 994/2240] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:05 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:06.687210 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-30340aa7-59b2-4579-88c1-7d66d857ee08 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:06.687804 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-30340aa7-59b2-4579-88c1-7d66d857ee08 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:06.694009 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-30340aa7-59b2-4579-88c1-7d66d857ee08 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:06.694453 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-30340aa7-59b2-4579-88c1-7d66d857ee08 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:06.695222 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-30340aa7-59b2-4579-88c1-7d66d857ee08 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:06.695683 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-30340aa7-59b2-4579-88c1-7d66d857ee08 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:06.756743 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-30340aa7-59b2-4579-88c1-7d66d857ee08 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:06.764707 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-30340aa7-59b2-4579-88c1-7d66d857ee08 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.081217 Jan 11 15:43:06.765271 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1247/2241] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:06 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:07.781349 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-1abbaf99-5c4c-461e-b7b3-12e94ed176c6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:07.781959 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-1abbaf99-5c4c-461e-b7b3-12e94ed176c6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:07.788188 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1abbaf99-5c4c-461e-b7b3-12e94ed176c6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:07.788965 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1abbaf99-5c4c-461e-b7b3-12e94ed176c6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:07.790405 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1abbaf99-5c4c-461e-b7b3-12e94ed176c6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:07.790851 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1abbaf99-5c4c-461e-b7b3-12e94ed176c6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:08.083047 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-1abbaf99-5c4c-461e-b7b3-12e94ed176c6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:08.091598 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-1abbaf99-5c4c-461e-b7b3-12e94ed176c6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.314104 Jan 11 15:43:08.092172 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 995/2242] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:07 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:09.107867 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-802cae02-3308-4628-86fc-f7e45ec487b6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:09.108490 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-802cae02-3308-4628-86fc-f7e45ec487b6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:09.114727 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-802cae02-3308-4628-86fc-f7e45ec487b6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:09.115174 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-802cae02-3308-4628-86fc-f7e45ec487b6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:09.115974 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-802cae02-3308-4628-86fc-f7e45ec487b6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:09.116407 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-802cae02-3308-4628-86fc-f7e45ec487b6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:09.174334 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-802cae02-3308-4628-86fc-f7e45ec487b6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:09.182619 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-802cae02-3308-4628-86fc-f7e45ec487b6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.078392 Jan 11 15:43:09.183182 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1248/2243] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:09 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:10.198894 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2087efae-9e14-435c-aa6b-0d8f62664d96 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:10.199530 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2087efae-9e14-435c-aa6b-0d8f62664d96 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:10.205704 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2087efae-9e14-435c-aa6b-0d8f62664d96 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:10.206147 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2087efae-9e14-435c-aa6b-0d8f62664d96 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:10.206941 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2087efae-9e14-435c-aa6b-0d8f62664d96 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:10.207405 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2087efae-9e14-435c-aa6b-0d8f62664d96 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:10.264277 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-2087efae-9e14-435c-aa6b-0d8f62664d96 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:10.271859 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2087efae-9e14-435c-aa6b-0d8f62664d96 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076624 Jan 11 15:43:10.272413 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 996/2244] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:10 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:11.292251 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-02c1f0b5-f07e-47f0-bffa-e3056f24a685 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:11.292884 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-02c1f0b5-f07e-47f0-bffa-e3056f24a685 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:11.299283 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-02c1f0b5-f07e-47f0-bffa-e3056f24a685 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:11.299761 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-02c1f0b5-f07e-47f0-bffa-e3056f24a685 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:11.300535 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-02c1f0b5-f07e-47f0-bffa-e3056f24a685 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:11.300969 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-02c1f0b5-f07e-47f0-bffa-e3056f24a685 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:11.357161 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-02c1f0b5-f07e-47f0-bffa-e3056f24a685 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:11.364748 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-02c1f0b5-f07e-47f0-bffa-e3056f24a685 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076121 Jan 11 15:43:11.365303 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1249/2245] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:11 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:12.380639 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-6d4eb19b-3b5d-4bf1-bd5f-42f6b3cd2510 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:12.381239 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-6d4eb19b-3b5d-4bf1-bd5f-42f6b3cd2510 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:12.388093 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6d4eb19b-3b5d-4bf1-bd5f-42f6b3cd2510 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:12.388548 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6d4eb19b-3b5d-4bf1-bd5f-42f6b3cd2510 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:12.389312 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6d4eb19b-3b5d-4bf1-bd5f-42f6b3cd2510 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:12.389900 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6d4eb19b-3b5d-4bf1-bd5f-42f6b3cd2510 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:12.450125 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-6d4eb19b-3b5d-4bf1-bd5f-42f6b3cd2510 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:12.457765 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-6d4eb19b-3b5d-4bf1-bd5f-42f6b3cd2510 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.080812 Jan 11 15:43:12.458344 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 997/2246] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:12 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:13.474858 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-aa664e90-8a57-43c1-91f4-d515c430ec42 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:13.475550 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-aa664e90-8a57-43c1-91f4-d515c430ec42 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:13.482395 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aa664e90-8a57-43c1-91f4-d515c430ec42 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:13.482848 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aa664e90-8a57-43c1-91f4-d515c430ec42 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:13.483657 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aa664e90-8a57-43c1-91f4-d515c430ec42 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:13.484095 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-aa664e90-8a57-43c1-91f4-d515c430ec42 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:13.541857 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-aa664e90-8a57-43c1-91f4-d515c430ec42 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:13.549341 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-aa664e90-8a57-43c1-91f4-d515c430ec42 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.078118 Jan 11 15:43:13.549905 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1250/2247] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:13 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:14.565827 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-37c437bc-7775-43d7-8453-1ad4101ea96b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:14.566390 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-37c437bc-7775-43d7-8453-1ad4101ea96b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:14.572596 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-37c437bc-7775-43d7-8453-1ad4101ea96b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:14.573048 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-37c437bc-7775-43d7-8453-1ad4101ea96b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:14.573826 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-37c437bc-7775-43d7-8453-1ad4101ea96b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:14.574265 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-37c437bc-7775-43d7-8453-1ad4101ea96b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:14.630270 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-37c437bc-7775-43d7-8453-1ad4101ea96b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:14.637887 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-37c437bc-7775-43d7-8453-1ad4101ea96b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.075835 Jan 11 15:43:14.638444 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 998/2248] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:14 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:15.654443 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-24377562-8b6d-4911-8a45-b7479e4d5a14 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:15.654984 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-24377562-8b6d-4911-8a45-b7479e4d5a14 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:15.661231 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-24377562-8b6d-4911-8a45-b7479e4d5a14 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:15.661683 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-24377562-8b6d-4911-8a45-b7479e4d5a14 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:15.662448 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-24377562-8b6d-4911-8a45-b7479e4d5a14 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:15.662880 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-24377562-8b6d-4911-8a45-b7479e4d5a14 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:15.718937 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-24377562-8b6d-4911-8a45-b7479e4d5a14 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:15.726485 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-24377562-8b6d-4911-8a45-b7479e4d5a14 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076011 Jan 11 15:43:15.727044 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1251/2249] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:15 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:16.742958 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-8568d729-bd8b-4677-9839-9be49cfc8e3d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:16.743547 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-8568d729-bd8b-4677-9839-9be49cfc8e3d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:16.750414 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8568d729-bd8b-4677-9839-9be49cfc8e3d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:16.750870 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8568d729-bd8b-4677-9839-9be49cfc8e3d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:16.751688 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8568d729-bd8b-4677-9839-9be49cfc8e3d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:16.752121 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8568d729-bd8b-4677-9839-9be49cfc8e3d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:16.809164 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-8568d729-bd8b-4677-9839-9be49cfc8e3d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:16.817155 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-8568d729-bd8b-4677-9839-9be49cfc8e3d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077915 Jan 11 15:43:16.817714 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 999/2250] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:16 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:17.832931 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8471a710-d994-4029-b6fa-e9867e3a7e52 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:17.833524 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8471a710-d994-4029-b6fa-e9867e3a7e52 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:17.839791 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8471a710-d994-4029-b6fa-e9867e3a7e52 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:17.840245 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8471a710-d994-4029-b6fa-e9867e3a7e52 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:17.841049 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8471a710-d994-4029-b6fa-e9867e3a7e52 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:17.841492 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8471a710-d994-4029-b6fa-e9867e3a7e52 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:17.897239 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-8471a710-d994-4029-b6fa-e9867e3a7e52 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:17.905151 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8471a710-d994-4029-b6fa-e9867e3a7e52 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.075951 Jan 11 15:43:17.905717 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1252/2251] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:17 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:18.921943 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-78a6fb0d-51de-486c-8412-0bd239e43eaa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:18.922583 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-78a6fb0d-51de-486c-8412-0bd239e43eaa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:18.928817 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-78a6fb0d-51de-486c-8412-0bd239e43eaa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:18.929267 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-78a6fb0d-51de-486c-8412-0bd239e43eaa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:18.930034 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-78a6fb0d-51de-486c-8412-0bd239e43eaa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:18.930472 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-78a6fb0d-51de-486c-8412-0bd239e43eaa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:18.989839 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-78a6fb0d-51de-486c-8412-0bd239e43eaa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:18.997950 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-78a6fb0d-51de-486c-8412-0bd239e43eaa tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.079638 Jan 11 15:43:18.998499 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1000/2252] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:18 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:20.014373 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-0df96312-1bfb-4037-abe6-36193eb061e8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:20.014980 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-0df96312-1bfb-4037-abe6-36193eb061e8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:20.021242 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0df96312-1bfb-4037-abe6-36193eb061e8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:20.021687 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0df96312-1bfb-4037-abe6-36193eb061e8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:20.022455 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0df96312-1bfb-4037-abe6-36193eb061e8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:20.022892 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-0df96312-1bfb-4037-abe6-36193eb061e8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:20.079148 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-0df96312-1bfb-4037-abe6-36193eb061e8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:20.086576 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-0df96312-1bfb-4037-abe6-36193eb061e8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.075821 Jan 11 15:43:20.087129 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1253/2253] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:20 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:21.103754 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-da314096-99d7-4176-8616-24478dacddc2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:21.104350 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-da314096-99d7-4176-8616-24478dacddc2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:21.110617 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-da314096-99d7-4176-8616-24478dacddc2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:21.111064 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-da314096-99d7-4176-8616-24478dacddc2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:21.111868 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-da314096-99d7-4176-8616-24478dacddc2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:21.112306 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-da314096-99d7-4176-8616-24478dacddc2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:21.169564 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-da314096-99d7-4176-8616-24478dacddc2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:21.177122 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-da314096-99d7-4176-8616-24478dacddc2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077528 Jan 11 15:43:21.177679 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1001/2254] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:21 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:43:22.194618 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-383a0f71-728f-4dcb-8f40-8bb009be0e38 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:22.195816 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-383a0f71-728f-4dcb-8f40-8bb009be0e38 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:22.205000 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-383a0f71-728f-4dcb-8f40-8bb009be0e38 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:22.205507 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-383a0f71-728f-4dcb-8f40-8bb009be0e38 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:22.206338 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-383a0f71-728f-4dcb-8f40-8bb009be0e38 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:22.206806 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-383a0f71-728f-4dcb-8f40-8bb009be0e38 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:22.267822 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-383a0f71-728f-4dcb-8f40-8bb009be0e38 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:22.275969 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-383a0f71-728f-4dcb-8f40-8bb009be0e38 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.085907 Jan 11 15:43:22.276538 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1254/2255] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:22 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:23.293236 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2b18cdd6-b88d-4f98-9500-41b70d4c9ffc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:23.293869 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2b18cdd6-b88d-4f98-9500-41b70d4c9ffc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:23.300145 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2b18cdd6-b88d-4f98-9500-41b70d4c9ffc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:23.300593 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2b18cdd6-b88d-4f98-9500-41b70d4c9ffc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:23.301356 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2b18cdd6-b88d-4f98-9500-41b70d4c9ffc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:23.301791 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2b18cdd6-b88d-4f98-9500-41b70d4c9ffc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:23.359943 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-2b18cdd6-b88d-4f98-9500-41b70d4c9ffc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:23.367761 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2b18cdd6-b88d-4f98-9500-41b70d4c9ffc tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.078254 Jan 11 15:43:23.368332 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1002/2256] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:23 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:24.384539 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b0ea68e3-55d8-435f-a41d-4c66c2c37c5a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:24.385149 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b0ea68e3-55d8-435f-a41d-4c66c2c37c5a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:24.391187 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b0ea68e3-55d8-435f-a41d-4c66c2c37c5a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:24.391749 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b0ea68e3-55d8-435f-a41d-4c66c2c37c5a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:24.392522 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b0ea68e3-55d8-435f-a41d-4c66c2c37c5a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:24.392961 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b0ea68e3-55d8-435f-a41d-4c66c2c37c5a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:24.450273 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b0ea68e3-55d8-435f-a41d-4c66c2c37c5a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:24.457955 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b0ea68e3-55d8-435f-a41d-4c66c2c37c5a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077188 Jan 11 15:43:24.458518 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1255/2257] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:24 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:25.474831 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-59b01970-231e-4715-8ad8-4ccafbfec730 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:25.475470 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-59b01970-231e-4715-8ad8-4ccafbfec730 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:25.481927 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-59b01970-231e-4715-8ad8-4ccafbfec730 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:25.482372 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-59b01970-231e-4715-8ad8-4ccafbfec730 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:25.483136 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-59b01970-231e-4715-8ad8-4ccafbfec730 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:25.483597 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-59b01970-231e-4715-8ad8-4ccafbfec730 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:25.542543 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-59b01970-231e-4715-8ad8-4ccafbfec730 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:25.550203 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-59b01970-231e-4715-8ad8-4ccafbfec730 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.079030 Jan 11 15:43:25.550754 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1003/2258] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:25 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:26.567522 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e3a78d7b-a96d-4c13-b83d-4a41384b722e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:26.568087 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e3a78d7b-a96d-4c13-b83d-4a41384b722e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:26.574798 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e3a78d7b-a96d-4c13-b83d-4a41384b722e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:26.575246 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e3a78d7b-a96d-4c13-b83d-4a41384b722e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:26.576033 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e3a78d7b-a96d-4c13-b83d-4a41384b722e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:26.576472 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e3a78d7b-a96d-4c13-b83d-4a41384b722e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:26.633093 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e3a78d7b-a96d-4c13-b83d-4a41384b722e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:26.641375 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e3a78d7b-a96d-4c13-b83d-4a41384b722e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077681 Jan 11 15:43:26.641927 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1256/2259] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:26 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:27.657994 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-469ab8bf-8b25-4f84-82e0-72fbf62e0c60 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:27.658510 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-469ab8bf-8b25-4f84-82e0-72fbf62e0c60 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:27.664745 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-469ab8bf-8b25-4f84-82e0-72fbf62e0c60 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:27.665713 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-469ab8bf-8b25-4f84-82e0-72fbf62e0c60 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:27.666490 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-469ab8bf-8b25-4f84-82e0-72fbf62e0c60 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:27.666928 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-469ab8bf-8b25-4f84-82e0-72fbf62e0c60 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:27.736843 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-469ab8bf-8b25-4f84-82e0-72fbf62e0c60 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:27.745357 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-469ab8bf-8b25-4f84-82e0-72fbf62e0c60 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.090984 Jan 11 15:43:27.745951 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1004/2260] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:27 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:28.762273 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b5c5b9f9-69b7-44e8-a670-217764d92e85 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:28.762952 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b5c5b9f9-69b7-44e8-a670-217764d92e85 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:28.769191 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b5c5b9f9-69b7-44e8-a670-217764d92e85 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:28.769640 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b5c5b9f9-69b7-44e8-a670-217764d92e85 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:28.770420 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b5c5b9f9-69b7-44e8-a670-217764d92e85 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:28.770857 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b5c5b9f9-69b7-44e8-a670-217764d92e85 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:28.828216 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b5c5b9f9-69b7-44e8-a670-217764d92e85 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:28.835889 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b5c5b9f9-69b7-44e8-a670-217764d92e85 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077826 Jan 11 15:43:28.836453 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1257/2261] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:28 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:29.852197 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4356b3d4-c508-42f4-b148-7b5bcb8fe134 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:29.853276 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4356b3d4-c508-42f4-b148-7b5bcb8fe134 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:29.860242 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4356b3d4-c508-42f4-b148-7b5bcb8fe134 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:29.860807 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4356b3d4-c508-42f4-b148-7b5bcb8fe134 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:29.861663 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4356b3d4-c508-42f4-b148-7b5bcb8fe134 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:29.862105 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4356b3d4-c508-42f4-b148-7b5bcb8fe134 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:29.922995 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-4356b3d4-c508-42f4-b148-7b5bcb8fe134 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:29.931472 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4356b3d4-c508-42f4-b148-7b5bcb8fe134 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.082617 Jan 11 15:43:29.934890 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1005/2262] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:29 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:30.948784 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a02fc1ac-3af4-4780-8cf1-c1c498314a06 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:30.949397 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a02fc1ac-3af4-4780-8cf1-c1c498314a06 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:30.955679 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a02fc1ac-3af4-4780-8cf1-c1c498314a06 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:30.956129 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a02fc1ac-3af4-4780-8cf1-c1c498314a06 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:30.956919 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a02fc1ac-3af4-4780-8cf1-c1c498314a06 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:30.957353 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a02fc1ac-3af4-4780-8cf1-c1c498314a06 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:31.014728 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a02fc1ac-3af4-4780-8cf1-c1c498314a06 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:31.022381 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a02fc1ac-3af4-4780-8cf1-c1c498314a06 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.078176 Jan 11 15:43:31.022935 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1258/2263] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:30 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:32.038996 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c924e964-5601-40ef-bea0-4250a1fb6f83 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:32.039631 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c924e964-5601-40ef-bea0-4250a1fb6f83 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:32.046287 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c924e964-5601-40ef-bea0-4250a1fb6f83 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:32.046738 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c924e964-5601-40ef-bea0-4250a1fb6f83 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:32.047537 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c924e964-5601-40ef-bea0-4250a1fb6f83 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:32.047971 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c924e964-5601-40ef-bea0-4250a1fb6f83 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:32.104242 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-c924e964-5601-40ef-bea0-4250a1fb6f83 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:32.111834 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c924e964-5601-40ef-bea0-4250a1fb6f83 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076456 Jan 11 15:43:32.112387 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1006/2264] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:32 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:33.128754 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6c68befc-8b33-4ea8-80e4-ca98607b86e8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:33.129386 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6c68befc-8b33-4ea8-80e4-ca98607b86e8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:33.136126 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6c68befc-8b33-4ea8-80e4-ca98607b86e8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:33.136571 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6c68befc-8b33-4ea8-80e4-ca98607b86e8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:33.137334 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6c68befc-8b33-4ea8-80e4-ca98607b86e8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:33.137767 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6c68befc-8b33-4ea8-80e4-ca98607b86e8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:33.197903 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6c68befc-8b33-4ea8-80e4-ca98607b86e8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:33.205469 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6c68befc-8b33-4ea8-80e4-ca98607b86e8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.080327 Jan 11 15:43:33.206026 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1259/2265] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:33 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:34.221787 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7deb5f8a-33ba-49d6-b95f-18c950bbfdce tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:34.222398 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7deb5f8a-33ba-49d6-b95f-18c950bbfdce tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:34.229214 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7deb5f8a-33ba-49d6-b95f-18c950bbfdce tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:34.229658 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7deb5f8a-33ba-49d6-b95f-18c950bbfdce tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:34.230418 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7deb5f8a-33ba-49d6-b95f-18c950bbfdce tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:34.230854 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7deb5f8a-33ba-49d6-b95f-18c950bbfdce tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:34.289340 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-7deb5f8a-33ba-49d6-b95f-18c950bbfdce tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:34.298058 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7deb5f8a-33ba-49d6-b95f-18c950bbfdce tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.079986 Jan 11 15:43:34.298615 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1007/2266] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:34 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:35.314572 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-254490f9-1a29-4bfb-84e6-9103a5e2bd4c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:35.315221 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-254490f9-1a29-4bfb-84e6-9103a5e2bd4c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:35.321605 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-254490f9-1a29-4bfb-84e6-9103a5e2bd4c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:35.322048 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-254490f9-1a29-4bfb-84e6-9103a5e2bd4c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:35.322819 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-254490f9-1a29-4bfb-84e6-9103a5e2bd4c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:35.323251 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-254490f9-1a29-4bfb-84e6-9103a5e2bd4c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:35.380250 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-254490f9-1a29-4bfb-84e6-9103a5e2bd4c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:35.387824 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-254490f9-1a29-4bfb-84e6-9103a5e2bd4c tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077046 Jan 11 15:43:35.388384 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1260/2267] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:35 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:36.404557 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3e6f855f-b703-47f5-baed-90b58fe9498d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:36.405180 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3e6f855f-b703-47f5-baed-90b58fe9498d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:36.411439 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3e6f855f-b703-47f5-baed-90b58fe9498d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:36.411892 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3e6f855f-b703-47f5-baed-90b58fe9498d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:36.412664 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3e6f855f-b703-47f5-baed-90b58fe9498d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:36.413105 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3e6f855f-b703-47f5-baed-90b58fe9498d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:36.472653 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-3e6f855f-b703-47f5-baed-90b58fe9498d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:36.484323 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3e6f855f-b703-47f5-baed-90b58fe9498d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.082335 Jan 11 15:43:36.484910 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1008/2268] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:36 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:37.501367 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-055e05c5-35ea-4aa8-9119-aec556eff9ef tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:37.502028 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-055e05c5-35ea-4aa8-9119-aec556eff9ef tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:37.508973 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-055e05c5-35ea-4aa8-9119-aec556eff9ef tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:37.509209 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-055e05c5-35ea-4aa8-9119-aec556eff9ef tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:37.509998 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-055e05c5-35ea-4aa8-9119-aec556eff9ef tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:37.510444 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-055e05c5-35ea-4aa8-9119-aec556eff9ef tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:37.567062 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-055e05c5-35ea-4aa8-9119-aec556eff9ef tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:37.575202 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-055e05c5-35ea-4aa8-9119-aec556eff9ef tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077514 Jan 11 15:43:37.575797 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1261/2269] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:37 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:38.591875 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-cfaa1f21-c8e2-4437-9060-790bafbb0b47 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:38.592488 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-cfaa1f21-c8e2-4437-9060-790bafbb0b47 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:38.598768 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cfaa1f21-c8e2-4437-9060-790bafbb0b47 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:38.599222 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cfaa1f21-c8e2-4437-9060-790bafbb0b47 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:38.600026 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cfaa1f21-c8e2-4437-9060-790bafbb0b47 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:38.600464 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cfaa1f21-c8e2-4437-9060-790bafbb0b47 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:38.666612 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-cfaa1f21-c8e2-4437-9060-790bafbb0b47 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:38.666612 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-cfaa1f21-c8e2-4437-9060-790bafbb0b47 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077941 Jan 11 15:43:38.667678 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1009/2270] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:38 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:39.683122 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-bb2c66f7-94cb-4478-b867-2f901c17c709 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:39.683759 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-bb2c66f7-94cb-4478-b867-2f901c17c709 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:39.690273 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bb2c66f7-94cb-4478-b867-2f901c17c709 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:39.690731 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bb2c66f7-94cb-4478-b867-2f901c17c709 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:39.691571 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bb2c66f7-94cb-4478-b867-2f901c17c709 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:39.692016 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-bb2c66f7-94cb-4478-b867-2f901c17c709 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:39.749634 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-bb2c66f7-94cb-4478-b867-2f901c17c709 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:39.757646 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-bb2c66f7-94cb-4478-b867-2f901c17c709 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.079158 Jan 11 15:43:39.758211 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1262/2271] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:39 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:40.773859 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-75e2d2da-0db4-46c7-9eda-df27548bba8e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:40.774469 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-75e2d2da-0db4-46c7-9eda-df27548bba8e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:40.781482 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-75e2d2da-0db4-46c7-9eda-df27548bba8e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:40.781934 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-75e2d2da-0db4-46c7-9eda-df27548bba8e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:40.782707 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-75e2d2da-0db4-46c7-9eda-df27548bba8e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:40.783148 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-75e2d2da-0db4-46c7-9eda-df27548bba8e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:40.839370 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-75e2d2da-0db4-46c7-9eda-df27548bba8e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:40.847272 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-75e2d2da-0db4-46c7-9eda-df27548bba8e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077010 Jan 11 15:43:40.847865 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1010/2272] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:40 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:41.865008 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-64aa0393-f04a-41e3-a960-e7d7181abcd9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:41.865572 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-64aa0393-f04a-41e3-a960-e7d7181abcd9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:41.871838 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-64aa0393-f04a-41e3-a960-e7d7181abcd9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:41.872295 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-64aa0393-f04a-41e3-a960-e7d7181abcd9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:41.873073 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-64aa0393-f04a-41e3-a960-e7d7181abcd9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:41.873518 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-64aa0393-f04a-41e3-a960-e7d7181abcd9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:41.929975 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-64aa0393-f04a-41e3-a960-e7d7181abcd9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:41.937572 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-64aa0393-f04a-41e3-a960-e7d7181abcd9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076326 Jan 11 15:43:41.938129 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1263/2273] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:41 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:42.954019 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-936d1f67-a7b2-4803-b6ef-218c36dbf040 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:42.954643 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-936d1f67-a7b2-4803-b6ef-218c36dbf040 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:42.960798 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-936d1f67-a7b2-4803-b6ef-218c36dbf040 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:42.961243 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-936d1f67-a7b2-4803-b6ef-218c36dbf040 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:42.962007 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-936d1f67-a7b2-4803-b6ef-218c36dbf040 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:42.962440 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-936d1f67-a7b2-4803-b6ef-218c36dbf040 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:43.022720 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-936d1f67-a7b2-4803-b6ef-218c36dbf040 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:43.031103 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-936d1f67-a7b2-4803-b6ef-218c36dbf040 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.080768 Jan 11 15:43:43.031699 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1011/2274] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:42 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:44.046959 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4ad0345d-17b6-4357-a15d-5c1ccf1ce812 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:44.047594 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-4ad0345d-17b6-4357-a15d-5c1ccf1ce812 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:44.053821 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4ad0345d-17b6-4357-a15d-5c1ccf1ce812 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:44.054276 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4ad0345d-17b6-4357-a15d-5c1ccf1ce812 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:44.055044 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4ad0345d-17b6-4357-a15d-5c1ccf1ce812 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:44.055515 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4ad0345d-17b6-4357-a15d-5c1ccf1ce812 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:44.111499 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-4ad0345d-17b6-4357-a15d-5c1ccf1ce812 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:44.119008 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4ad0345d-17b6-4357-a15d-5c1ccf1ce812 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.075683 Jan 11 15:43:44.119602 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1264/2275] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:44 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:45.135967 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b8d80a46-f901-4f8c-bae8-b033524c183d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:45.136570 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b8d80a46-f901-4f8c-bae8-b033524c183d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:45.143543 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b8d80a46-f901-4f8c-bae8-b033524c183d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:45.144002 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b8d80a46-f901-4f8c-bae8-b033524c183d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:45.144775 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b8d80a46-f901-4f8c-bae8-b033524c183d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:45.145216 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b8d80a46-f901-4f8c-bae8-b033524c183d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:45.203817 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-b8d80a46-f901-4f8c-bae8-b033524c183d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:45.212140 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b8d80a46-f901-4f8c-bae8-b033524c183d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.079666 Jan 11 15:43:45.212940 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1012/2276] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:45 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:46.228631 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f2fe3076-0cc7-4132-88c9-48574be22ca9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:46.229243 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f2fe3076-0cc7-4132-88c9-48574be22ca9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:46.236116 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f2fe3076-0cc7-4132-88c9-48574be22ca9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:46.236571 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f2fe3076-0cc7-4132-88c9-48574be22ca9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:46.237355 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f2fe3076-0cc7-4132-88c9-48574be22ca9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:46.237795 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f2fe3076-0cc7-4132-88c9-48574be22ca9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:46.295476 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f2fe3076-0cc7-4132-88c9-48574be22ca9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:46.303175 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f2fe3076-0cc7-4132-88c9-48574be22ca9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.078204 Jan 11 15:43:46.303776 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1265/2277] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:46 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:47.320240 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f65cab33-94ef-4bf9-b632-209ca6ed1a9f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:47.320776 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f65cab33-94ef-4bf9-b632-209ca6ed1a9f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:47.327575 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f65cab33-94ef-4bf9-b632-209ca6ed1a9f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:47.330958 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f65cab33-94ef-4bf9-b632-209ca6ed1a9f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:47.330958 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f65cab33-94ef-4bf9-b632-209ca6ed1a9f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:47.330958 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f65cab33-94ef-4bf9-b632-209ca6ed1a9f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:47.385715 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-f65cab33-94ef-4bf9-b632-209ca6ed1a9f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:47.393996 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f65cab33-94ef-4bf9-b632-209ca6ed1a9f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077489 Jan 11 15:43:47.394557 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1013/2278] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:47 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:48.409853 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-47600374-1b41-4306-84a7-10a7a6fa686f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:48.410518 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-47600374-1b41-4306-84a7-10a7a6fa686f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:48.416822 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-47600374-1b41-4306-84a7-10a7a6fa686f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:48.417273 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-47600374-1b41-4306-84a7-10a7a6fa686f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:48.418050 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-47600374-1b41-4306-84a7-10a7a6fa686f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:48.418491 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-47600374-1b41-4306-84a7-10a7a6fa686f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:48.502857 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-47600374-1b41-4306-84a7-10a7a6fa686f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:48.510822 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-47600374-1b41-4306-84a7-10a7a6fa686f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.104520 Jan 11 15:43:48.515793 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1266/2279] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:48 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:49.527904 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-281650b1-b5d7-469b-9f3e-6b9abcaca483 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:49.529431 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-281650b1-b5d7-469b-9f3e-6b9abcaca483 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:49.536287 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-281650b1-b5d7-469b-9f3e-6b9abcaca483 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:49.536746 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-281650b1-b5d7-469b-9f3e-6b9abcaca483 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:49.537544 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-281650b1-b5d7-469b-9f3e-6b9abcaca483 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:49.537982 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-281650b1-b5d7-469b-9f3e-6b9abcaca483 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:49.605464 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-281650b1-b5d7-469b-9f3e-6b9abcaca483 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:49.613707 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-281650b1-b5d7-469b-9f3e-6b9abcaca483 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.089763 Jan 11 15:43:49.614269 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1014/2280] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:49 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:50.629549 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-43a87849-6e48-49d6-a881-bea8847db564 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:50.630256 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-43a87849-6e48-49d6-a881-bea8847db564 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:50.639228 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-43a87849-6e48-49d6-a881-bea8847db564 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:50.639228 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-43a87849-6e48-49d6-a881-bea8847db564 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:50.639228 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-43a87849-6e48-49d6-a881-bea8847db564 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:50.639228 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-43a87849-6e48-49d6-a881-bea8847db564 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:50.701734 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-43a87849-6e48-49d6-a881-bea8847db564 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:50.706971 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-43a87849-6e48-49d6-a881-bea8847db564 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.081148 Jan 11 15:43:50.707571 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1267/2281] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:50 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:51.723378 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-515b1e83-0040-4c9d-8419-4297e01ea795 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:51.723938 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-515b1e83-0040-4c9d-8419-4297e01ea795 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:51.730124 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-515b1e83-0040-4c9d-8419-4297e01ea795 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:51.730571 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-515b1e83-0040-4c9d-8419-4297e01ea795 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:51.731360 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-515b1e83-0040-4c9d-8419-4297e01ea795 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:51.731797 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-515b1e83-0040-4c9d-8419-4297e01ea795 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:51.788927 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-515b1e83-0040-4c9d-8419-4297e01ea795 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:51.796591 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-515b1e83-0040-4c9d-8419-4297e01ea795 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077029 Jan 11 15:43:51.797193 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1015/2282] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:51 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:52.813518 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-03074dc4-a492-42d2-884d-d11435f296f1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:52.814120 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-03074dc4-a492-42d2-884d-d11435f296f1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:52.820333 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-03074dc4-a492-42d2-884d-d11435f296f1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:52.820783 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-03074dc4-a492-42d2-884d-d11435f296f1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:52.821555 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-03074dc4-a492-42d2-884d-d11435f296f1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:52.821991 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-03074dc4-a492-42d2-884d-d11435f296f1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:52.885293 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-03074dc4-a492-42d2-884d-d11435f296f1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:52.893735 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-03074dc4-a492-42d2-884d-d11435f296f1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.084379 Jan 11 15:43:52.894297 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1268/2283] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:52 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:53.911977 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-fe2f94bd-f79b-4749-a053-77b1c6cb66a4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:53.912605 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-fe2f94bd-f79b-4749-a053-77b1c6cb66a4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:53.918834 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fe2f94bd-f79b-4749-a053-77b1c6cb66a4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:53.919284 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fe2f94bd-f79b-4749-a053-77b1c6cb66a4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:53.920136 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fe2f94bd-f79b-4749-a053-77b1c6cb66a4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:53.920584 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fe2f94bd-f79b-4749-a053-77b1c6cb66a4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:53.977943 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-fe2f94bd-f79b-4749-a053-77b1c6cb66a4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:53.985609 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-fe2f94bd-f79b-4749-a053-77b1c6cb66a4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077707 Jan 11 15:43:53.986161 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1016/2284] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:53 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:55.002170 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-960e32ca-34cb-4d02-998e-b9b4239d39b7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:55.002785 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-960e32ca-34cb-4d02-998e-b9b4239d39b7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:55.008588 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-960e32ca-34cb-4d02-998e-b9b4239d39b7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:55.009038 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-960e32ca-34cb-4d02-998e-b9b4239d39b7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:55.009802 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-960e32ca-34cb-4d02-998e-b9b4239d39b7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:55.010242 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-960e32ca-34cb-4d02-998e-b9b4239d39b7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:55.068350 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-960e32ca-34cb-4d02-998e-b9b4239d39b7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:55.076054 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-960e32ca-34cb-4d02-998e-b9b4239d39b7 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077788 Jan 11 15:43:55.076615 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1269/2285] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:54 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:56.092531 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-8afb5190-fb5a-4ddb-bdf9-a41dd8ae5a18 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:56.093762 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-8afb5190-fb5a-4ddb-bdf9-a41dd8ae5a18 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:56.099788 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8afb5190-fb5a-4ddb-bdf9-a41dd8ae5a18 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:56.100245 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8afb5190-fb5a-4ddb-bdf9-a41dd8ae5a18 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:56.101026 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8afb5190-fb5a-4ddb-bdf9-a41dd8ae5a18 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:56.101470 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8afb5190-fb5a-4ddb-bdf9-a41dd8ae5a18 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:56.160704 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-8afb5190-fb5a-4ddb-bdf9-a41dd8ae5a18 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:56.168246 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-8afb5190-fb5a-4ddb-bdf9-a41dd8ae5a18 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.079371 Jan 11 15:43:56.168805 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1017/2286] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:56 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:57.184541 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7a3029c3-86e8-42ae-a9f9-43744e7890ea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:57.185158 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-7a3029c3-86e8-42ae-a9f9-43744e7890ea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:57.191363 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7a3029c3-86e8-42ae-a9f9-43744e7890ea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:57.191814 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7a3029c3-86e8-42ae-a9f9-43744e7890ea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:57.192579 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7a3029c3-86e8-42ae-a9f9-43744e7890ea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:57.193017 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7a3029c3-86e8-42ae-a9f9-43744e7890ea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:57.254919 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-7a3029c3-86e8-42ae-a9f9-43744e7890ea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:57.262669 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7a3029c3-86e8-42ae-a9f9-43744e7890ea tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.081800 Jan 11 15:43:57.263231 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1270/2287] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:57 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:58.279094 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2f6d2212-2e9b-4551-8623-730e380c5ba6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:58.279727 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2f6d2212-2e9b-4551-8623-730e380c5ba6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:58.285958 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2f6d2212-2e9b-4551-8623-730e380c5ba6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:58.286410 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2f6d2212-2e9b-4551-8623-730e380c5ba6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:58.287179 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2f6d2212-2e9b-4551-8623-730e380c5ba6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:58.287644 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2f6d2212-2e9b-4551-8623-730e380c5ba6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:58.345469 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-2f6d2212-2e9b-4551-8623-730e380c5ba6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:58.352901 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2f6d2212-2e9b-4551-8623-730e380c5ba6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077730 Jan 11 15:43:58.353456 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1018/2288] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:58 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:43:59.369150 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d3ccff9d-8383-49bc-bf78-607a15ca62f4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:43:59.369735 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d3ccff9d-8383-49bc-bf78-607a15ca62f4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:43:59.376066 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d3ccff9d-8383-49bc-bf78-607a15ca62f4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:59.376549 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d3ccff9d-8383-49bc-bf78-607a15ca62f4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:59.377326 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d3ccff9d-8383-49bc-bf78-607a15ca62f4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:43:59.377768 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d3ccff9d-8383-49bc-bf78-607a15ca62f4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:43:59.435064 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d3ccff9d-8383-49bc-bf78-607a15ca62f4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:43:59.442722 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d3ccff9d-8383-49bc-bf78-607a15ca62f4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077334 Jan 11 15:43:59.443313 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1271/2289] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:43:59 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:00.459658 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-6d6ad0b8-e48e-4f10-8c92-8e925ced71e9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:00.460266 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-6d6ad0b8-e48e-4f10-8c92-8e925ced71e9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:00.466504 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6d6ad0b8-e48e-4f10-8c92-8e925ced71e9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:00.466953 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6d6ad0b8-e48e-4f10-8c92-8e925ced71e9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:00.467748 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6d6ad0b8-e48e-4f10-8c92-8e925ced71e9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:00.468185 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6d6ad0b8-e48e-4f10-8c92-8e925ced71e9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:00.524205 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-6d6ad0b8-e48e-4f10-8c92-8e925ced71e9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:00.532088 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-6d6ad0b8-e48e-4f10-8c92-8e925ced71e9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076053 Jan 11 15:44:00.532651 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1019/2290] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:00 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:01.548501 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a06a1709-250c-49ee-bf6f-9b2352d10065 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:01.549108 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a06a1709-250c-49ee-bf6f-9b2352d10065 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:01.555324 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a06a1709-250c-49ee-bf6f-9b2352d10065 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:01.555790 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a06a1709-250c-49ee-bf6f-9b2352d10065 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:01.556553 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a06a1709-250c-49ee-bf6f-9b2352d10065 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:01.556991 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a06a1709-250c-49ee-bf6f-9b2352d10065 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:01.613262 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a06a1709-250c-49ee-bf6f-9b2352d10065 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:01.620816 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a06a1709-250c-49ee-bf6f-9b2352d10065 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076004 Jan 11 15:44:01.621915 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1272/2291] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:01 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:02.637679 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-0529b90b-907d-442b-80bb-cca03fd4423f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:02.638242 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-0529b90b-907d-442b-80bb-cca03fd4423f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:02.644438 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0529b90b-907d-442b-80bb-cca03fd4423f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:02.644892 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0529b90b-907d-442b-80bb-cca03fd4423f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:02.645666 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0529b90b-907d-442b-80bb-cca03fd4423f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:02.646105 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0529b90b-907d-442b-80bb-cca03fd4423f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:02.706772 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-0529b90b-907d-442b-80bb-cca03fd4423f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:02.714375 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-0529b90b-907d-442b-80bb-cca03fd4423f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.080407 Jan 11 15:44:02.714913 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1020/2292] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:02 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:03.731837 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-82594f0b-cf7d-49ac-b551-9fb2d8ce0abb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:03.732434 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-82594f0b-cf7d-49ac-b551-9fb2d8ce0abb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:03.738767 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-82594f0b-cf7d-49ac-b551-9fb2d8ce0abb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:03.739225 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-82594f0b-cf7d-49ac-b551-9fb2d8ce0abb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:03.740037 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-82594f0b-cf7d-49ac-b551-9fb2d8ce0abb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:03.740484 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-82594f0b-cf7d-49ac-b551-9fb2d8ce0abb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:03.797842 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-82594f0b-cf7d-49ac-b551-9fb2d8ce0abb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:03.805510 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-82594f0b-cf7d-49ac-b551-9fb2d8ce0abb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077923 Jan 11 15:44:03.806072 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1273/2293] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:03 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:04.822002 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b2f9c297-3909-43a3-80d5-6e72247752bf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:04.822640 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b2f9c297-3909-43a3-80d5-6e72247752bf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:04.829594 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b2f9c297-3909-43a3-80d5-6e72247752bf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:04.830074 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b2f9c297-3909-43a3-80d5-6e72247752bf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:04.830843 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b2f9c297-3909-43a3-80d5-6e72247752bf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:04.831274 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b2f9c297-3909-43a3-80d5-6e72247752bf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:04.887975 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-b2f9c297-3909-43a3-80d5-6e72247752bf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:04.895632 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b2f9c297-3909-43a3-80d5-6e72247752bf tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077255 Jan 11 15:44:04.896199 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1021/2294] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:04 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:05.913924 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-15ec1db6-6f27-41f2-9446-2fc8279a657e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:05.914460 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-15ec1db6-6f27-41f2-9446-2fc8279a657e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:05.920721 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-15ec1db6-6f27-41f2-9446-2fc8279a657e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:05.921177 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-15ec1db6-6f27-41f2-9446-2fc8279a657e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:05.921956 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-15ec1db6-6f27-41f2-9446-2fc8279a657e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:05.922404 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-15ec1db6-6f27-41f2-9446-2fc8279a657e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:05.979032 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-15ec1db6-6f27-41f2-9446-2fc8279a657e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:05.986682 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-15ec1db6-6f27-41f2-9446-2fc8279a657e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076520 Jan 11 15:44:05.987243 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1274/2295] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:05 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:07.002984 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ed0da0d8-0509-4edc-bd1f-a2673d38a37f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:07.009922 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-ed0da0d8-0509-4edc-bd1f-a2673d38a37f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:07.010121 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ed0da0d8-0509-4edc-bd1f-a2673d38a37f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:07.010409 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ed0da0d8-0509-4edc-bd1f-a2673d38a37f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:07.011178 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ed0da0d8-0509-4edc-bd1f-a2673d38a37f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:07.011640 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ed0da0d8-0509-4edc-bd1f-a2673d38a37f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:07.068795 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-ed0da0d8-0509-4edc-bd1f-a2673d38a37f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:07.076338 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-ed0da0d8-0509-4edc-bd1f-a2673d38a37f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076972 Jan 11 15:44:07.076891 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1022/2296] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:06 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:08.093222 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4094c7be-b1cb-46ad-bfa5-e845989e165a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:08.093837 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-4094c7be-b1cb-46ad-bfa5-e845989e165a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:08.100215 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4094c7be-b1cb-46ad-bfa5-e845989e165a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:08.100667 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4094c7be-b1cb-46ad-bfa5-e845989e165a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:08.101443 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4094c7be-b1cb-46ad-bfa5-e845989e165a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:08.101883 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4094c7be-b1cb-46ad-bfa5-e845989e165a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:08.159025 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-4094c7be-b1cb-46ad-bfa5-e845989e165a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:08.166645 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4094c7be-b1cb-46ad-bfa5-e845989e165a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077751 Jan 11 15:44:08.167204 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1275/2297] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:08 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:09.183053 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ef81fe5b-96b4-4b82-a9af-27b0bfe9ff85 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:09.183775 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-ef81fe5b-96b4-4b82-a9af-27b0bfe9ff85 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:09.189969 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ef81fe5b-96b4-4b82-a9af-27b0bfe9ff85 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:09.190418 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ef81fe5b-96b4-4b82-a9af-27b0bfe9ff85 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:09.191180 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ef81fe5b-96b4-4b82-a9af-27b0bfe9ff85 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:09.191640 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ef81fe5b-96b4-4b82-a9af-27b0bfe9ff85 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:09.255486 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-ef81fe5b-96b4-4b82-a9af-27b0bfe9ff85 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:09.259827 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-ef81fe5b-96b4-4b82-a9af-27b0bfe9ff85 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.080491 Jan 11 15:44:09.260391 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1023/2298] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:09 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:10.276202 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4d735e23-16b8-47a4-8f3d-aee8767523c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:10.277091 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-4d735e23-16b8-47a4-8f3d-aee8767523c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:10.283531 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4d735e23-16b8-47a4-8f3d-aee8767523c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:10.283991 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4d735e23-16b8-47a4-8f3d-aee8767523c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:10.284774 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4d735e23-16b8-47a4-8f3d-aee8767523c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:10.285223 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4d735e23-16b8-47a4-8f3d-aee8767523c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:10.343357 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-4d735e23-16b8-47a4-8f3d-aee8767523c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:10.351144 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4d735e23-16b8-47a4-8f3d-aee8767523c0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.078627 Jan 11 15:44:10.351742 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1276/2299] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:10 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:11.367262 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-762751d1-615c-4c51-bc35-d53796f5ebf8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:11.367892 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-762751d1-615c-4c51-bc35-d53796f5ebf8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:11.374159 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-762751d1-615c-4c51-bc35-d53796f5ebf8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:11.374606 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-762751d1-615c-4c51-bc35-d53796f5ebf8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:11.375407 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-762751d1-615c-4c51-bc35-d53796f5ebf8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:11.375843 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-762751d1-615c-4c51-bc35-d53796f5ebf8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:11.433817 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-762751d1-615c-4c51-bc35-d53796f5ebf8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:11.441282 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-762751d1-615c-4c51-bc35-d53796f5ebf8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077692 Jan 11 15:44:11.441841 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1024/2300] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:11 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:12.457851 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b7f4f417-b9b0-414d-bc25-6d00549497fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:12.458466 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b7f4f417-b9b0-414d-bc25-6d00549497fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:12.465337 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b7f4f417-b9b0-414d-bc25-6d00549497fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:12.465793 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b7f4f417-b9b0-414d-bc25-6d00549497fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:12.466575 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b7f4f417-b9b0-414d-bc25-6d00549497fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:12.467018 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b7f4f417-b9b0-414d-bc25-6d00549497fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:12.523419 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b7f4f417-b9b0-414d-bc25-6d00549497fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:12.532028 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b7f4f417-b9b0-414d-bc25-6d00549497fb tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077848 Jan 11 15:44:12.532603 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1277/2301] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:12 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:13.548399 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4c248ab7-1f28-4c6f-981e-1c8d002d2365 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:13.549008 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4c248ab7-1f28-4c6f-981e-1c8d002d2365 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:13.555209 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4c248ab7-1f28-4c6f-981e-1c8d002d2365 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:13.555681 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4c248ab7-1f28-4c6f-981e-1c8d002d2365 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:13.556451 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4c248ab7-1f28-4c6f-981e-1c8d002d2365 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:13.556888 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4c248ab7-1f28-4c6f-981e-1c8d002d2365 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:13.614028 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-4c248ab7-1f28-4c6f-981e-1c8d002d2365 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:13.622069 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4c248ab7-1f28-4c6f-981e-1c8d002d2365 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077340 Jan 11 15:44:13.622623 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1025/2302] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:13 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:14.639492 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5ce25495-dcea-495e-878f-c0c10a54fc16 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:14.640084 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5ce25495-dcea-495e-878f-c0c10a54fc16 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:14.646197 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5ce25495-dcea-495e-878f-c0c10a54fc16 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:14.646646 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5ce25495-dcea-495e-878f-c0c10a54fc16 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:14.647442 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5ce25495-dcea-495e-878f-c0c10a54fc16 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:14.647881 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5ce25495-dcea-495e-878f-c0c10a54fc16 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:14.705461 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-5ce25495-dcea-495e-878f-c0c10a54fc16 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:14.713033 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5ce25495-dcea-495e-878f-c0c10a54fc16 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.078062 Jan 11 15:44:14.713597 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1278/2303] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:14 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:15.729379 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-9bae2f7d-e291-4b8d-b4e5-af507fffd7b4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:15.729990 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-9bae2f7d-e291-4b8d-b4e5-af507fffd7b4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:15.736209 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9bae2f7d-e291-4b8d-b4e5-af507fffd7b4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:15.736690 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9bae2f7d-e291-4b8d-b4e5-af507fffd7b4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:15.737458 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9bae2f7d-e291-4b8d-b4e5-af507fffd7b4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:15.737897 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-9bae2f7d-e291-4b8d-b4e5-af507fffd7b4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:15.797331 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-9bae2f7d-e291-4b8d-b4e5-af507fffd7b4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:15.804948 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-9bae2f7d-e291-4b8d-b4e5-af507fffd7b4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.079340 Jan 11 15:44:15.805497 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1026/2304] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:15 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:16.821641 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d6862bc3-a26a-4f07-bb80-2dca12fa4809 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:16.822257 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d6862bc3-a26a-4f07-bb80-2dca12fa4809 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:16.829118 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d6862bc3-a26a-4f07-bb80-2dca12fa4809 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:16.829565 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d6862bc3-a26a-4f07-bb80-2dca12fa4809 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:16.830334 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d6862bc3-a26a-4f07-bb80-2dca12fa4809 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:16.830773 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d6862bc3-a26a-4f07-bb80-2dca12fa4809 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:16.888359 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d6862bc3-a26a-4f07-bb80-2dca12fa4809 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:16.895881 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d6862bc3-a26a-4f07-bb80-2dca12fa4809 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077844 Jan 11 15:44:16.896437 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1279/2305] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:16 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:17.912697 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-796675fb-bf88-4314-aa91-19679f0b27ec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:17.913229 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-796675fb-bf88-4314-aa91-19679f0b27ec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:17.919493 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-796675fb-bf88-4314-aa91-19679f0b27ec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:17.920011 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-796675fb-bf88-4314-aa91-19679f0b27ec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:17.920793 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-796675fb-bf88-4314-aa91-19679f0b27ec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:17.921232 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-796675fb-bf88-4314-aa91-19679f0b27ec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:17.977990 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-796675fb-bf88-4314-aa91-19679f0b27ec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:17.985587 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-796675fb-bf88-4314-aa91-19679f0b27ec tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076659 Jan 11 15:44:17.986146 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1027/2306] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:17 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:19.002888 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d94ed8e6-ffb9-4e0c-982f-c9d5b5759997 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:19.003532 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d94ed8e6-ffb9-4e0c-982f-c9d5b5759997 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:19.009804 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d94ed8e6-ffb9-4e0c-982f-c9d5b5759997 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:19.010252 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d94ed8e6-ffb9-4e0c-982f-c9d5b5759997 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:19.011019 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d94ed8e6-ffb9-4e0c-982f-c9d5b5759997 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:19.011496 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d94ed8e6-ffb9-4e0c-982f-c9d5b5759997 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:19.068219 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d94ed8e6-ffb9-4e0c-982f-c9d5b5759997 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:19.076577 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d94ed8e6-ffb9-4e0c-982f-c9d5b5759997 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077368 Jan 11 15:44:19.077143 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1280/2307] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:18 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:20.093188 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-20451c05-8606-4b9b-820d-9e4867d4a444 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:20.093783 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-20451c05-8606-4b9b-820d-9e4867d4a444 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:20.099947 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-20451c05-8606-4b9b-820d-9e4867d4a444 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:20.100398 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-20451c05-8606-4b9b-820d-9e4867d4a444 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:20.101164 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-20451c05-8606-4b9b-820d-9e4867d4a444 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:20.101603 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-20451c05-8606-4b9b-820d-9e4867d4a444 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:20.158005 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-20451c05-8606-4b9b-820d-9e4867d4a444 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:20.165903 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-20451c05-8606-4b9b-820d-9e4867d4a444 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076676 Jan 11 15:44:20.166461 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1028/2308] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:20 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:21.182504 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-47c00cf9-9ebc-4f32-994d-9fb48e9164f5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:21.183246 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-47c00cf9-9ebc-4f32-994d-9fb48e9164f5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:21.190036 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-47c00cf9-9ebc-4f32-994d-9fb48e9164f5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:21.190484 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-47c00cf9-9ebc-4f32-994d-9fb48e9164f5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:21.191252 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-47c00cf9-9ebc-4f32-994d-9fb48e9164f5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:21.191713 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-47c00cf9-9ebc-4f32-994d-9fb48e9164f5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:21.248433 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-47c00cf9-9ebc-4f32-994d-9fb48e9164f5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:21.256828 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-47c00cf9-9ebc-4f32-994d-9fb48e9164f5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077908 Jan 11 15:44:21.263667 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1281/2309] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:21 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:22.274217 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2fb97cc6-e3e2-4943-9076-6ddbf9073cde tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:22.274819 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2fb97cc6-e3e2-4943-9076-6ddbf9073cde tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:22.280945 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2fb97cc6-e3e2-4943-9076-6ddbf9073cde tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:22.284285 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2fb97cc6-e3e2-4943-9076-6ddbf9073cde tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:22.284285 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2fb97cc6-e3e2-4943-9076-6ddbf9073cde tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:22.284285 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2fb97cc6-e3e2-4943-9076-6ddbf9073cde tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:22.342652 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-2fb97cc6-e3e2-4943-9076-6ddbf9073cde tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:22.350489 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2fb97cc6-e3e2-4943-9076-6ddbf9073cde tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.080463 Jan 11 15:44:22.351042 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1029/2310] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:22 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:23.366866 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-25f4f1d0-192c-4e15-a154-ed0f8fca11a8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:23.367506 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-25f4f1d0-192c-4e15-a154-ed0f8fca11a8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:23.374009 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-25f4f1d0-192c-4e15-a154-ed0f8fca11a8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:23.374459 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-25f4f1d0-192c-4e15-a154-ed0f8fca11a8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:23.375233 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-25f4f1d0-192c-4e15-a154-ed0f8fca11a8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:23.375776 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-25f4f1d0-192c-4e15-a154-ed0f8fca11a8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:23.433154 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-25f4f1d0-192c-4e15-a154-ed0f8fca11a8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:23.440928 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-25f4f1d0-192c-4e15-a154-ed0f8fca11a8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077726 Jan 11 15:44:23.441489 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1282/2311] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:23 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:24.457207 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2b273c02-c12a-402f-8229-13411296bcf8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:24.457846 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2b273c02-c12a-402f-8229-13411296bcf8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:24.464100 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2b273c02-c12a-402f-8229-13411296bcf8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:24.464549 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2b273c02-c12a-402f-8229-13411296bcf8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:24.465321 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2b273c02-c12a-402f-8229-13411296bcf8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:24.465763 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2b273c02-c12a-402f-8229-13411296bcf8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:24.523198 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-2b273c02-c12a-402f-8229-13411296bcf8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:24.531302 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2b273c02-c12a-402f-8229-13411296bcf8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077762 Jan 11 15:44:24.531873 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1030/2312] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:24 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:25.243861 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:44:25.244471 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: Tue Jan 11 15:44:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:44:25.343236 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:44:25.343455 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: Tue Jan 11 15:44:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:44:25.547207 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-31b102cb-0b5a-43aa-b74d-6f1233dcc86d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:25.547850 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-31b102cb-0b5a-43aa-b74d-6f1233dcc86d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:25.554290 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-31b102cb-0b5a-43aa-b74d-6f1233dcc86d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:25.554739 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-31b102cb-0b5a-43aa-b74d-6f1233dcc86d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:25.555539 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-31b102cb-0b5a-43aa-b74d-6f1233dcc86d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:25.556008 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-31b102cb-0b5a-43aa-b74d-6f1233dcc86d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:25.613577 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-31b102cb-0b5a-43aa-b74d-6f1233dcc86d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:25.621891 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-31b102cb-0b5a-43aa-b74d-6f1233dcc86d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077919 Jan 11 15:44:25.622464 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1283/2313] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:25 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:26.639006 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-936db605-7409-430a-8e87-6e4f23e15412 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:26.639623 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-936db605-7409-430a-8e87-6e4f23e15412 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:26.647965 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-936db605-7409-430a-8e87-6e4f23e15412 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:26.648423 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-936db605-7409-430a-8e87-6e4f23e15412 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:26.649210 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-936db605-7409-430a-8e87-6e4f23e15412 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:26.649661 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-936db605-7409-430a-8e87-6e4f23e15412 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:26.708656 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-936db605-7409-430a-8e87-6e4f23e15412 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:26.719591 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-936db605-7409-430a-8e87-6e4f23e15412 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.084899 Jan 11 15:44:26.720135 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1031/2314] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:26 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:27.735813 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-23f023f6-9ca3-478f-968e-d50bc024bb41 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:27.736436 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-23f023f6-9ca3-478f-968e-d50bc024bb41 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:27.742618 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-23f023f6-9ca3-478f-968e-d50bc024bb41 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:27.743064 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-23f023f6-9ca3-478f-968e-d50bc024bb41 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:27.743864 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-23f023f6-9ca3-478f-968e-d50bc024bb41 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:27.744302 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-23f023f6-9ca3-478f-968e-d50bc024bb41 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:27.801545 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-23f023f6-9ca3-478f-968e-d50bc024bb41 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:27.810013 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-23f023f6-9ca3-478f-968e-d50bc024bb41 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077829 Jan 11 15:44:27.810574 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1284/2315] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:27 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:28.826988 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-36e96941-48e5-418e-a0b1-c892e3c4ebfd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:28.827630 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-36e96941-48e5-418e-a0b1-c892e3c4ebfd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:28.833940 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-36e96941-48e5-418e-a0b1-c892e3c4ebfd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:28.834399 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-36e96941-48e5-418e-a0b1-c892e3c4ebfd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:28.835179 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-36e96941-48e5-418e-a0b1-c892e3c4ebfd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:28.835650 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-36e96941-48e5-418e-a0b1-c892e3c4ebfd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:28.895248 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-36e96941-48e5-418e-a0b1-c892e3c4ebfd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:28.903151 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-36e96941-48e5-418e-a0b1-c892e3c4ebfd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.080491 Jan 11 15:44:28.903744 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1032/2316] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:28 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:29.919938 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-925a59e4-9352-4e65-8918-6843882f1df6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:29.920750 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-925a59e4-9352-4e65-8918-6843882f1df6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:29.927256 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-925a59e4-9352-4e65-8918-6843882f1df6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:29.927753 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-925a59e4-9352-4e65-8918-6843882f1df6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:29.928547 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-925a59e4-9352-4e65-8918-6843882f1df6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:29.928994 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-925a59e4-9352-4e65-8918-6843882f1df6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:29.998208 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-925a59e4-9352-4e65-8918-6843882f1df6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:30.011310 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-925a59e4-9352-4e65-8918-6843882f1df6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.089846 Jan 11 15:44:30.011310 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1285/2317] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:29 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:31.021907 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2008ad0c-1fca-4b94-85b9-2335704310bd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:31.022495 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2008ad0c-1fca-4b94-85b9-2335704310bd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:31.030364 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2008ad0c-1fca-4b94-85b9-2335704310bd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:31.030810 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2008ad0c-1fca-4b94-85b9-2335704310bd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:31.031998 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2008ad0c-1fca-4b94-85b9-2335704310bd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:31.032456 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2008ad0c-1fca-4b94-85b9-2335704310bd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:31.091420 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-2008ad0c-1fca-4b94-85b9-2335704310bd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:31.099130 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2008ad0c-1fca-4b94-85b9-2335704310bd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.080866 Jan 11 15:44:31.099865 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1033/2318] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:31 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:32.116174 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-1cf8db77-2b54-45e5-9724-7e5ffd61f234 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:32.116789 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-1cf8db77-2b54-45e5-9724-7e5ffd61f234 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:32.123053 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1cf8db77-2b54-45e5-9724-7e5ffd61f234 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:32.123545 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1cf8db77-2b54-45e5-9724-7e5ffd61f234 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:32.124327 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1cf8db77-2b54-45e5-9724-7e5ffd61f234 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:32.124772 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-1cf8db77-2b54-45e5-9724-7e5ffd61f234 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:32.181533 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-1cf8db77-2b54-45e5-9724-7e5ffd61f234 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:32.189071 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-1cf8db77-2b54-45e5-9724-7e5ffd61f234 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076616 Jan 11 15:44:32.189628 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1286/2319] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:32 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:33.205926 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e7c4efbd-477e-47f4-9a4c-39969a76bb46 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:33.206525 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e7c4efbd-477e-47f4-9a4c-39969a76bb46 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:33.212984 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e7c4efbd-477e-47f4-9a4c-39969a76bb46 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:33.213447 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e7c4efbd-477e-47f4-9a4c-39969a76bb46 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:33.214229 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e7c4efbd-477e-47f4-9a4c-39969a76bb46 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:33.214697 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e7c4efbd-477e-47f4-9a4c-39969a76bb46 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:33.275704 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-e7c4efbd-477e-47f4-9a4c-39969a76bb46 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:33.283724 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e7c4efbd-477e-47f4-9a4c-39969a76bb46 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.081451 Jan 11 15:44:33.284277 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1034/2320] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:33 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:34.300358 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6f731a00-feba-481f-a59c-63cced68bd09 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:34.300995 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6f731a00-feba-481f-a59c-63cced68bd09 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:34.307564 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6f731a00-feba-481f-a59c-63cced68bd09 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:34.308019 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6f731a00-feba-481f-a59c-63cced68bd09 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:34.309493 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6f731a00-feba-481f-a59c-63cced68bd09 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:34.310034 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6f731a00-feba-481f-a59c-63cced68bd09 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:34.369422 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6f731a00-feba-481f-a59c-63cced68bd09 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:34.377881 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6f731a00-feba-481f-a59c-63cced68bd09 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.081187 Jan 11 15:44:34.378437 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1287/2321] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:34 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:35.394186 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ac0cedb1-d17a-4a1f-9ca9-5fa63644d3d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:35.394794 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-ac0cedb1-d17a-4a1f-9ca9-5fa63644d3d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:35.401344 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ac0cedb1-d17a-4a1f-9ca9-5fa63644d3d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:35.401792 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ac0cedb1-d17a-4a1f-9ca9-5fa63644d3d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:35.402586 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ac0cedb1-d17a-4a1f-9ca9-5fa63644d3d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:35.403010 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ac0cedb1-d17a-4a1f-9ca9-5fa63644d3d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:35.459098 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-ac0cedb1-d17a-4a1f-9ca9-5fa63644d3d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:35.466812 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-ac0cedb1-d17a-4a1f-9ca9-5fa63644d3d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076216 Jan 11 15:44:35.467392 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1035/2322] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:35 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:36.483284 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2937e077-33b3-409d-9007-284e5a671593 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:36.483931 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2937e077-33b3-409d-9007-284e5a671593 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:36.490201 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2937e077-33b3-409d-9007-284e5a671593 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:36.490654 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2937e077-33b3-409d-9007-284e5a671593 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:36.491460 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2937e077-33b3-409d-9007-284e5a671593 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:36.491902 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2937e077-33b3-409d-9007-284e5a671593 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:36.548874 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-2937e077-33b3-409d-9007-284e5a671593 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:36.556487 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2937e077-33b3-409d-9007-284e5a671593 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076813 Jan 11 15:44:36.557049 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1288/2323] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:36 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:37.573123 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-6d7eeeda-5f48-4eec-b212-a75fa82d6dc5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:37.573734 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-6d7eeeda-5f48-4eec-b212-a75fa82d6dc5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:37.580580 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6d7eeeda-5f48-4eec-b212-a75fa82d6dc5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:37.581036 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6d7eeeda-5f48-4eec-b212-a75fa82d6dc5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:37.582179 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6d7eeeda-5f48-4eec-b212-a75fa82d6dc5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:37.582619 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6d7eeeda-5f48-4eec-b212-a75fa82d6dc5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:37.638611 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-6d7eeeda-5f48-4eec-b212-a75fa82d6dc5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:37.646165 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-6d7eeeda-5f48-4eec-b212-a75fa82d6dc5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076673 Jan 11 15:44:37.646731 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1036/2324] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:37 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:38.663145 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6b48f4ec-8dc0-4718-adb7-fc4688c5ef22 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:38.663746 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6b48f4ec-8dc0-4718-adb7-fc4688c5ef22 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:38.670571 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6b48f4ec-8dc0-4718-adb7-fc4688c5ef22 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:38.671020 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6b48f4ec-8dc0-4718-adb7-fc4688c5ef22 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:38.671827 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6b48f4ec-8dc0-4718-adb7-fc4688c5ef22 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:38.672263 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6b48f4ec-8dc0-4718-adb7-fc4688c5ef22 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:38.729654 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6b48f4ec-8dc0-4718-adb7-fc4688c5ef22 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:38.737875 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6b48f4ec-8dc0-4718-adb7-fc4688c5ef22 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.078573 Jan 11 15:44:38.738485 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1289/2325] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:38 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:39.754709 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b44ca005-a2dd-4477-a506-7c36f2231a21 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:39.755329 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b44ca005-a2dd-4477-a506-7c36f2231a21 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:39.761467 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b44ca005-a2dd-4477-a506-7c36f2231a21 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:39.761919 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b44ca005-a2dd-4477-a506-7c36f2231a21 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:39.762683 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b44ca005-a2dd-4477-a506-7c36f2231a21 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:39.763117 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b44ca005-a2dd-4477-a506-7c36f2231a21 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:39.828183 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-b44ca005-a2dd-4477-a506-7c36f2231a21 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:39.837801 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b44ca005-a2dd-4477-a506-7c36f2231a21 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.086785 Jan 11 15:44:39.838358 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1037/2326] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:39 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:40.853913 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6691c479-1fda-4e8a-bfff-4faf3fecdff3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:40.854530 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6691c479-1fda-4e8a-bfff-4faf3fecdff3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:40.861428 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6691c479-1fda-4e8a-bfff-4faf3fecdff3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:40.861885 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6691c479-1fda-4e8a-bfff-4faf3fecdff3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:40.862669 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6691c479-1fda-4e8a-bfff-4faf3fecdff3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:40.863113 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6691c479-1fda-4e8a-bfff-4faf3fecdff3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:40.921157 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6691c479-1fda-4e8a-bfff-4faf3fecdff3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:40.929030 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6691c479-1fda-4e8a-bfff-4faf3fecdff3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.079036 Jan 11 15:44:40.929589 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1290/2327] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:40 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:41.945567 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2b31790a-ba36-44f2-ada7-c4f0798f5bb1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:41.946100 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2b31790a-ba36-44f2-ada7-c4f0798f5bb1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:41.952863 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2b31790a-ba36-44f2-ada7-c4f0798f5bb1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:41.953316 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2b31790a-ba36-44f2-ada7-c4f0798f5bb1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:41.954098 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2b31790a-ba36-44f2-ada7-c4f0798f5bb1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:41.954539 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2b31790a-ba36-44f2-ada7-c4f0798f5bb1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:42.011086 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-2b31790a-ba36-44f2-ada7-c4f0798f5bb1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:42.019331 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2b31790a-ba36-44f2-ada7-c4f0798f5bb1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077434 Jan 11 15:44:42.019896 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1038/2328] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:41 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:43.036193 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a09c1a14-f6cc-4cbf-add1-62a632ff8223 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:43.036788 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a09c1a14-f6cc-4cbf-add1-62a632ff8223 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:43.043027 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a09c1a14-f6cc-4cbf-add1-62a632ff8223 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:43.043505 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a09c1a14-f6cc-4cbf-add1-62a632ff8223 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:43.044278 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a09c1a14-f6cc-4cbf-add1-62a632ff8223 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:43.044713 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a09c1a14-f6cc-4cbf-add1-62a632ff8223 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:43.104949 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a09c1a14-f6cc-4cbf-add1-62a632ff8223 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:43.113528 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a09c1a14-f6cc-4cbf-add1-62a632ff8223 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.080981 Jan 11 15:44:43.114085 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1291/2329] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:43 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:44.130309 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-06fd2f33-c609-483b-af65-6a5dbe35d96f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:44.130927 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-06fd2f33-c609-483b-af65-6a5dbe35d96f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:44.137257 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-06fd2f33-c609-483b-af65-6a5dbe35d96f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:44.137716 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-06fd2f33-c609-483b-af65-6a5dbe35d96f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:44.138491 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-06fd2f33-c609-483b-af65-6a5dbe35d96f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:44.138934 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-06fd2f33-c609-483b-af65-6a5dbe35d96f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:44.195414 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-06fd2f33-c609-483b-af65-6a5dbe35d96f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:44.202865 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-06fd2f33-c609-483b-af65-6a5dbe35d96f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076151 Jan 11 15:44:44.203444 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1039/2330] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:44 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:45.218390 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5bd721b6-32e8-4149-8403-38afcd42ab7a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:45.219046 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5bd721b6-32e8-4149-8403-38afcd42ab7a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:45.225285 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5bd721b6-32e8-4149-8403-38afcd42ab7a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:45.225733 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5bd721b6-32e8-4149-8403-38afcd42ab7a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:45.226498 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5bd721b6-32e8-4149-8403-38afcd42ab7a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:45.226988 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5bd721b6-32e8-4149-8403-38afcd42ab7a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:45.285097 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-5bd721b6-32e8-4149-8403-38afcd42ab7a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:45.292860 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5bd721b6-32e8-4149-8403-38afcd42ab7a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.078193 Jan 11 15:44:45.293476 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1292/2331] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:45 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:46.309352 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-16d1c38a-9e23-45c3-9428-73464039c758 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:46.310023 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-16d1c38a-9e23-45c3-9428-73464039c758 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:46.316396 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-16d1c38a-9e23-45c3-9428-73464039c758 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:46.316850 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-16d1c38a-9e23-45c3-9428-73464039c758 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:46.317621 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-16d1c38a-9e23-45c3-9428-73464039c758 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:46.318061 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-16d1c38a-9e23-45c3-9428-73464039c758 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:46.377628 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-16d1c38a-9e23-45c3-9428-73464039c758 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:46.385196 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-16d1c38a-9e23-45c3-9428-73464039c758 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.079554 Jan 11 15:44:46.385750 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1040/2332] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:46 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:47.402373 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3b0a3c78-9065-4744-9333-e92e041722b3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:47.403516 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3b0a3c78-9065-4744-9333-e92e041722b3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:47.409736 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3b0a3c78-9065-4744-9333-e92e041722b3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:47.410192 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3b0a3c78-9065-4744-9333-e92e041722b3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:47.410965 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3b0a3c78-9065-4744-9333-e92e041722b3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:47.411432 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3b0a3c78-9065-4744-9333-e92e041722b3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:47.471862 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3b0a3c78-9065-4744-9333-e92e041722b3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:47.479497 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3b0a3c78-9065-4744-9333-e92e041722b3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.080988 Jan 11 15:44:47.480058 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1293/2333] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:47 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:48.495863 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e2765637-4329-4e77-b61f-b8840e2feb1f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:48.496999 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e2765637-4329-4e77-b61f-b8840e2feb1f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:48.503412 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e2765637-4329-4e77-b61f-b8840e2feb1f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:48.503871 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e2765637-4329-4e77-b61f-b8840e2feb1f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:48.504648 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e2765637-4329-4e77-b61f-b8840e2feb1f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:48.505092 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e2765637-4329-4e77-b61f-b8840e2feb1f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:48.562163 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-e2765637-4329-4e77-b61f-b8840e2feb1f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:48.569807 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e2765637-4329-4e77-b61f-b8840e2feb1f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077673 Jan 11 15:44:48.570369 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1041/2334] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:48 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:49.586622 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6207e2da-12f9-433b-8797-7141c6fbaf0e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:49.587242 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6207e2da-12f9-433b-8797-7141c6fbaf0e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:49.593595 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6207e2da-12f9-433b-8797-7141c6fbaf0e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:49.594056 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6207e2da-12f9-433b-8797-7141c6fbaf0e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:49.594841 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6207e2da-12f9-433b-8797-7141c6fbaf0e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:49.595301 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6207e2da-12f9-433b-8797-7141c6fbaf0e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:49.652028 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6207e2da-12f9-433b-8797-7141c6fbaf0e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:49.659766 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6207e2da-12f9-433b-8797-7141c6fbaf0e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076925 Jan 11 15:44:49.660336 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1294/2335] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:49 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:50.676053 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-25a0b60c-d77c-4e22-a751-f2f19aabf20f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:50.676667 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-25a0b60c-d77c-4e22-a751-f2f19aabf20f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:50.683149 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-25a0b60c-d77c-4e22-a751-f2f19aabf20f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:50.688165 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-25a0b60c-d77c-4e22-a751-f2f19aabf20f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:50.688165 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-25a0b60c-d77c-4e22-a751-f2f19aabf20f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:50.688165 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-25a0b60c-d77c-4e22-a751-f2f19aabf20f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:50.743513 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-25a0b60c-d77c-4e22-a751-f2f19aabf20f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:50.751933 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-25a0b60c-d77c-4e22-a751-f2f19aabf20f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.079508 Jan 11 15:44:50.752499 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1042/2336] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:50 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:51.768832 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-fa0b3773-8fb6-4cf8-ae58-c55d1cfd8ce6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:51.769480 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-fa0b3773-8fb6-4cf8-ae58-c55d1cfd8ce6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:51.776207 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fa0b3773-8fb6-4cf8-ae58-c55d1cfd8ce6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:51.776662 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fa0b3773-8fb6-4cf8-ae58-c55d1cfd8ce6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:51.777447 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fa0b3773-8fb6-4cf8-ae58-c55d1cfd8ce6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:51.777946 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fa0b3773-8fb6-4cf8-ae58-c55d1cfd8ce6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:51.835718 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-fa0b3773-8fb6-4cf8-ae58-c55d1cfd8ce6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:51.843561 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-fa0b3773-8fb6-4cf8-ae58-c55d1cfd8ce6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.078349 Jan 11 15:44:51.844132 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1295/2337] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:51 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:52.860341 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-c33049fc-c7ac-4d8e-b0e4-f8944a17c0a2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:52.860929 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-c33049fc-c7ac-4d8e-b0e4-f8944a17c0a2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:52.867169 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c33049fc-c7ac-4d8e-b0e4-f8944a17c0a2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:52.867652 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c33049fc-c7ac-4d8e-b0e4-f8944a17c0a2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:52.868419 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c33049fc-c7ac-4d8e-b0e4-f8944a17c0a2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:52.868852 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-c33049fc-c7ac-4d8e-b0e4-f8944a17c0a2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:52.928044 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-c33049fc-c7ac-4d8e-b0e4-f8944a17c0a2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:52.938802 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-c33049fc-c7ac-4d8e-b0e4-f8944a17c0a2 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.080306 Jan 11 15:44:52.938802 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1043/2338] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:52 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:53.953479 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-733f841f-a455-48d1-a2d8-5f34054fa23b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:53.954274 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-733f841f-a455-48d1-a2d8-5f34054fa23b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:53.960021 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-733f841f-a455-48d1-a2d8-5f34054fa23b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:53.960478 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-733f841f-a455-48d1-a2d8-5f34054fa23b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:53.961255 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-733f841f-a455-48d1-a2d8-5f34054fa23b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:53.961693 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-733f841f-a455-48d1-a2d8-5f34054fa23b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:54.022602 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-733f841f-a455-48d1-a2d8-5f34054fa23b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:54.030574 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-733f841f-a455-48d1-a2d8-5f34054fa23b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.081595 Jan 11 15:44:54.036893 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1296/2339] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:53 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:55.046525 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e779ff22-49c7-4952-b329-c5be27c0cab8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:55.061408 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e779ff22-49c7-4952-b329-c5be27c0cab8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:55.061408 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e779ff22-49c7-4952-b329-c5be27c0cab8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:55.061408 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e779ff22-49c7-4952-b329-c5be27c0cab8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:55.061408 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e779ff22-49c7-4952-b329-c5be27c0cab8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:55.061857 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e779ff22-49c7-4952-b329-c5be27c0cab8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:55.111679 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-e779ff22-49c7-4952-b329-c5be27c0cab8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:55.119787 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e779ff22-49c7-4952-b329-c5be27c0cab8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076868 Jan 11 15:44:55.120360 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1044/2340] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:55 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:56.137126 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4e7aaa21-537f-48d5-8dd3-7748caa0b97d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:56.137738 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-4e7aaa21-537f-48d5-8dd3-7748caa0b97d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:56.144172 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4e7aaa21-537f-48d5-8dd3-7748caa0b97d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:56.144629 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4e7aaa21-537f-48d5-8dd3-7748caa0b97d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:56.145411 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4e7aaa21-537f-48d5-8dd3-7748caa0b97d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:56.145851 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4e7aaa21-537f-48d5-8dd3-7748caa0b97d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:56.202645 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-4e7aaa21-537f-48d5-8dd3-7748caa0b97d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:56.210220 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4e7aaa21-537f-48d5-8dd3-7748caa0b97d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076778 Jan 11 15:44:56.210785 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1297/2341] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:56 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:57.225999 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3e6bc926-4532-4770-9577-8b39bdc52d70 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:57.226627 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3e6bc926-4532-4770-9577-8b39bdc52d70 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:57.233498 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3e6bc926-4532-4770-9577-8b39bdc52d70 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:57.233946 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3e6bc926-4532-4770-9577-8b39bdc52d70 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:57.234721 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3e6bc926-4532-4770-9577-8b39bdc52d70 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:57.235156 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3e6bc926-4532-4770-9577-8b39bdc52d70 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:57.292263 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-3e6bc926-4532-4770-9577-8b39bdc52d70 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:57.301040 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3e6bc926-4532-4770-9577-8b39bdc52d70 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.078701 Jan 11 15:44:57.301596 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1045/2342] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:57 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:58.317540 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ac6cdf99-c3f7-4b59-b26f-f044b8996b09 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:58.318161 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ac6cdf99-c3f7-4b59-b26f-f044b8996b09 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:58.324611 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ac6cdf99-c3f7-4b59-b26f-f044b8996b09 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:58.325077 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ac6cdf99-c3f7-4b59-b26f-f044b8996b09 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:58.325868 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ac6cdf99-c3f7-4b59-b26f-f044b8996b09 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:58.326311 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ac6cdf99-c3f7-4b59-b26f-f044b8996b09 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:58.383459 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ac6cdf99-c3f7-4b59-b26f-f044b8996b09 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:58.391163 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ac6cdf99-c3f7-4b59-b26f-f044b8996b09 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077351 Jan 11 15:44:58.391767 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1298/2343] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:58 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:44:59.407468 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-1b379f4e-31c8-44c4-bb89-56d96100551a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:44:59.408261 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-1b379f4e-31c8-44c4-bb89-56d96100551a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:44:59.414446 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1b379f4e-31c8-44c4-bb89-56d96100551a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:59.414898 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1b379f4e-31c8-44c4-bb89-56d96100551a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:59.415703 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1b379f4e-31c8-44c4-bb89-56d96100551a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:44:59.416144 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1b379f4e-31c8-44c4-bb89-56d96100551a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:44:59.474693 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-1b379f4e-31c8-44c4-bb89-56d96100551a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:44:59.483473 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-1b379f4e-31c8-44c4-bb89-56d96100551a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.079614 Jan 11 15:44:59.484137 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1046/2344] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:44:59 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:45:00.500366 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-fa6cba7b-248b-477d-b8fe-5c7bf4573e98 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:00.500982 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-fa6cba7b-248b-477d-b8fe-5c7bf4573e98 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:00.507262 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fa6cba7b-248b-477d-b8fe-5c7bf4573e98 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:00.507699 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fa6cba7b-248b-477d-b8fe-5c7bf4573e98 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:00.508469 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fa6cba7b-248b-477d-b8fe-5c7bf4573e98 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:00.508912 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fa6cba7b-248b-477d-b8fe-5c7bf4573e98 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:00.576978 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-fa6cba7b-248b-477d-b8fe-5c7bf4573e98 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:00.585037 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-fa6cba7b-248b-477d-b8fe-5c7bf4573e98 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.088898 Jan 11 15:45:00.585608 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1299/2345] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:00 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:01.601304 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e8c9dc53-8e86-43e2-a40d-2286e8d75706 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:01.601945 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e8c9dc53-8e86-43e2-a40d-2286e8d75706 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:01.608209 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e8c9dc53-8e86-43e2-a40d-2286e8d75706 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:01.608661 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e8c9dc53-8e86-43e2-a40d-2286e8d75706 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:01.609433 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e8c9dc53-8e86-43e2-a40d-2286e8d75706 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:01.609873 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e8c9dc53-8e86-43e2-a40d-2286e8d75706 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:01.666311 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-e8c9dc53-8e86-43e2-a40d-2286e8d75706 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:01.673877 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e8c9dc53-8e86-43e2-a40d-2286e8d75706 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076209 Jan 11 15:45:01.674431 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1047/2346] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:01 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:02.689730 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-684bd0c5-e68d-42fc-b96b-f15bac3eb512 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:02.690310 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-684bd0c5-e68d-42fc-b96b-f15bac3eb512 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:02.696728 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-684bd0c5-e68d-42fc-b96b-f15bac3eb512 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:02.697188 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-684bd0c5-e68d-42fc-b96b-f15bac3eb512 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:02.697979 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-684bd0c5-e68d-42fc-b96b-f15bac3eb512 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:02.698455 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-684bd0c5-e68d-42fc-b96b-f15bac3eb512 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:02.755148 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-684bd0c5-e68d-42fc-b96b-f15bac3eb512 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:02.763408 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-684bd0c5-e68d-42fc-b96b-f15bac3eb512 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077362 Jan 11 15:45:02.763972 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1300/2347] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:02 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:03.780467 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b1277a8b-77ac-4329-b6ff-641af3d349a5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:03.781084 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b1277a8b-77ac-4329-b6ff-641af3d349a5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:03.787336 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b1277a8b-77ac-4329-b6ff-641af3d349a5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:03.787794 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b1277a8b-77ac-4329-b6ff-641af3d349a5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:03.788577 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b1277a8b-77ac-4329-b6ff-641af3d349a5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:03.789018 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b1277a8b-77ac-4329-b6ff-641af3d349a5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:03.845058 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-b1277a8b-77ac-4329-b6ff-641af3d349a5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:03.852560 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b1277a8b-77ac-4329-b6ff-641af3d349a5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076377 Jan 11 15:45:03.853145 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1048/2348] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:03 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:04.869469 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-7e489f16-79a6-489b-ba59-6927e4dc8f3d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:04.870103 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-7e489f16-79a6-489b-ba59-6927e4dc8f3d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:04.877327 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7e489f16-79a6-489b-ba59-6927e4dc8f3d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:04.877777 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7e489f16-79a6-489b-ba59-6927e4dc8f3d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:04.878542 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7e489f16-79a6-489b-ba59-6927e4dc8f3d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:04.878980 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-7e489f16-79a6-489b-ba59-6927e4dc8f3d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:04.935742 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-7e489f16-79a6-489b-ba59-6927e4dc8f3d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:04.943204 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-7e489f16-79a6-489b-ba59-6927e4dc8f3d tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077398 Jan 11 15:45:04.943792 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1301/2349] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:04 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:05.959481 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7a22cb4b-897a-4bd4-8b75-e7d7ae02f38f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:05.960015 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7a22cb4b-897a-4bd4-8b75-e7d7ae02f38f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:05.966282 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7a22cb4b-897a-4bd4-8b75-e7d7ae02f38f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:05.966733 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7a22cb4b-897a-4bd4-8b75-e7d7ae02f38f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:05.967556 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7a22cb4b-897a-4bd4-8b75-e7d7ae02f38f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:05.967993 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7a22cb4b-897a-4bd4-8b75-e7d7ae02f38f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:06.023869 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-7a22cb4b-897a-4bd4-8b75-e7d7ae02f38f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:06.032265 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7a22cb4b-897a-4bd4-8b75-e7d7ae02f38f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076482 Jan 11 15:45:06.032823 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1049/2350] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:05 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:07.048592 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-274563b0-83eb-4872-abbd-16b73e4c78e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:07.049193 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-274563b0-83eb-4872-abbd-16b73e4c78e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:07.055495 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-274563b0-83eb-4872-abbd-16b73e4c78e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:07.055947 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-274563b0-83eb-4872-abbd-16b73e4c78e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:07.056716 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-274563b0-83eb-4872-abbd-16b73e4c78e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:07.057154 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-274563b0-83eb-4872-abbd-16b73e4c78e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:07.117794 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-274563b0-83eb-4872-abbd-16b73e4c78e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:07.126149 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-274563b0-83eb-4872-abbd-16b73e4c78e5 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.081208 Jan 11 15:45:07.126716 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1302/2351] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:07 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:08.141931 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-6905c1e4-6652-49f9-b63e-f7206dc61258 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:08.142570 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-6905c1e4-6652-49f9-b63e-f7206dc61258 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:08.148901 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6905c1e4-6652-49f9-b63e-f7206dc61258 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:08.149350 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6905c1e4-6652-49f9-b63e-f7206dc61258 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:08.150369 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6905c1e4-6652-49f9-b63e-f7206dc61258 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:08.150827 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6905c1e4-6652-49f9-b63e-f7206dc61258 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:08.206750 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-6905c1e4-6652-49f9-b63e-f7206dc61258 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:08.214195 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-6905c1e4-6652-49f9-b63e-f7206dc61258 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.075849 Jan 11 15:45:08.215411 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1050/2352] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:08 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:09.232512 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c25c06d4-1a0f-4647-897f-54c88added22 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:09.233108 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c25c06d4-1a0f-4647-897f-54c88added22 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:09.239496 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c25c06d4-1a0f-4647-897f-54c88added22 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:09.239951 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c25c06d4-1a0f-4647-897f-54c88added22 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:09.240760 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c25c06d4-1a0f-4647-897f-54c88added22 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:09.241221 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c25c06d4-1a0f-4647-897f-54c88added22 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:09.299752 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c25c06d4-1a0f-4647-897f-54c88added22 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:09.307439 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c25c06d4-1a0f-4647-897f-54c88added22 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.079898 Jan 11 15:45:09.308002 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1303/2353] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:09 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:10.323874 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-fd264073-0389-43d9-9db5-f7e4a936e2d0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:10.324480 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-fd264073-0389-43d9-9db5-f7e4a936e2d0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:10.330642 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fd264073-0389-43d9-9db5-f7e4a936e2d0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:10.331088 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fd264073-0389-43d9-9db5-f7e4a936e2d0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:10.331889 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fd264073-0389-43d9-9db5-f7e4a936e2d0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:10.332324 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fd264073-0389-43d9-9db5-f7e4a936e2d0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:10.388790 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-fd264073-0389-43d9-9db5-f7e4a936e2d0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:10.396270 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-fd264073-0389-43d9-9db5-f7e4a936e2d0 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.075985 Jan 11 15:45:10.396827 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1051/2354] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:10 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:11.413389 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ec545464-cb4f-4474-b5c6-5de6b09366a3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:11.413999 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ec545464-cb4f-4474-b5c6-5de6b09366a3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:11.420920 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ec545464-cb4f-4474-b5c6-5de6b09366a3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:11.421368 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ec545464-cb4f-4474-b5c6-5de6b09366a3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:11.422142 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ec545464-cb4f-4474-b5c6-5de6b09366a3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:11.422585 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ec545464-cb4f-4474-b5c6-5de6b09366a3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:11.478829 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ec545464-cb4f-4474-b5c6-5de6b09366a3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:11.487100 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ec545464-cb4f-4474-b5c6-5de6b09366a3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077380 Jan 11 15:45:11.487689 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1304/2355] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:11 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:12.503631 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e3f899b3-4062-4bbc-a8ba-9222baec811e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:12.504239 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e3f899b3-4062-4bbc-a8ba-9222baec811e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:12.510450 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e3f899b3-4062-4bbc-a8ba-9222baec811e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:12.510847 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e3f899b3-4062-4bbc-a8ba-9222baec811e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:12.512216 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e3f899b3-4062-4bbc-a8ba-9222baec811e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:12.512654 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e3f899b3-4062-4bbc-a8ba-9222baec811e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:12.568394 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-e3f899b3-4062-4bbc-a8ba-9222baec811e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:12.576729 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e3f899b3-4062-4bbc-a8ba-9222baec811e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076877 Jan 11 15:45:12.577283 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1052/2356] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:12 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:13.593554 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-c2e2f920-dd63-4ad9-a484-3dbd3b273387 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:13.594172 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-c2e2f920-dd63-4ad9-a484-3dbd3b273387 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:13.600462 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c2e2f920-dd63-4ad9-a484-3dbd3b273387 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:13.600923 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c2e2f920-dd63-4ad9-a484-3dbd3b273387 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:13.601705 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c2e2f920-dd63-4ad9-a484-3dbd3b273387 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:13.602151 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-c2e2f920-dd63-4ad9-a484-3dbd3b273387 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:13.662245 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-c2e2f920-dd63-4ad9-a484-3dbd3b273387 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:13.670609 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-c2e2f920-dd63-4ad9-a484-3dbd3b273387 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.081256 Jan 11 15:45:13.671173 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1305/2357] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:13 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:14.687538 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-1053f4a8-efd3-4fd1-8100-84242889e365 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:14.688086 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-1053f4a8-efd3-4fd1-8100-84242889e365 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:14.694487 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1053f4a8-efd3-4fd1-8100-84242889e365 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:14.694935 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1053f4a8-efd3-4fd1-8100-84242889e365 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:14.695735 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1053f4a8-efd3-4fd1-8100-84242889e365 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:14.696172 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1053f4a8-efd3-4fd1-8100-84242889e365 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:14.753246 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-1053f4a8-efd3-4fd1-8100-84242889e365 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:14.760896 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-1053f4a8-efd3-4fd1-8100-84242889e365 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077198 Jan 11 15:45:14.761998 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1053/2358] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:14 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:15.778407 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-dbd54c42-36b8-4e5e-9400-7d0c9aea710e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:15.779056 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-dbd54c42-36b8-4e5e-9400-7d0c9aea710e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:15.785229 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dbd54c42-36b8-4e5e-9400-7d0c9aea710e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:15.785674 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dbd54c42-36b8-4e5e-9400-7d0c9aea710e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:15.786443 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dbd54c42-36b8-4e5e-9400-7d0c9aea710e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:15.786880 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dbd54c42-36b8-4e5e-9400-7d0c9aea710e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:15.843915 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-dbd54c42-36b8-4e5e-9400-7d0c9aea710e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:15.851568 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-dbd54c42-36b8-4e5e-9400-7d0c9aea710e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077529 Jan 11 15:45:15.852138 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1306/2359] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:15 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:16.868612 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-58e9dd74-28ab-4ed4-a217-fa9303c09049 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:16.869212 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-58e9dd74-28ab-4ed4-a217-fa9303c09049 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:16.875497 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-58e9dd74-28ab-4ed4-a217-fa9303c09049 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:16.875957 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-58e9dd74-28ab-4ed4-a217-fa9303c09049 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:16.876731 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-58e9dd74-28ab-4ed4-a217-fa9303c09049 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:16.877176 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-58e9dd74-28ab-4ed4-a217-fa9303c09049 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:16.934630 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-58e9dd74-28ab-4ed4-a217-fa9303c09049 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:16.942210 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-58e9dd74-28ab-4ed4-a217-fa9303c09049 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077265 Jan 11 15:45:16.942783 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1054/2360] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:16 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:17.959013 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-95a437a9-e32f-4442-967a-bd106c0f62ab tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:17.959605 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-95a437a9-e32f-4442-967a-bd106c0f62ab tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:17.965739 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-95a437a9-e32f-4442-967a-bd106c0f62ab tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:17.966188 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-95a437a9-e32f-4442-967a-bd106c0f62ab tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:17.966955 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-95a437a9-e32f-4442-967a-bd106c0f62ab tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:17.967423 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-95a437a9-e32f-4442-967a-bd106c0f62ab tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:18.023823 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-95a437a9-e32f-4442-967a-bd106c0f62ab tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:18.032115 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-95a437a9-e32f-4442-967a-bd106c0f62ab tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076784 Jan 11 15:45:18.032674 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1307/2361] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:17 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:19.048303 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ecfb57ef-0d10-47d9-b530-d71537a3c2d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:19.049009 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-ecfb57ef-0d10-47d9-b530-d71537a3c2d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:19.055264 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ecfb57ef-0d10-47d9-b530-d71537a3c2d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:19.055738 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ecfb57ef-0d10-47d9-b530-d71537a3c2d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:19.056504 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ecfb57ef-0d10-47d9-b530-d71537a3c2d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:19.056940 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ecfb57ef-0d10-47d9-b530-d71537a3c2d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:19.113694 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-ecfb57ef-0d10-47d9-b530-d71537a3c2d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:19.121900 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-ecfb57ef-0d10-47d9-b530-d71537a3c2d3 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077230 Jan 11 15:45:19.122466 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1055/2362] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:19 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:20.138505 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-19275738-dc70-4673-a991-2be01f5e25b4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:20.139129 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-19275738-dc70-4673-a991-2be01f5e25b4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:20.145302 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-19275738-dc70-4673-a991-2be01f5e25b4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:20.146586 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-19275738-dc70-4673-a991-2be01f5e25b4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:20.146586 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-19275738-dc70-4673-a991-2be01f5e25b4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:20.146924 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-19275738-dc70-4673-a991-2be01f5e25b4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:20.207474 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-19275738-dc70-4673-a991-2be01f5e25b4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:20.215841 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-19275738-dc70-4673-a991-2be01f5e25b4 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.081462 Jan 11 15:45:20.216407 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1308/2363] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:20 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:21.232217 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a14f18e2-92c5-498c-9731-8b7f4205fd7e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:21.232840 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a14f18e2-92c5-498c-9731-8b7f4205fd7e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:21.239135 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a14f18e2-92c5-498c-9731-8b7f4205fd7e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:21.239625 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a14f18e2-92c5-498c-9731-8b7f4205fd7e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:21.240408 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a14f18e2-92c5-498c-9731-8b7f4205fd7e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:21.240854 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a14f18e2-92c5-498c-9731-8b7f4205fd7e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:21.298494 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-a14f18e2-92c5-498c-9731-8b7f4205fd7e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:21.306363 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a14f18e2-92c5-498c-9731-8b7f4205fd7e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077863 Jan 11 15:45:21.306934 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1056/2364] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:21 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:22.323274 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-fe1c8547-0d63-4af7-818e-67c870773348 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:22.324412 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-fe1c8547-0d63-4af7-818e-67c870773348 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:22.330649 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fe1c8547-0d63-4af7-818e-67c870773348 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:22.331097 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fe1c8547-0d63-4af7-818e-67c870773348 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:22.331893 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fe1c8547-0d63-4af7-818e-67c870773348 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:22.332329 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fe1c8547-0d63-4af7-818e-67c870773348 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:22.390793 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-fe1c8547-0d63-4af7-818e-67c870773348 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:22.398461 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-fe1c8547-0d63-4af7-818e-67c870773348 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.078859 Jan 11 15:45:22.399411 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1309/2365] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:22 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:23.415616 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f103da1b-8a39-4a0d-baa6-583844b36435 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:23.416224 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f103da1b-8a39-4a0d-baa6-583844b36435 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:23.423155 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f103da1b-8a39-4a0d-baa6-583844b36435 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:23.423726 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f103da1b-8a39-4a0d-baa6-583844b36435 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:23.424504 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f103da1b-8a39-4a0d-baa6-583844b36435 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:23.424944 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f103da1b-8a39-4a0d-baa6-583844b36435 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:23.481504 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-f103da1b-8a39-4a0d-baa6-583844b36435 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:23.489069 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f103da1b-8a39-4a0d-baa6-583844b36435 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077111 Jan 11 15:45:23.489628 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1057/2366] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:23 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:24.505665 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ec91d368-8ee1-430a-9215-86cc69510349 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:24.506296 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ec91d368-8ee1-430a-9215-86cc69510349 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:24.512728 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ec91d368-8ee1-430a-9215-86cc69510349 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:24.513114 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ec91d368-8ee1-430a-9215-86cc69510349 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:24.513886 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ec91d368-8ee1-430a-9215-86cc69510349 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:24.514329 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ec91d368-8ee1-430a-9215-86cc69510349 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:24.580288 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ec91d368-8ee1-430a-9215-86cc69510349 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:24.588895 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ec91d368-8ee1-430a-9215-86cc69510349 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.086796 Jan 11 15:45:24.590037 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1310/2367] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:24 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:25.606377 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-468fc27d-5a6b-4431-96bd-ae22fd210a96 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:25.607008 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-468fc27d-5a6b-4431-96bd-ae22fd210a96 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:25.612946 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-468fc27d-5a6b-4431-96bd-ae22fd210a96 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:25.613396 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-468fc27d-5a6b-4431-96bd-ae22fd210a96 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:25.614160 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-468fc27d-5a6b-4431-96bd-ae22fd210a96 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:25.614591 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-468fc27d-5a6b-4431-96bd-ae22fd210a96 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:25.671109 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-468fc27d-5a6b-4431-96bd-ae22fd210a96 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:25.678645 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-468fc27d-5a6b-4431-96bd-ae22fd210a96 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076508 Jan 11 15:45:25.679196 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1058/2368] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:25 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:26.694819 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-690e5f80-fe1e-4e61-81ee-efa9c2114520 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:26.695464 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-690e5f80-fe1e-4e61-81ee-efa9c2114520 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:26.702212 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-690e5f80-fe1e-4e61-81ee-efa9c2114520 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:26.702669 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-690e5f80-fe1e-4e61-81ee-efa9c2114520 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:26.703479 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-690e5f80-fe1e-4e61-81ee-efa9c2114520 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:26.703927 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-690e5f80-fe1e-4e61-81ee-efa9c2114520 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:26.763983 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-690e5f80-fe1e-4e61-81ee-efa9c2114520 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:26.771658 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-690e5f80-fe1e-4e61-81ee-efa9c2114520 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.080449 Jan 11 15:45:26.772218 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1311/2369] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:26 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:27.788914 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-567b0ea9-6bd4-4fa3-94c9-58c5101e63d1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:27.789526 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-567b0ea9-6bd4-4fa3-94c9-58c5101e63d1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:27.796438 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-567b0ea9-6bd4-4fa3-94c9-58c5101e63d1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:27.796889 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-567b0ea9-6bd4-4fa3-94c9-58c5101e63d1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:27.797674 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-567b0ea9-6bd4-4fa3-94c9-58c5101e63d1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:27.798117 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-567b0ea9-6bd4-4fa3-94c9-58c5101e63d1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:27.853881 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-567b0ea9-6bd4-4fa3-94c9-58c5101e63d1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:27.862030 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-567b0ea9-6bd4-4fa3-94c9-58c5101e63d1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076787 Jan 11 15:45:27.862590 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1059/2370] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:27 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:28.878530 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9e20101d-dd08-41ce-9a87-d154ae25f288 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:28.879138 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9e20101d-dd08-41ce-9a87-d154ae25f288 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:28.885355 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9e20101d-dd08-41ce-9a87-d154ae25f288 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:28.885804 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9e20101d-dd08-41ce-9a87-d154ae25f288 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:28.886566 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9e20101d-dd08-41ce-9a87-d154ae25f288 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:28.886999 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9e20101d-dd08-41ce-9a87-d154ae25f288 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:28.943981 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-9e20101d-dd08-41ce-9a87-d154ae25f288 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:28.951595 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9e20101d-dd08-41ce-9a87-d154ae25f288 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076669 Jan 11 15:45:28.952154 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1312/2371] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:28 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:29.968544 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-ae55e077-3c84-4cd6-83e3-77175e957ba9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:29.969161 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-ae55e077-3c84-4cd6-83e3-77175e957ba9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:29.975335 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ae55e077-3c84-4cd6-83e3-77175e957ba9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:29.975787 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ae55e077-3c84-4cd6-83e3-77175e957ba9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:29.976560 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ae55e077-3c84-4cd6-83e3-77175e957ba9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:29.976995 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-ae55e077-3c84-4cd6-83e3-77175e957ba9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:30.051031 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-ae55e077-3c84-4cd6-83e3-77175e957ba9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:30.059037 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-ae55e077-3c84-4cd6-83e3-77175e957ba9 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.094211 Jan 11 15:45:30.059635 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1060/2372] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:29 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:30.779282 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:45:30.779567 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: Tue Jan 11 15:45:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:45:31.076035 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-70242ebc-c8bc-4b5d-acb5-0b3c19246275 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:31.076584 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-70242ebc-c8bc-4b5d-acb5-0b3c19246275 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:31.082785 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-70242ebc-c8bc-4b5d-acb5-0b3c19246275 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:31.083237 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-70242ebc-c8bc-4b5d-acb5-0b3c19246275 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:31.084044 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-70242ebc-c8bc-4b5d-acb5-0b3c19246275 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:31.084491 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-70242ebc-c8bc-4b5d-acb5-0b3c19246275 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:31.150790 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-70242ebc-c8bc-4b5d-acb5-0b3c19246275 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:31.158680 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-70242ebc-c8bc-4b5d-acb5-0b3c19246275 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.086997 Jan 11 15:45:31.159246 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1313/2373] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:31 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:32.175447 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-5e638c7c-6d74-4256-af3b-4d31b6a68481 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:32.176090 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-5e638c7c-6d74-4256-af3b-4d31b6a68481 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:32.182250 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5e638c7c-6d74-4256-af3b-4d31b6a68481 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:32.182727 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5e638c7c-6d74-4256-af3b-4d31b6a68481 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:32.183516 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5e638c7c-6d74-4256-af3b-4d31b6a68481 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:32.183952 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5e638c7c-6d74-4256-af3b-4d31b6a68481 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:32.240210 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-5e638c7c-6d74-4256-af3b-4d31b6a68481 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:32.248287 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-5e638c7c-6d74-4256-af3b-4d31b6a68481 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076454 Jan 11 15:45:32.248833 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1061/2374] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:32 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:33.266686 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d69a3f33-40f7-450d-aeb0-87c96a8e4544 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:33.267863 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d69a3f33-40f7-450d-aeb0-87c96a8e4544 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:33.279103 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d69a3f33-40f7-450d-aeb0-87c96a8e4544 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:33.281452 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d69a3f33-40f7-450d-aeb0-87c96a8e4544 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:33.281452 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d69a3f33-40f7-450d-aeb0-87c96a8e4544 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:33.281682 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d69a3f33-40f7-450d-aeb0-87c96a8e4544 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:33.337953 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d69a3f33-40f7-450d-aeb0-87c96a8e4544 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:33.346143 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d69a3f33-40f7-450d-aeb0-87c96a8e4544 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.084477 Jan 11 15:45:33.346701 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1314/2375] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:33 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:34.363230 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a62b0096-692c-4c7a-b14e-245d027dfb41 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:34.364033 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a62b0096-692c-4c7a-b14e-245d027dfb41 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:34.370119 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a62b0096-692c-4c7a-b14e-245d027dfb41 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:34.370577 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a62b0096-692c-4c7a-b14e-245d027dfb41 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:34.371429 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a62b0096-692c-4c7a-b14e-245d027dfb41 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:34.371872 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a62b0096-692c-4c7a-b14e-245d027dfb41 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:34.428755 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-a62b0096-692c-4c7a-b14e-245d027dfb41 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:34.436498 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a62b0096-692c-4c7a-b14e-245d027dfb41 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076990 Jan 11 15:45:34.437059 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1062/2376] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:34 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:35.453447 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-11697e67-b139-474b-a590-883959976c80 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:35.454042 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-11697e67-b139-474b-a590-883959976c80 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:35.460319 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-11697e67-b139-474b-a590-883959976c80 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:35.460776 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-11697e67-b139-474b-a590-883959976c80 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:35.461551 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-11697e67-b139-474b-a590-883959976c80 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:35.461990 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-11697e67-b139-474b-a590-883959976c80 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:35.520340 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-11697e67-b139-474b-a590-883959976c80 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:35.530804 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-11697e67-b139-474b-a590-883959976c80 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.081085 Jan 11 15:45:35.531397 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1315/2377] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:35 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:45:36.547393 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-fb49045f-7eab-4b8e-a533-b2eadafb6e31 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:36.547926 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-fb49045f-7eab-4b8e-a533-b2eadafb6e31 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:36.554091 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fb49045f-7eab-4b8e-a533-b2eadafb6e31 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:36.554543 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fb49045f-7eab-4b8e-a533-b2eadafb6e31 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:36.555330 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fb49045f-7eab-4b8e-a533-b2eadafb6e31 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:36.555771 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fb49045f-7eab-4b8e-a533-b2eadafb6e31 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:36.612515 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-fb49045f-7eab-4b8e-a533-b2eadafb6e31 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:36.620070 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-fb49045f-7eab-4b8e-a533-b2eadafb6e31 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076464 Jan 11 15:45:36.620619 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1063/2378] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:36 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:37.636551 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-687e116f-d0ae-41fa-8076-6e23229dee70 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:37.637145 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-687e116f-d0ae-41fa-8076-6e23229dee70 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:37.643464 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-687e116f-d0ae-41fa-8076-6e23229dee70 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:37.643920 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-687e116f-d0ae-41fa-8076-6e23229dee70 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:37.644696 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-687e116f-d0ae-41fa-8076-6e23229dee70 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:37.645141 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-687e116f-d0ae-41fa-8076-6e23229dee70 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:37.705134 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-687e116f-d0ae-41fa-8076-6e23229dee70 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:37.718844 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-687e116f-d0ae-41fa-8076-6e23229dee70 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.085963 Jan 11 15:45:37.719444 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1316/2379] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:37 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:38.735663 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e7e308de-e01c-4447-9077-18eec0a72607 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:38.736352 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e7e308de-e01c-4447-9077-18eec0a72607 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:38.742535 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e7e308de-e01c-4447-9077-18eec0a72607 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:38.742987 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e7e308de-e01c-4447-9077-18eec0a72607 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:38.743787 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e7e308de-e01c-4447-9077-18eec0a72607 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:38.744225 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e7e308de-e01c-4447-9077-18eec0a72607 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:38.802669 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-e7e308de-e01c-4447-9077-18eec0a72607 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:38.810912 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e7e308de-e01c-4447-9077-18eec0a72607 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.078977 Jan 11 15:45:38.811490 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1064/2380] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:38 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:39.828129 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ef9fda24-dcb0-459f-9b63-286520fb1c9a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:39.828678 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ef9fda24-dcb0-459f-9b63-286520fb1c9a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:39.834890 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ef9fda24-dcb0-459f-9b63-286520fb1c9a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:39.837775 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ef9fda24-dcb0-459f-9b63-286520fb1c9a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:39.837775 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ef9fda24-dcb0-459f-9b63-286520fb1c9a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:39.837775 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ef9fda24-dcb0-459f-9b63-286520fb1c9a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:39.907148 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ef9fda24-dcb0-459f-9b63-286520fb1c9a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:39.915111 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ef9fda24-dcb0-459f-9b63-286520fb1c9a tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.091387 Jan 11 15:45:39.915723 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1317/2381] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:39 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:40.931655 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a8622465-2ebc-4d05-afe1-4dced32973a6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:40.932266 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a8622465-2ebc-4d05-afe1-4dced32973a6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:40.938499 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a8622465-2ebc-4d05-afe1-4dced32973a6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:40.939106 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a8622465-2ebc-4d05-afe1-4dced32973a6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:40.939909 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a8622465-2ebc-4d05-afe1-4dced32973a6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:40.940346 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a8622465-2ebc-4d05-afe1-4dced32973a6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:40.997923 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-a8622465-2ebc-4d05-afe1-4dced32973a6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:41.005695 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a8622465-2ebc-4d05-afe1-4dced32973a6 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077708 Jan 11 15:45:41.006252 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1065/2382] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:40 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:42.022203 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-dbd41cb6-a99c-4772-9212-6ca53be8bce1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:42.022826 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-dbd41cb6-a99c-4772-9212-6ca53be8bce1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:42.029814 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dbd41cb6-a99c-4772-9212-6ca53be8bce1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:42.030264 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dbd41cb6-a99c-4772-9212-6ca53be8bce1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:42.031047 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dbd41cb6-a99c-4772-9212-6ca53be8bce1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:42.031517 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dbd41cb6-a99c-4772-9212-6ca53be8bce1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:42.087921 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-dbd41cb6-a99c-4772-9212-6ca53be8bce1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:42.095989 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-dbd41cb6-a99c-4772-9212-6ca53be8bce1 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077399 Jan 11 15:45:42.096552 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1318/2383] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:42 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:43.112237 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-cd75d38a-e6c0-4fa1-b92e-86275583ae38 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:43.112872 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-cd75d38a-e6c0-4fa1-b92e-86275583ae38 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:43.119330 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cd75d38a-e6c0-4fa1-b92e-86275583ae38 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:43.119790 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cd75d38a-e6c0-4fa1-b92e-86275583ae38 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:43.120556 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cd75d38a-e6c0-4fa1-b92e-86275583ae38 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:43.120989 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-cd75d38a-e6c0-4fa1-b92e-86275583ae38 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:43.180067 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-cd75d38a-e6c0-4fa1-b92e-86275583ae38 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:43.188130 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-cd75d38a-e6c0-4fa1-b92e-86275583ae38 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.079464 Jan 11 15:45:43.188730 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1066/2384] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:43 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:44.204877 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-53146893-ca6b-48bc-a9f6-b1e3d7f8c4fd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:44.205502 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-53146893-ca6b-48bc-a9f6-b1e3d7f8c4fd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:44.211867 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-53146893-ca6b-48bc-a9f6-b1e3d7f8c4fd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:44.212320 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-53146893-ca6b-48bc-a9f6-b1e3d7f8c4fd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:44.213095 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-53146893-ca6b-48bc-a9f6-b1e3d7f8c4fd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:44.213539 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-53146893-ca6b-48bc-a9f6-b1e3d7f8c4fd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:44.275008 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-53146893-ca6b-48bc-a9f6-b1e3d7f8c4fd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:44.283355 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-53146893-ca6b-48bc-a9f6-b1e3d7f8c4fd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.082093 Jan 11 15:45:44.283923 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1319/2385] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:44 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:45.299353 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2ee45d54-a7f0-4d12-b106-feac5a54912b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:45.299957 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2ee45d54-a7f0-4d12-b106-feac5a54912b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:45.306151 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2ee45d54-a7f0-4d12-b106-feac5a54912b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:45.306597 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2ee45d54-a7f0-4d12-b106-feac5a54912b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:45.307380 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2ee45d54-a7f0-4d12-b106-feac5a54912b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:45.307817 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2ee45d54-a7f0-4d12-b106-feac5a54912b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:45.364919 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-2ee45d54-a7f0-4d12-b106-feac5a54912b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:45.373289 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2ee45d54-a7f0-4d12-b106-feac5a54912b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077511 Jan 11 15:45:45.373882 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1067/2386] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:45 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:46.389677 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3a498bf2-0304-4e91-b0cd-b75ebf32586e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:46.390287 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3a498bf2-0304-4e91-b0cd-b75ebf32586e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:46.396565 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3a498bf2-0304-4e91-b0cd-b75ebf32586e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:46.397021 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3a498bf2-0304-4e91-b0cd-b75ebf32586e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:46.397797 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3a498bf2-0304-4e91-b0cd-b75ebf32586e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:46.398495 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3a498bf2-0304-4e91-b0cd-b75ebf32586e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:46.455823 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3a498bf2-0304-4e91-b0cd-b75ebf32586e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:46.463392 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3a498bf2-0304-4e91-b0cd-b75ebf32586e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077899 Jan 11 15:45:46.463967 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1320/2387] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:46 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:47.481283 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-47eb7e63-565c-4724-8a4f-3d2a95cdcac8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:47.481871 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-47eb7e63-565c-4724-8a4f-3d2a95cdcac8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:47.488067 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-47eb7e63-565c-4724-8a4f-3d2a95cdcac8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:47.488515 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-47eb7e63-565c-4724-8a4f-3d2a95cdcac8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:47.489281 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-47eb7e63-565c-4724-8a4f-3d2a95cdcac8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:47.489716 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-47eb7e63-565c-4724-8a4f-3d2a95cdcac8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:47.546333 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-47eb7e63-565c-4724-8a4f-3d2a95cdcac8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:47.553749 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-47eb7e63-565c-4724-8a4f-3d2a95cdcac8 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077025 Jan 11 15:45:47.554301 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1068/2388] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:47 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:48.570043 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-a734e2c7-ef2d-42c2-8400-1ae64c76b69e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:48.570687 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-a734e2c7-ef2d-42c2-8400-1ae64c76b69e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:48.577021 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a734e2c7-ef2d-42c2-8400-1ae64c76b69e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:48.584522 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a734e2c7-ef2d-42c2-8400-1ae64c76b69e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:48.584522 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a734e2c7-ef2d-42c2-8400-1ae64c76b69e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:48.584522 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-a734e2c7-ef2d-42c2-8400-1ae64c76b69e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:48.636401 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-a734e2c7-ef2d-42c2-8400-1ae64c76b69e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:48.644084 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-a734e2c7-ef2d-42c2-8400-1ae64c76b69e tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077703 Jan 11 15:45:48.644651 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1321/2389] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:48 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:49.660395 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-e9217997-d95e-4a4c-a86b-a20f139b9350 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:49.661030 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-e9217997-d95e-4a4c-a86b-a20f139b9350 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:49.667268 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e9217997-d95e-4a4c-a86b-a20f139b9350 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:49.667751 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e9217997-d95e-4a4c-a86b-a20f139b9350 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:49.668560 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e9217997-d95e-4a4c-a86b-a20f139b9350 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:49.668999 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-e9217997-d95e-4a4c-a86b-a20f139b9350 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:49.727019 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-e9217997-d95e-4a4c-a86b-a20f139b9350 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:49.734886 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-e9217997-d95e-4a4c-a86b-a20f139b9350 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.078240 Jan 11 15:45:49.735473 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1069/2390] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:49 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:50.751615 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-6248c0b6-9bde-47b9-9d4f-edecfd50c2bd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:50.752147 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-6248c0b6-9bde-47b9-9d4f-edecfd50c2bd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:50.758353 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6248c0b6-9bde-47b9-9d4f-edecfd50c2bd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:50.758806 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6248c0b6-9bde-47b9-9d4f-edecfd50c2bd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:50.759613 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6248c0b6-9bde-47b9-9d4f-edecfd50c2bd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:50.760092 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-6248c0b6-9bde-47b9-9d4f-edecfd50c2bd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:50.819994 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-6248c0b6-9bde-47b9-9d4f-edecfd50c2bd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:50.827708 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-6248c0b6-9bde-47b9-9d4f-edecfd50c2bd tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.079812 Jan 11 15:45:50.828274 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1322/2391] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:50 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:51.845033 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-1e41b20b-d02d-48e5-8f7c-e8589293ff4f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:51.845610 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-1e41b20b-d02d-48e5-8f7c-e8589293ff4f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:51.851828 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1e41b20b-d02d-48e5-8f7c-e8589293ff4f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:51.852290 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1e41b20b-d02d-48e5-8f7c-e8589293ff4f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:51.853066 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1e41b20b-d02d-48e5-8f7c-e8589293ff4f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:51.853507 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-1e41b20b-d02d-48e5-8f7c-e8589293ff4f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:51.910725 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-1e41b20b-d02d-48e5-8f7c-e8589293ff4f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:51.918800 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-1e41b20b-d02d-48e5-8f7c-e8589293ff4f tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.077368 Jan 11 15:45:51.919393 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1070/2392] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:51 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:52.934797 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f0c652ee-cfc9-4113-9b75-2ee35d5ec50b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:52.935379 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f0c652ee-cfc9-4113-9b75-2ee35d5ec50b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:52.941822 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f0c652ee-cfc9-4113-9b75-2ee35d5ec50b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:52.942275 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f0c652ee-cfc9-4113-9b75-2ee35d5ec50b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:52.943053 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f0c652ee-cfc9-4113-9b75-2ee35d5ec50b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:52.943528 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f0c652ee-cfc9-4113-9b75-2ee35d5ec50b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:53.000347 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f0c652ee-cfc9-4113-9b75-2ee35d5ec50b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:53.007954 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f0c652ee-cfc9-4113-9b75-2ee35d5ec50b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1353 microversion: 2.1 time: 0.076826 Jan 11 15:45:53.008521 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1323/2393] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:52 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:54.024811 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-69145b86-9621-472b-8074-53e9f9c62b2b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:54.025460 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-69145b86-9621-472b-8074-53e9f9c62b2b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:54.031749 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-69145b86-9621-472b-8074-53e9f9c62b2b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:54.032202 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-69145b86-9621-472b-8074-53e9f9c62b2b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:54.032978 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-69145b86-9621-472b-8074-53e9f9c62b2b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:54.033417 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-69145b86-9621-472b-8074-53e9f9c62b2b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:54.062222 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-69145b86-9621-472b-8074-53e9f9c62b2b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:54.062671 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-69145b86-9621-472b-8074-53e9f9c62b2b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:54.063113 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.objects.instance [None req-69145b86-9621-472b-8074-53e9f9c62b2b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lazy-loading 'fault' on Instance uuid 3b978091-0bf4-4e69-8053-76e49154df4c {{(pid=116903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 15:45:54.100649 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-69145b86-9621-472b-8074-53e9f9c62b2b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbdfb4cffb24af08af575c0742abcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dc68d56028437c845a8b922ebb73fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:45:54.108280 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-69145b86-9621-472b-8074-53e9f9c62b2b tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 200 len: 1447 microversion: 2.1 time: 0.087351 Jan 11 15:45:54.109042 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1071/2394] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:54 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 1447 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:45:55.125686 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-222ba9fe-de7c-4f7c-9c92-29b93dc8d104 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:45:55.126297 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-222ba9fe-de7c-4f7c-9c92-29b93dc8d104 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] [instance: 3b978091-0bf4-4e69-8053-76e49154df4c] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:45:55.132405 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-222ba9fe-de7c-4f7c-9c92-29b93dc8d104 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:55.132893 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-222ba9fe-de7c-4f7c-9c92-29b93dc8d104 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:55.133621 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-222ba9fe-de7c-4f7c-9c92-29b93dc8d104 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:45:55.134057 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-222ba9fe-de7c-4f7c-9c92-29b93dc8d104 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:45:55.148290 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.wsgi [None req-222ba9fe-de7c-4f7c-9c92-29b93dc8d104 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] HTTP exception thrown: Instance 3b978091-0bf4-4e69-8053-76e49154df4c could not be found. Jan 11 15:45:55.148939 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-222ba9fe-de7c-4f7c-9c92-29b93dc8d104 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] Returning 404 to user: Instance 3b978091-0bf4-4e69-8053-76e49154df4c could not be found. {{(pid=116902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:45:55.149750 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-222ba9fe-de7c-4f7c-9c92-29b93dc8d104 tempest-ServerRescueNegativeTestJSON-2052117699 tempest-ServerRescueNegativeTestJSON-2052117699-project] 10.222.0.52 "GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c" status: 404 len: 111 microversion: 2.1 time: 0.028089 Jan 11 15:45:55.150279 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1324/2395] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:45:55 2022] GET /compute/v2.1/servers/3b978091-0bf4-4e69-8053-76e49154df4c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 15:46:07.041458 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:46:07.042069 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: Tue Jan 11 15:46:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:46:20.598166 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:46:20.598844 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: Tue Jan 11 15:46:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:46:34.692885 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:46:34.693418 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: Tue Jan 11 15:46:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:46:50.882756 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-6ef50445-f541-46af-97d7-64a7a1f90739 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Action: 'create', calling method: .version_select at 0x7f16be9a6b80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1112735517"}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:46:50.897320 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.quota [None req-6ef50445-f541-46af-97d7-64a7a1f90739 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Getting quotas for project 06276674abbb4c1f8a9437722791905e. Resources: {'key_pairs'} {{(pid=116903) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 15:46:50.901050 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.quota [None req-6ef50445-f541-46af-97d7-64a7a1f90739 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Getting quotas for user 22875c58647e4bd089f89cd66dd473e3 and project 06276674abbb4c1f8a9437722791905e. Resources: {'key_pairs'} {{(pid=116903) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 15:46:51.152909 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.quota [None req-6ef50445-f541-46af-97d7-64a7a1f90739 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Getting quotas for project 06276674abbb4c1f8a9437722791905e. Resources: {'key_pairs'} {{(pid=116903) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 15:46:51.157116 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.quota [None req-6ef50445-f541-46af-97d7-64a7a1f90739 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Getting quotas for user 22875c58647e4bd089f89cd66dd473e3 and project 06276674abbb4c1f8a9437722791905e. Resources: {'key_pairs'} {{(pid=116903) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 15:46:51.170500 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-6ef50445-f541-46af-97d7-64a7a1f90739 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.290746 Jan 11 15:46:51.171106 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1072/2396] 10.222.0.52 () {60 vars in 1157 bytes} [Tue Jan 11 15:46:50 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:46:51.219421 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-937eef06-60d5-4be5-8c6a-0fce4794e942 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-279184216", "imageRef": "fedf47d0-7a12-47e8-97a0-b35e6919ce4f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1112735517", "networks": [{"uuid": "cadd987c-b66f-4ad7-86d0-a2676e82abb1"}]}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:46:51.379957 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.network.neutron [None req-937eef06-60d5-4be5-8c6a-0fce4794e942 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] validate_networks() for [('cadd987c-b66f-4ad7-86d0-a2676e82abb1', None, None, None, None, None)] {{(pid=116902) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 15:46:51.850523 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-937eef06-60d5-4be5-8c6a-0fce4794e942 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Flavor limits 0:0:0 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 15:46:51.850954 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-937eef06-60d5-4be5-8c6a-0fce4794e942 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Image limits 0:0:0 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 15:46:51.851475 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-937eef06-60d5-4be5-8c6a-0fce4794e942 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Flavor pref 0:0:0 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 15:46:51.851892 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-937eef06-60d5-4be5-8c6a-0fce4794e942 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Image pref 0:0:0 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 15:46:51.852308 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.virt.hardware [None req-937eef06-60d5-4be5-8c6a-0fce4794e942 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 15:46:51.860978 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-937eef06-60d5-4be5-8c6a-0fce4794e942 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:46:51.865601 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-937eef06-60d5-4be5-8c6a-0fce4794e942 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:46:51.865601 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-937eef06-60d5-4be5-8c6a-0fce4794e942 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:46:51.865601 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-937eef06-60d5-4be5-8c6a-0fce4794e942 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:46:51.879035 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.quota [None req-937eef06-60d5-4be5-8c6a-0fce4794e942 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Getting quotas for project 06276674abbb4c1f8a9437722791905e. Resources: {'instances', 'cores', 'ram'} {{(pid=116902) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 15:46:51.882936 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.quota [None req-937eef06-60d5-4be5-8c6a-0fce4794e942 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Getting quotas for user 22875c58647e4bd089f89cd66dd473e3 and project 06276674abbb4c1f8a9437722791905e. Resources: {'instances', 'cores', 'ram'} {{(pid=116902) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 15:46:51.894187 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-937eef06-60d5-4be5-8c6a-0fce4794e942 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Going to run 1 instances... {{(pid=116902) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 15:46:51.896746 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-937eef06-60d5-4be5-8c6a-0fce4794e942 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fedf47d0-7a12-47e8-97a0-b35e6919ce4f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 15:46:52.014271 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-937eef06-60d5-4be5-8c6a-0fce4794e942 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.798629 Jan 11 15:46:52.014913 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1325/2397] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jan 11 15:46:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 15:46:52.025118 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-d5375847-4d16-4a9e-bac4-33930fc04cab tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:46:52.025731 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-d5375847-4d16-4a9e-bac4-33930fc04cab tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:46:52.128301 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-d5375847-4d16-4a9e-bac4-33930fc04cab tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:46:52.135741 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-d5375847-4d16-4a9e-bac4-33930fc04cab tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1258 microversion: 2.1 time: 0.115027 Jan 11 15:46:52.136292 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1073/2398] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:46:52 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1258 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:46:53.153031 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-304b46d5-86ec-4343-98d1-8301a21e4c2e tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:46:53.153599 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-304b46d5-86ec-4343-98d1-8301a21e4c2e tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:46:53.160226 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-304b46d5-86ec-4343-98d1-8301a21e4c2e tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:46:53.160681 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-304b46d5-86ec-4343-98d1-8301a21e4c2e tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:46:53.161452 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-304b46d5-86ec-4343-98d1-8301a21e4c2e tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:46:53.161894 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-304b46d5-86ec-4343-98d1-8301a21e4c2e tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:46:53.221259 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-304b46d5-86ec-4343-98d1-8301a21e4c2e tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:46:53.229916 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-304b46d5-86ec-4343-98d1-8301a21e4c2e tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1262 microversion: 2.1 time: 0.081139 Jan 11 15:46:53.230477 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1326/2399] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:46:53 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:46:54.246325 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-8332df84-f909-4946-8a8e-5caf7f693252 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:46:54.255098 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-8332df84-f909-4946-8a8e-5caf7f693252 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:46:54.259617 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8332df84-f909-4946-8a8e-5caf7f693252 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:46:54.260105 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8332df84-f909-4946-8a8e-5caf7f693252 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:46:54.260892 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8332df84-f909-4946-8a8e-5caf7f693252 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:46:54.261324 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8332df84-f909-4946-8a8e-5caf7f693252 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:46:54.328694 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-8332df84-f909-4946-8a8e-5caf7f693252 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:46:54.336386 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-8332df84-f909-4946-8a8e-5caf7f693252 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1318 microversion: 2.1 time: 0.093594 Jan 11 15:46:54.336942 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1074/2400] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:46:54 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1318 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:46:55.367238 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4e3a8398-16bc-4a4f-a129-ae44b0e8bb74 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:46:55.368514 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-4e3a8398-16bc-4a4f-a129-ae44b0e8bb74 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:46:55.376071 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4e3a8398-16bc-4a4f-a129-ae44b0e8bb74 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:46:55.376764 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4e3a8398-16bc-4a4f-a129-ae44b0e8bb74 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:46:55.377719 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4e3a8398-16bc-4a4f-a129-ae44b0e8bb74 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:46:55.378359 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4e3a8398-16bc-4a4f-a129-ae44b0e8bb74 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:46:55.605113 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-4e3a8398-16bc-4a4f-a129-ae44b0e8bb74 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:46:55.640111 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4e3a8398-16bc-4a4f-a129-ae44b0e8bb74 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1358 microversion: 2.1 time: 0.273875 Jan 11 15:46:55.642529 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1327/2401] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:46:55 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1358 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:46:56.662737 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-b13b9306-9f14-495b-bc08-d1a1d486c6fd tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:46:56.664010 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-b13b9306-9f14-495b-bc08-d1a1d486c6fd tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:46:56.670013 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b13b9306-9f14-495b-bc08-d1a1d486c6fd tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:46:56.670468 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b13b9306-9f14-495b-bc08-d1a1d486c6fd tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:46:56.671274 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b13b9306-9f14-495b-bc08-d1a1d486c6fd tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:46:56.672014 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-b13b9306-9f14-495b-bc08-d1a1d486c6fd tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:46:56.812553 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-b13b9306-9f14-495b-bc08-d1a1d486c6fd tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:46:56.820038 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-b13b9306-9f14-495b-bc08-d1a1d486c6fd tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1358 microversion: 2.1 time: 0.161082 Jan 11 15:46:56.820925 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1075/2402] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:46:56 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:46:57.836631 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-af6a6fc8-c192-4641-a9d7-4201436d42d8 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:46:57.837296 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-af6a6fc8-c192-4641-a9d7-4201436d42d8 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:46:57.844229 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-af6a6fc8-c192-4641-a9d7-4201436d42d8 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:46:57.844684 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-af6a6fc8-c192-4641-a9d7-4201436d42d8 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:46:57.845699 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-af6a6fc8-c192-4641-a9d7-4201436d42d8 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:46:57.846143 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-af6a6fc8-c192-4641-a9d7-4201436d42d8 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:46:57.996294 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-af6a6fc8-c192-4641-a9d7-4201436d42d8 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:46:58.004477 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-af6a6fc8-c192-4641-a9d7-4201436d42d8 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1358 microversion: 2.1 time: 0.171433 Jan 11 15:46:58.005136 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1328/2403] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:46:57 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:46:59.022044 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-26077e8f-431e-4d60-b6bc-fbc4eee9d332 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:46:59.022764 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-26077e8f-431e-4d60-b6bc-fbc4eee9d332 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:46:59.029536 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-26077e8f-431e-4d60-b6bc-fbc4eee9d332 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:46:59.029990 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-26077e8f-431e-4d60-b6bc-fbc4eee9d332 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:46:59.030765 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-26077e8f-431e-4d60-b6bc-fbc4eee9d332 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:46:59.031210 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-26077e8f-431e-4d60-b6bc-fbc4eee9d332 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:46:59.172703 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-26077e8f-431e-4d60-b6bc-fbc4eee9d332 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:46:59.181929 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-26077e8f-431e-4d60-b6bc-fbc4eee9d332 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1358 microversion: 2.1 time: 0.163741 Jan 11 15:46:59.182509 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1076/2404] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:46:59 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:47:00.198600 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e74e9931-27e7-4464-a2ae-454434d7d31e tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:00.200220 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e74e9931-27e7-4464-a2ae-454434d7d31e tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:00.209156 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e74e9931-27e7-4464-a2ae-454434d7d31e tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:00.210034 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e74e9931-27e7-4464-a2ae-454434d7d31e tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:00.211083 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e74e9931-27e7-4464-a2ae-454434d7d31e tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:00.211788 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e74e9931-27e7-4464-a2ae-454434d7d31e tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:00.487633 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e74e9931-27e7-4464-a2ae-454434d7d31e tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:00.496712 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e74e9931-27e7-4464-a2ae-454434d7d31e tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1358 microversion: 2.1 time: 0.301857 Jan 11 15:47:00.499665 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1329/2405] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:00 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1358 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:47:01.518421 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-585b0f31-f4c5-4f31-997a-1ffdea6956f6 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:01.519787 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-585b0f31-f4c5-4f31-997a-1ffdea6956f6 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:01.527504 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-585b0f31-f4c5-4f31-997a-1ffdea6956f6 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:01.528457 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-585b0f31-f4c5-4f31-997a-1ffdea6956f6 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:01.529524 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-585b0f31-f4c5-4f31-997a-1ffdea6956f6 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:01.530201 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-585b0f31-f4c5-4f31-997a-1ffdea6956f6 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:01.695403 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-585b0f31-f4c5-4f31-997a-1ffdea6956f6 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:01.704258 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-585b0f31-f4c5-4f31-997a-1ffdea6956f6 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1358 microversion: 2.1 time: 0.190119 Jan 11 15:47:01.704767 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1077/2406] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:01 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:47:02.721663 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-2ddbff13-27dd-4751-803c-cd00d8947957 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:02.722339 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-2ddbff13-27dd-4751-803c-cd00d8947957 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:02.728639 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2ddbff13-27dd-4751-803c-cd00d8947957 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:02.729092 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2ddbff13-27dd-4751-803c-cd00d8947957 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:02.729882 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2ddbff13-27dd-4751-803c-cd00d8947957 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:02.730309 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-2ddbff13-27dd-4751-803c-cd00d8947957 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:02.859833 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-2ddbff13-27dd-4751-803c-cd00d8947957 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:02.867648 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-2ddbff13-27dd-4751-803c-cd00d8947957 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1358 microversion: 2.1 time: 0.149664 Jan 11 15:47:02.868239 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1330/2407] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:02 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:47:03.883709 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-0aa96308-4b4a-4075-9a88-f3ffd5522114 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:03.884326 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-0aa96308-4b4a-4075-9a88-f3ffd5522114 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:03.890703 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0aa96308-4b4a-4075-9a88-f3ffd5522114 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:03.891187 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0aa96308-4b4a-4075-9a88-f3ffd5522114 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:03.892003 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0aa96308-4b4a-4075-9a88-f3ffd5522114 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:03.892454 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-0aa96308-4b4a-4075-9a88-f3ffd5522114 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:04.025042 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-0aa96308-4b4a-4075-9a88-f3ffd5522114 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:04.034260 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-0aa96308-4b4a-4075-9a88-f3ffd5522114 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1358 microversion: 2.1 time: 0.153993 Jan 11 15:47:04.034873 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1078/2408] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:03 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:47:05.049405 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-b6841e15-73a0-438c-858f-6d75b00588de tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:05.050022 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-b6841e15-73a0-438c-858f-6d75b00588de tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:05.058935 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b6841e15-73a0-438c-858f-6d75b00588de tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:05.058935 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b6841e15-73a0-438c-858f-6d75b00588de tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:05.058935 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b6841e15-73a0-438c-858f-6d75b00588de tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:05.058935 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-b6841e15-73a0-438c-858f-6d75b00588de tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:05.188546 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-b6841e15-73a0-438c-858f-6d75b00588de tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:05.195929 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-b6841e15-73a0-438c-858f-6d75b00588de tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1358 microversion: 2.1 time: 0.150155 Jan 11 15:47:05.196500 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1331/2409] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:05 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:47:06.213648 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-bd2e387a-6675-4c19-b22a-8fefdd63ac15 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:06.214260 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-bd2e387a-6675-4c19-b22a-8fefdd63ac15 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:06.221969 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bd2e387a-6675-4c19-b22a-8fefdd63ac15 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:06.222431 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bd2e387a-6675-4c19-b22a-8fefdd63ac15 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:06.223256 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bd2e387a-6675-4c19-b22a-8fefdd63ac15 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:06.223731 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bd2e387a-6675-4c19-b22a-8fefdd63ac15 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:06.359753 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-bd2e387a-6675-4c19-b22a-8fefdd63ac15 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:06.367029 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-bd2e387a-6675-4c19-b22a-8fefdd63ac15 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1358 microversion: 2.1 time: 0.157045 Jan 11 15:47:06.367631 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1079/2410] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:06 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:47:07.383777 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e21c4fc5-b78d-4c92-abb2-803fdbbba4ef tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:07.384399 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e21c4fc5-b78d-4c92-abb2-803fdbbba4ef tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:07.391615 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e21c4fc5-b78d-4c92-abb2-803fdbbba4ef tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:07.391985 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e21c4fc5-b78d-4c92-abb2-803fdbbba4ef tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:07.392778 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e21c4fc5-b78d-4c92-abb2-803fdbbba4ef tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:07.393226 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e21c4fc5-b78d-4c92-abb2-803fdbbba4ef tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:07.529875 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e21c4fc5-b78d-4c92-abb2-803fdbbba4ef tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:07.537082 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e21c4fc5-b78d-4c92-abb2-803fdbbba4ef tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1358 microversion: 2.1 time: 0.157101 Jan 11 15:47:07.537604 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1332/2411] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:07 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:47:08.553595 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-70808128-fd7a-4b44-98d6-f95ddac57d1b tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:08.554212 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-70808128-fd7a-4b44-98d6-f95ddac57d1b tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:08.561177 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-70808128-fd7a-4b44-98d6-f95ddac57d1b tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:08.561635 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-70808128-fd7a-4b44-98d6-f95ddac57d1b tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:08.562414 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-70808128-fd7a-4b44-98d6-f95ddac57d1b tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:08.562857 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-70808128-fd7a-4b44-98d6-f95ddac57d1b tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:08.690464 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-70808128-fd7a-4b44-98d6-f95ddac57d1b tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:08.697736 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-70808128-fd7a-4b44-98d6-f95ddac57d1b tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1358 microversion: 2.1 time: 0.147758 Jan 11 15:47:08.698292 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1080/2412] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:08 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:47:09.713704 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-32568226-7e3c-4a7a-90f1-ff7282c57fa8 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:09.714299 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-32568226-7e3c-4a7a-90f1-ff7282c57fa8 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:09.721087 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-32568226-7e3c-4a7a-90f1-ff7282c57fa8 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:09.721542 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-32568226-7e3c-4a7a-90f1-ff7282c57fa8 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:09.722323 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-32568226-7e3c-4a7a-90f1-ff7282c57fa8 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:09.722767 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-32568226-7e3c-4a7a-90f1-ff7282c57fa8 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:09.858335 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-32568226-7e3c-4a7a-90f1-ff7282c57fa8 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:09.865515 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-32568226-7e3c-4a7a-90f1-ff7282c57fa8 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1358 microversion: 2.1 time: 0.155509 Jan 11 15:47:09.866077 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1333/2413] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:09 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:47:10.882127 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-30dfe298-62f0-45e0-bd1c-cee5457c9f5e tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:10.882708 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-30dfe298-62f0-45e0-bd1c-cee5457c9f5e tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:10.888987 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-30dfe298-62f0-45e0-bd1c-cee5457c9f5e tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:10.889426 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-30dfe298-62f0-45e0-bd1c-cee5457c9f5e tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:10.890200 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-30dfe298-62f0-45e0-bd1c-cee5457c9f5e tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:10.890641 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-30dfe298-62f0-45e0-bd1c-cee5457c9f5e tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:11.021605 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-30dfe298-62f0-45e0-bd1c-cee5457c9f5e tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:11.028990 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-30dfe298-62f0-45e0-bd1c-cee5457c9f5e tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1358 microversion: 2.1 time: 0.150645 Jan 11 15:47:11.029563 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1081/2414] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:10 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:47:12.045297 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f0832c02-7bd8-4e47-b4a8-02f508559066 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:12.045910 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f0832c02-7bd8-4e47-b4a8-02f508559066 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:12.052455 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f0832c02-7bd8-4e47-b4a8-02f508559066 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:12.052922 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f0832c02-7bd8-4e47-b4a8-02f508559066 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:12.053724 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f0832c02-7bd8-4e47-b4a8-02f508559066 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:12.054172 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f0832c02-7bd8-4e47-b4a8-02f508559066 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:12.199131 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f0832c02-7bd8-4e47-b4a8-02f508559066 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:12.207597 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f0832c02-7bd8-4e47-b4a8-02f508559066 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1358 microversion: 2.1 time: 0.165882 Jan 11 15:47:12.208170 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1334/2415] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:12 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:47:13.224191 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-89b7b5b3-ae18-4512-be45-4f50fa333ac4 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:13.224794 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-89b7b5b3-ae18-4512-be45-4f50fa333ac4 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:13.231070 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-89b7b5b3-ae18-4512-be45-4f50fa333ac4 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:13.231555 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-89b7b5b3-ae18-4512-be45-4f50fa333ac4 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:13.232328 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-89b7b5b3-ae18-4512-be45-4f50fa333ac4 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:13.232767 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-89b7b5b3-ae18-4512-be45-4f50fa333ac4 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:13.361652 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-89b7b5b3-ae18-4512-be45-4f50fa333ac4 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:13.368933 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-89b7b5b3-ae18-4512-be45-4f50fa333ac4 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1358 microversion: 2.1 time: 0.148406 Jan 11 15:47:13.372295 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1082/2416] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:13 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:47:14.386084 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d2eb02f5-886d-497a-9471-bb2dda843462 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:14.386705 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d2eb02f5-886d-497a-9471-bb2dda843462 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:14.394076 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d2eb02f5-886d-497a-9471-bb2dda843462 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:14.394538 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d2eb02f5-886d-497a-9471-bb2dda843462 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:14.395612 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d2eb02f5-886d-497a-9471-bb2dda843462 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:14.396073 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d2eb02f5-886d-497a-9471-bb2dda843462 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:14.522674 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-d2eb02f5-886d-497a-9471-bb2dda843462 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:14.529871 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d2eb02f5-886d-497a-9471-bb2dda843462 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1358 microversion: 2.1 time: 0.147459 Jan 11 15:47:14.530552 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1335/2417] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:14 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:47:15.546123 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7d382dfe-f13f-4433-89cd-c7b78d86e48b tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:15.546726 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7d382dfe-f13f-4433-89cd-c7b78d86e48b tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:15.553275 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7d382dfe-f13f-4433-89cd-c7b78d86e48b tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:15.553728 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7d382dfe-f13f-4433-89cd-c7b78d86e48b tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:15.554495 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7d382dfe-f13f-4433-89cd-c7b78d86e48b tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:15.554930 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7d382dfe-f13f-4433-89cd-c7b78d86e48b tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:15.681267 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-7d382dfe-f13f-4433-89cd-c7b78d86e48b tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:15.688888 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7d382dfe-f13f-4433-89cd-c7b78d86e48b tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1358 microversion: 2.1 time: 0.146310 Jan 11 15:47:15.689441 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1083/2418] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:15 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:47:16.705727 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-4fb5a264-5fdc-43e1-8dbf-c93e549699d2 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:16.706331 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-4fb5a264-5fdc-43e1-8dbf-c93e549699d2 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:16.712567 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4fb5a264-5fdc-43e1-8dbf-c93e549699d2 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:16.713015 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4fb5a264-5fdc-43e1-8dbf-c93e549699d2 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:16.713782 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4fb5a264-5fdc-43e1-8dbf-c93e549699d2 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:16.714278 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-4fb5a264-5fdc-43e1-8dbf-c93e549699d2 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:16.838704 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-4fb5a264-5fdc-43e1-8dbf-c93e549699d2 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:16.845939 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-4fb5a264-5fdc-43e1-8dbf-c93e549699d2 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1358 microversion: 2.1 time: 0.144458 Jan 11 15:47:16.846533 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1336/2419] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:16 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:47:17.862279 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-8631f3f1-ce16-4da4-85b2-f5f8c3c0ad2b tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:17.862895 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-8631f3f1-ce16-4da4-85b2-f5f8c3c0ad2b tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:17.869133 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8631f3f1-ce16-4da4-85b2-f5f8c3c0ad2b tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:17.869590 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8631f3f1-ce16-4da4-85b2-f5f8c3c0ad2b tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:17.870362 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8631f3f1-ce16-4da4-85b2-f5f8c3c0ad2b tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:17.870806 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8631f3f1-ce16-4da4-85b2-f5f8c3c0ad2b tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:17.996957 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-8631f3f1-ce16-4da4-85b2-f5f8c3c0ad2b tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:18.004568 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-8631f3f1-ce16-4da4-85b2-f5f8c3c0ad2b tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1358 microversion: 2.1 time: 0.145929 Jan 11 15:47:18.005130 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1084/2420] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:17 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:47:19.021574 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e401154c-b475-4c93-904c-f33639bd8580 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:19.022189 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e401154c-b475-4c93-904c-f33639bd8580 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:19.028509 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e401154c-b475-4c93-904c-f33639bd8580 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:19.028967 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e401154c-b475-4c93-904c-f33639bd8580 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:19.029748 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e401154c-b475-4c93-904c-f33639bd8580 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:19.030193 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e401154c-b475-4c93-904c-f33639bd8580 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:19.167102 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e401154c-b475-4c93-904c-f33639bd8580 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:19.174381 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e401154c-b475-4c93-904c-f33639bd8580 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1358 microversion: 2.1 time: 0.156753 Jan 11 15:47:19.174952 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1337/2421] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:19 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:47:20.190802 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-70491fe2-4b46-453f-9307-5e20040d97cd tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:20.191371 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-70491fe2-4b46-453f-9307-5e20040d97cd tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:20.197559 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-70491fe2-4b46-453f-9307-5e20040d97cd tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:20.198015 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-70491fe2-4b46-453f-9307-5e20040d97cd tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:20.198790 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-70491fe2-4b46-453f-9307-5e20040d97cd tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:20.199229 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-70491fe2-4b46-453f-9307-5e20040d97cd tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:20.325647 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-70491fe2-4b46-453f-9307-5e20040d97cd tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:20.332913 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-70491fe2-4b46-453f-9307-5e20040d97cd tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1358 microversion: 2.1 time: 0.145917 Jan 11 15:47:20.333504 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1085/2422] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:20 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:47:21.349957 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-97694a07-0d40-47a8-bee2-2871ae13b967 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:21.350631 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-97694a07-0d40-47a8-bee2-2871ae13b967 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:21.357264 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-97694a07-0d40-47a8-bee2-2871ae13b967 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:21.357714 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-97694a07-0d40-47a8-bee2-2871ae13b967 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:21.358500 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-97694a07-0d40-47a8-bee2-2871ae13b967 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:21.359001 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-97694a07-0d40-47a8-bee2-2871ae13b967 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:21.527524 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-97694a07-0d40-47a8-bee2-2871ae13b967 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:21.534943 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-97694a07-0d40-47a8-bee2-2871ae13b967 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1358 microversion: 2.1 time: 0.188724 Jan 11 15:47:21.535565 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1338/2423] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:21 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:47:22.026167 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [req-01b78a9a-2377-4430-b057-f2bb345371e2 req-92d41874-7cfb-4530-a330-40c35bb1ea23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "893d0984-e8f3-4e6c-8be5-443e86cdb75e", "tag": "09678a50-7da3-4be3-a4ed-004641fadef2"}]} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:47:22.026167 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:47:22.026167 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: warnings.warn(msg) Jan 11 15:47:22.026167 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-01b78a9a-2377-4430-b057-f2bb345371e2 req-92d41874-7cfb-4530-a330-40c35bb1ea23 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:22.026167 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-01b78a9a-2377-4430-b057-f2bb345371e2 req-92d41874-7cfb-4530-a330-40c35bb1ea23 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:22.028996 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.compute.server_external_events [req-01b78a9a-2377-4430-b057-f2bb345371e2 req-92d41874-7cfb-4530-a330-40c35bb1ea23 service nova] Creating event network-changed:09678a50-7da3-4be3-a4ed-004641fadef2 for instance 893d0984-e8f3-4e6c-8be5-443e86cdb75e on hv-cinder-82418 Jan 11 15:47:22.038495 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [req-01b78a9a-2377-4430-b057-f2bb345371e2 req-92d41874-7cfb-4530-a330-40c35bb1ea23 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169328 Jan 11 15:47:22.038495 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1086/2424] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:47:22.551136 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3e8612b7-c438-4b6a-bb4b-0996c625ad98 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:22.551789 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3e8612b7-c438-4b6a-bb4b-0996c625ad98 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:22.558043 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3e8612b7-c438-4b6a-bb4b-0996c625ad98 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:22.558501 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3e8612b7-c438-4b6a-bb4b-0996c625ad98 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:22.559307 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3e8612b7-c438-4b6a-bb4b-0996c625ad98 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:22.559827 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3e8612b7-c438-4b6a-bb4b-0996c625ad98 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:22.715391 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3e8612b7-c438-4b6a-bb4b-0996c625ad98 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:22.723481 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3e8612b7-c438-4b6a-bb4b-0996c625ad98 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1358 microversion: 2.1 time: 0.176520 Jan 11 15:47:22.724061 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1339/2425] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:22 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:47:23.741606 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-3ed9450c-0b28-4756-9f72-0b81af0e45d2 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:23.742303 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-3ed9450c-0b28-4756-9f72-0b81af0e45d2 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:23.748414 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3ed9450c-0b28-4756-9f72-0b81af0e45d2 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:23.748866 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3ed9450c-0b28-4756-9f72-0b81af0e45d2 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:23.749632 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3ed9450c-0b28-4756-9f72-0b81af0e45d2 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:23.750070 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-3ed9450c-0b28-4756-9f72-0b81af0e45d2 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:23.875990 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-3ed9450c-0b28-4756-9f72-0b81af0e45d2 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:23.885094 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-3ed9450c-0b28-4756-9f72-0b81af0e45d2 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1358 microversion: 2.1 time: 0.147614 Jan 11 15:47:23.885843 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1087/2426] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:23 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:47:24.906531 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ea6d4d40-64f3-4692-a584-f5e4f84ade69 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:24.907099 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ea6d4d40-64f3-4692-a584-f5e4f84ade69 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:24.912820 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ea6d4d40-64f3-4692-a584-f5e4f84ade69 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:24.913272 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ea6d4d40-64f3-4692-a584-f5e4f84ade69 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:24.914044 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ea6d4d40-64f3-4692-a584-f5e4f84ade69 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:24.914487 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ea6d4d40-64f3-4692-a584-f5e4f84ade69 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:25.039220 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ea6d4d40-64f3-4692-a584-f5e4f84ade69 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:25.047085 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ea6d4d40-64f3-4692-a584-f5e4f84ade69 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1358 microversion: 2.1 time: 0.144205 Jan 11 15:47:25.048216 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1340/2427] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:24 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:47:26.063175 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-5188c98b-165f-42a3-9ed7-0914aeabd0c9 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:26.063936 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-5188c98b-165f-42a3-9ed7-0914aeabd0c9 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:26.071144 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5188c98b-165f-42a3-9ed7-0914aeabd0c9 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:26.071676 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5188c98b-165f-42a3-9ed7-0914aeabd0c9 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:26.072453 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5188c98b-165f-42a3-9ed7-0914aeabd0c9 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:26.073028 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-5188c98b-165f-42a3-9ed7-0914aeabd0c9 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:26.200903 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-5188c98b-165f-42a3-9ed7-0914aeabd0c9 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:26.208022 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-5188c98b-165f-42a3-9ed7-0914aeabd0c9 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1358 microversion: 2.1 time: 0.148505 Jan 11 15:47:26.208575 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1088/2428] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:26 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:47:27.224622 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-f476e0f9-4ea6-4d3e-adb1-bcb1f0de8c02 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:27.225233 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-f476e0f9-4ea6-4d3e-adb1-bcb1f0de8c02 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:27.231552 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f476e0f9-4ea6-4d3e-adb1-bcb1f0de8c02 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:27.231998 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f476e0f9-4ea6-4d3e-adb1-bcb1f0de8c02 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:27.232769 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f476e0f9-4ea6-4d3e-adb1-bcb1f0de8c02 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:27.233203 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-f476e0f9-4ea6-4d3e-adb1-bcb1f0de8c02 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:27.361517 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-f476e0f9-4ea6-4d3e-adb1-bcb1f0de8c02 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:27.369073 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-f476e0f9-4ea6-4d3e-adb1-bcb1f0de8c02 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1358 microversion: 2.1 time: 0.148038 Jan 11 15:47:27.369649 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1341/2429] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:27 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 15:47:28.385360 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-8f014725-6300-4fc8-a44f-38d93477be71 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:28.385971 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-8f014725-6300-4fc8-a44f-38d93477be71 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:28.392150 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8f014725-6300-4fc8-a44f-38d93477be71 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:28.392592 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8f014725-6300-4fc8-a44f-38d93477be71 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:28.393351 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8f014725-6300-4fc8-a44f-38d93477be71 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:28.393783 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8f014725-6300-4fc8-a44f-38d93477be71 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:28.518698 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-8f014725-6300-4fc8-a44f-38d93477be71 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:28.526039 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-8f014725-6300-4fc8-a44f-38d93477be71 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1358 microversion: 2.1 time: 0.144339 Jan 11 15:47:28.526597 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1089/2430] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:28 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1358 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:47:29.542034 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-3d8d6aea-658f-4fe0-b5a6-c026d14e7864 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:29.542635 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-3d8d6aea-658f-4fe0-b5a6-c026d14e7864 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:29.549516 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3d8d6aea-658f-4fe0-b5a6-c026d14e7864 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:29.549969 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3d8d6aea-658f-4fe0-b5a6-c026d14e7864 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:29.550749 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3d8d6aea-658f-4fe0-b5a6-c026d14e7864 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:29.551197 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-3d8d6aea-658f-4fe0-b5a6-c026d14e7864 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:29.677698 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-3d8d6aea-658f-4fe0-b5a6-c026d14e7864 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:29.684937 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-3d8d6aea-658f-4fe0-b5a6-c026d14e7864 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1358 microversion: 2.1 time: 0.146628 Jan 11 15:47:29.685509 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1342/2431] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:29 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:47:30.702032 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-8dab21ed-0c75-43ca-abbf-7b5e9a8d30d9 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:30.702904 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-8dab21ed-0c75-43ca-abbf-7b5e9a8d30d9 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:30.709802 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8dab21ed-0c75-43ca-abbf-7b5e9a8d30d9 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:30.710249 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8dab21ed-0c75-43ca-abbf-7b5e9a8d30d9 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:30.711011 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8dab21ed-0c75-43ca-abbf-7b5e9a8d30d9 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:30.711470 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8dab21ed-0c75-43ca-abbf-7b5e9a8d30d9 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:30.838680 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-8dab21ed-0c75-43ca-abbf-7b5e9a8d30d9 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:30.845846 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-8dab21ed-0c75-43ca-abbf-7b5e9a8d30d9 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1358 microversion: 2.1 time: 0.147428 Jan 11 15:47:30.846401 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1090/2432] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:30 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:47:31.861602 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-abb55cd0-1871-4146-b467-a88e2b5c01bd tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:31.862209 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-abb55cd0-1871-4146-b467-a88e2b5c01bd tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:31.868493 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-abb55cd0-1871-4146-b467-a88e2b5c01bd tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:31.868943 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-abb55cd0-1871-4146-b467-a88e2b5c01bd tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:31.869712 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-abb55cd0-1871-4146-b467-a88e2b5c01bd tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:31.870150 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-abb55cd0-1871-4146-b467-a88e2b5c01bd tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:31.998252 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-abb55cd0-1871-4146-b467-a88e2b5c01bd tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:32.005947 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-abb55cd0-1871-4146-b467-a88e2b5c01bd tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1358 microversion: 2.1 time: 0.147987 Jan 11 15:47:32.006544 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1343/2433] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:31 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:47:32.270754 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [req-0c352daa-40a2-4018-98da-6f7192f42872 req-6d488cc7-045f-4b08-ad4a-9fe63567e85c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893d0984-e8f3-4e6c-8be5-443e86cdb75e", "name": "network-vif-plugged", "status": "completed", "tag": "09678a50-7da3-4be3-a4ed-004641fadef2"}]} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:47:32.272358 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:47:32.272358 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: warnings.warn(msg) Jan 11 15:47:32.278995 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-0c352daa-40a2-4018-98da-6f7192f42872 req-6d488cc7-045f-4b08-ad4a-9fe63567e85c service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:32.280547 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-0c352daa-40a2-4018-98da-6f7192f42872 req-6d488cc7-045f-4b08-ad4a-9fe63567e85c service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:32.290508 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.compute.server_external_events [req-0c352daa-40a2-4018-98da-6f7192f42872 req-6d488cc7-045f-4b08-ad4a-9fe63567e85c service nova] Creating event network-vif-plugged:09678a50-7da3-4be3-a4ed-004641fadef2 for instance 893d0984-e8f3-4e6c-8be5-443e86cdb75e on hv-cinder-82418 Jan 11 15:47:32.295567 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [req-0c352daa-40a2-4018-98da-6f7192f42872 req-6d488cc7-045f-4b08-ad4a-9fe63567e85c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084032 Jan 11 15:47:32.296161 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1091/2434] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:47:33.021767 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e77adaa8-4562-402f-b76d-73778fffe2e4 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:33.022420 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e77adaa8-4562-402f-b76d-73778fffe2e4 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:33.028953 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e77adaa8-4562-402f-b76d-73778fffe2e4 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:33.029414 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e77adaa8-4562-402f-b76d-73778fffe2e4 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:33.030199 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e77adaa8-4562-402f-b76d-73778fffe2e4 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:33.030643 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e77adaa8-4562-402f-b76d-73778fffe2e4 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:33.242109 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e77adaa8-4562-402f-b76d-73778fffe2e4 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:33.249321 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e77adaa8-4562-402f-b76d-73778fffe2e4 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1358 microversion: 2.1 time: 0.231401 Jan 11 15:47:33.249886 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1344/2435] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:33 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1358 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:47:34.266175 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-25f76a12-c769-4fbb-97c5-febd55b697e6 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:34.267528 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-25f76a12-c769-4fbb-97c5-febd55b697e6 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:34.273718 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-25f76a12-c769-4fbb-97c5-febd55b697e6 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:34.274172 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-25f76a12-c769-4fbb-97c5-febd55b697e6 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:34.274940 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-25f76a12-c769-4fbb-97c5-febd55b697e6 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:34.275412 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-25f76a12-c769-4fbb-97c5-febd55b697e6 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:34.402916 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-25f76a12-c769-4fbb-97c5-febd55b697e6 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:34.410730 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-25f76a12-c769-4fbb-97c5-febd55b697e6 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1358 microversion: 2.1 time: 0.148952 Jan 11 15:47:34.420205 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1092/2436] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:34 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:47:35.427636 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e7a2c812-5202-49b7-9093-ee7ce6fa5545 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:35.428244 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e7a2c812-5202-49b7-9093-ee7ce6fa5545 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:35.434400 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e7a2c812-5202-49b7-9093-ee7ce6fa5545 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:35.434834 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e7a2c812-5202-49b7-9093-ee7ce6fa5545 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:35.435647 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e7a2c812-5202-49b7-9093-ee7ce6fa5545 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:35.436086 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e7a2c812-5202-49b7-9093-ee7ce6fa5545 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:35.567596 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e7a2c812-5202-49b7-9093-ee7ce6fa5545 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:35.574824 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e7a2c812-5202-49b7-9093-ee7ce6fa5545 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1547 microversion: 2.1 time: 0.151005 Jan 11 15:47:35.575417 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1345/2437] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:35 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:47:35.591178 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-733543cc-134f-4b65-bc28-4352be56aff7 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:35.591946 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-733543cc-134f-4b65-bc28-4352be56aff7 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:35.598910 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-733543cc-134f-4b65-bc28-4352be56aff7 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:35.599318 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-733543cc-134f-4b65-bc28-4352be56aff7 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:35.600146 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-733543cc-134f-4b65-bc28-4352be56aff7 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:35.600581 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-733543cc-134f-4b65-bc28-4352be56aff7 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:35.730837 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-733543cc-134f-4b65-bc28-4352be56aff7 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:35.738193 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-733543cc-134f-4b65-bc28-4352be56aff7 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1547 microversion: 2.1 time: 0.150651 Jan 11 15:47:35.739043 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1093/2438] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:35 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:47:35.754162 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-858a6864-8fdb-454d-8f22-8d0557666256 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:35.757586 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:47:35.757586 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:47:35.761285 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-858a6864-8fdb-454d-8f22-8d0557666256 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:35.761285 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-858a6864-8fdb-454d-8f22-8d0557666256 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Searching by: {'deleted': False, 'project_id': '06276674abbb4c1f8a9437722791905e'} {{(pid=116902) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 11 15:47:35.765742 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-858a6864-8fdb-454d-8f22-8d0557666256 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:35.766189 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-858a6864-8fdb-454d-8f22-8d0557666256 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:35.767572 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-858a6864-8fdb-454d-8f22-8d0557666256 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:35.768010 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-858a6864-8fdb-454d-8f22-8d0557666256 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:35.864670 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.multi_cell_list [None req-858a6864-8fdb-454d-8f22-8d0557666256 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116902) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 11 15:47:35.959698 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-858a6864-8fdb-454d-8f22-8d0557666256 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.209550 Jan 11 15:47:35.960295 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1346/2439] 10.222.0.52 () {58 vars in 1124 bytes} [Tue Jan 11 15:47:35 2022] GET /compute/v2.1/servers => generated 342 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:47:35.971833 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-2d3d5ed7-6db3-498c-a207-6d5c9f16d9f3 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:35.972442 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-2d3d5ed7-6db3-498c-a207-6d5c9f16d9f3 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:35.978163 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2d3d5ed7-6db3-498c-a207-6d5c9f16d9f3 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:35.978595 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2d3d5ed7-6db3-498c-a207-6d5c9f16d9f3 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:35.979394 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2d3d5ed7-6db3-498c-a207-6d5c9f16d9f3 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:35.979829 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-2d3d5ed7-6db3-498c-a207-6d5c9f16d9f3 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:36.106249 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-2d3d5ed7-6db3-498c-a207-6d5c9f16d9f3 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:36.113663 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-2d3d5ed7-6db3-498c-a207-6d5c9f16d9f3 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1547 microversion: 2.1 time: 0.147115 Jan 11 15:47:36.114226 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1094/2440] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:35 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1547 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:47:37.919679 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-5f2a5000-7fd5-4b8b-8d13-9dde0e8207e8 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "abad6401-a855-4430-9c1d-bbcdfc5ce69d"}} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:47:37.920731 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-5f2a5000-7fd5-4b8b-8d13-9dde0e8207e8 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:37.927417 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5f2a5000-7fd5-4b8b-8d13-9dde0e8207e8 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:37.928126 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5f2a5000-7fd5-4b8b-8d13-9dde0e8207e8 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:37.928634 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5f2a5000-7fd5-4b8b-8d13-9dde0e8207e8 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:37.929077 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-5f2a5000-7fd5-4b8b-8d13-9dde0e8207e8 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:41.089151 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-5f2a5000-7fd5-4b8b-8d13-9dde0e8207e8 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "POST /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.173048 Jan 11 15:47:41.089850 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1347/2441] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jan 11 15:47:37 2022] POST /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e/os-volume_attachments => generated 194 bytes in 3175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:47:45.350706 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:47:45.351388 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: Tue Jan 11 15:47:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:47:50.876962 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-fb663cd5-2147-4a59-b942-bd81a92863fe tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:50.878172 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-fb663cd5-2147-4a59-b942-bd81a92863fe tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:50.884612 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fb663cd5-2147-4a59-b942-bd81a92863fe tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:50.889689 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fb663cd5-2147-4a59-b942-bd81a92863fe tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:50.889689 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fb663cd5-2147-4a59-b942-bd81a92863fe tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:50.889689 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-fb663cd5-2147-4a59-b942-bd81a92863fe tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:51.016626 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-fb663cd5-2147-4a59-b942-bd81a92863fe tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:51.025007 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-fb663cd5-2147-4a59-b942-bd81a92863fe tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1593 microversion: 2.1 time: 0.151859 Jan 11 15:47:51.025566 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1095/2442] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:50 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1593 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:47:53.467984 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-723693cd-4c24-47a9-bf04-9e15a5e4e124 req-1c413f15-42a4-4934-9eac-d77df92f8a2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "893d0984-e8f3-4e6c-8be5-443e86cdb75e", "tag": "09678a50-7da3-4be3-a4ed-004641fadef2"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:47:53.479429 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:47:53.479429 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:47:53.488609 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-723693cd-4c24-47a9-bf04-9e15a5e4e124 req-1c413f15-42a4-4934-9eac-d77df92f8a2f service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:53.489332 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-723693cd-4c24-47a9-bf04-9e15a5e4e124 req-1c413f15-42a4-4934-9eac-d77df92f8a2f service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:53.500515 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-723693cd-4c24-47a9-bf04-9e15a5e4e124 req-1c413f15-42a4-4934-9eac-d77df92f8a2f service nova] Creating event network-changed:09678a50-7da3-4be3-a4ed-004641fadef2 for instance 893d0984-e8f3-4e6c-8be5-443e86cdb75e on hv-cinder-82418 Jan 11 15:47:53.506337 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [req-723693cd-4c24-47a9-bf04-9e15a5e4e124 req-1c413f15-42a4-4934-9eac-d77df92f8a2f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174172 Jan 11 15:47:53.507200 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1348/2443] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:47:55.727226 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a96d1dea-439f-474d-8144-5814ffce40b3 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-218016201"}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:47:55.735218 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a96d1dea-439f-474d-8144-5814ffce40b3 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:55.735218 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a96d1dea-439f-474d-8144-5814ffce40b3 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:55.735218 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a96d1dea-439f-474d-8144-5814ffce40b3 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:55.735972 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a96d1dea-439f-474d-8144-5814ffce40b3 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:55.736410 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a96d1dea-439f-474d-8144-5814ffce40b3 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:55.861884 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.network.security_group_api [None req-a96d1dea-439f-474d-8144-5814ffce40b3 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Adding security group abb33e9e-5d30-4c02-aaea-493c055fc1f6 to port 09678a50-7da3-4be3-a4ed-004641fadef2 Jan 11 15:47:56.287248 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a96d1dea-439f-474d-8144-5814ffce40b3 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "POST /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e/action" status: 202 len: 0 microversion: 2.1 time: 0.563789 Jan 11 15:47:56.287957 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1096/2444] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:47:55 2022] POST /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e/action => generated 0 bytes in 566 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:47:56.298971 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-8447ac77-eab7-4318-8552-1b7bf15cd928 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:47:56.300382 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-8447ac77-eab7-4318-8552-1b7bf15cd928 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:47:56.301659 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [req-b2eb74ec-45ee-44fe-817e-eec501f5333f req-0f5656f5-c905-4c0c-817d-9189a82e9a2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "893d0984-e8f3-4e6c-8be5-443e86cdb75e", "tag": "09678a50-7da3-4be3-a4ed-004641fadef2"}]} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:47:56.303275 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:47:56.303275 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: warnings.warn(msg) Jan 11 15:47:56.307772 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8447ac77-eab7-4318-8552-1b7bf15cd928 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:56.308620 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8447ac77-eab7-4318-8552-1b7bf15cd928 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:56.309500 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8447ac77-eab7-4318-8552-1b7bf15cd928 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:56.310005 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-8447ac77-eab7-4318-8552-1b7bf15cd928 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:56.316429 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-b2eb74ec-45ee-44fe-817e-eec501f5333f req-0f5656f5-c905-4c0c-817d-9189a82e9a2d service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:47:56.317882 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-b2eb74ec-45ee-44fe-817e-eec501f5333f req-0f5656f5-c905-4c0c-817d-9189a82e9a2d service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:47:56.330655 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.compute.server_external_events [req-b2eb74ec-45ee-44fe-817e-eec501f5333f req-0f5656f5-c905-4c0c-817d-9189a82e9a2d service nova] Creating event network-changed:09678a50-7da3-4be3-a4ed-004641fadef2 for instance 893d0984-e8f3-4e6c-8be5-443e86cdb75e on hv-cinder-82418 Jan 11 15:47:56.336850 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [req-b2eb74ec-45ee-44fe-817e-eec501f5333f req-0f5656f5-c905-4c0c-817d-9189a82e9a2d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038818 Jan 11 15:47:56.338120 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1097/2445] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:47:56.851100 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-8447ac77-eab7-4318-8552-1b7bf15cd928 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:47:56.859043 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-8447ac77-eab7-4318-8552-1b7bf15cd928 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1758 microversion: 2.1 time: 0.566607 Jan 11 15:47:56.859660 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1349/2446] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:47:56 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1758 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:49:07.887083 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84edaab3-8fd4-4fe8-afdc-3f0d3b8de5ac] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 11 15:49:07.890975 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-7bc60d43-3bf9-4924-80dc-d2d016aadfcd tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:49:07.892014 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-7bc60d43-3bf9-4924-80dc-d2d016aadfcd tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:49:07.898296 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7bc60d43-3bf9-4924-80dc-d2d016aadfcd tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:49:07.899367 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7bc60d43-3bf9-4924-80dc-d2d016aadfcd tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:49:07.900146 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7bc60d43-3bf9-4924-80dc-d2d016aadfcd tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:49:07.900588 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-7bc60d43-3bf9-4924-80dc-d2d016aadfcd tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:49:08.119419 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-7bc60d43-3bf9-4924-80dc-d2d016aadfcd tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "POST /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e/action" status: 202 len: 0 microversion: 2.1 time: 0.234064 Jan 11 15:49:08.120210 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1098/2447] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:49:07 2022] POST /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:49:08.128995 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-94b0a1ad-d23b-47f2-8ca7-16ec653d6aa5 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:49:08.129622 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-94b0a1ad-d23b-47f2-8ca7-16ec653d6aa5 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:49:08.136130 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-94b0a1ad-d23b-47f2-8ca7-16ec653d6aa5 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:49:08.136579 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-94b0a1ad-d23b-47f2-8ca7-16ec653d6aa5 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:49:08.137411 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-94b0a1ad-d23b-47f2-8ca7-16ec653d6aa5 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:49:08.137804 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-94b0a1ad-d23b-47f2-8ca7-16ec653d6aa5 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:49:08.318672 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-94b0a1ad-d23b-47f2-8ca7-16ec653d6aa5 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:49:08.327036 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-94b0a1ad-d23b-47f2-8ca7-16ec653d6aa5 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1750 microversion: 2.1 time: 0.202550 Jan 11 15:49:08.327636 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1350/2448] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:49:08 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1750 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:49:09.346429 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f65b8e1d-0172-4085-9d6c-bcb582f6c97a tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:49:09.347120 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f65b8e1d-0172-4085-9d6c-bcb582f6c97a tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:49:09.355380 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO oslo.messaging._drivers.impl_rabbit [-] [84edaab3-8fd4-4fe8-afdc-3f0d3b8de5ac] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 53328. Jan 11 15:49:09.357028 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f65b8e1d-0172-4085-9d6c-bcb582f6c97a tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:49:09.357480 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f65b8e1d-0172-4085-9d6c-bcb582f6c97a tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:49:09.358246 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f65b8e1d-0172-4085-9d6c-bcb582f6c97a tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:49:09.358684 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f65b8e1d-0172-4085-9d6c-bcb582f6c97a tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:49:09.501935 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-f65b8e1d-0172-4085-9d6c-bcb582f6c97a tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:49:09.510161 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f65b8e1d-0172-4085-9d6c-bcb582f6c97a tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1755 microversion: 2.1 time: 0.170381 Jan 11 15:49:09.510663 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1099/2449] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:49:09 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:49:10.528327 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-50f94932-db24-43e2-ab2f-147c9af3af08 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:49:10.528847 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-50f94932-db24-43e2-ab2f-147c9af3af08 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:49:10.535166 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-50f94932-db24-43e2-ab2f-147c9af3af08 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:49:10.535652 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-50f94932-db24-43e2-ab2f-147c9af3af08 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:49:10.536433 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-50f94932-db24-43e2-ab2f-147c9af3af08 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:49:10.536877 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-50f94932-db24-43e2-ab2f-147c9af3af08 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:49:10.675847 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-50f94932-db24-43e2-ab2f-147c9af3af08 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:49:10.683530 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-50f94932-db24-43e2-ab2f-147c9af3af08 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1755 microversion: 2.1 time: 0.158927 Jan 11 15:49:10.684097 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1351/2450] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:49:10 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:49:11.700415 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-4cda5286-5b0a-4579-9635-390bb6839b1d tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:49:11.701018 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-4cda5286-5b0a-4579-9635-390bb6839b1d tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:49:11.707227 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4cda5286-5b0a-4579-9635-390bb6839b1d tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:49:11.707704 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4cda5286-5b0a-4579-9635-390bb6839b1d tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:49:11.708499 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4cda5286-5b0a-4579-9635-390bb6839b1d tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:49:11.708932 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-4cda5286-5b0a-4579-9635-390bb6839b1d tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:49:11.849174 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-4cda5286-5b0a-4579-9635-390bb6839b1d tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:49:11.857304 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-4cda5286-5b0a-4579-9635-390bb6839b1d tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1755 microversion: 2.1 time: 0.160567 Jan 11 15:49:11.857846 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1100/2451] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:49:11 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:49:12.874975 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9ac1b26b-b67e-475c-8359-386bf4f7d461 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:49:12.875622 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9ac1b26b-b67e-475c-8359-386bf4f7d461 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:49:12.881838 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9ac1b26b-b67e-475c-8359-386bf4f7d461 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:49:12.882289 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9ac1b26b-b67e-475c-8359-386bf4f7d461 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:49:12.883062 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9ac1b26b-b67e-475c-8359-386bf4f7d461 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:49:12.883535 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9ac1b26b-b67e-475c-8359-386bf4f7d461 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:49:13.021097 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-9ac1b26b-b67e-475c-8359-386bf4f7d461 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:49:13.029254 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9ac1b26b-b67e-475c-8359-386bf4f7d461 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1755 microversion: 2.1 time: 0.157864 Jan 11 15:49:13.029828 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1352/2452] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:49:12 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1755 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:49:14.045247 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-6cee591f-e895-44b0-b232-b5b07097ad61 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:49:14.045835 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-6cee591f-e895-44b0-b232-b5b07097ad61 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:49:14.052000 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6cee591f-e895-44b0-b232-b5b07097ad61 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:49:14.052447 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6cee591f-e895-44b0-b232-b5b07097ad61 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:49:14.053210 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6cee591f-e895-44b0-b232-b5b07097ad61 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:49:14.053643 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-6cee591f-e895-44b0-b232-b5b07097ad61 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:49:14.190299 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-6cee591f-e895-44b0-b232-b5b07097ad61 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:49:14.198487 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-6cee591f-e895-44b0-b232-b5b07097ad61 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1755 microversion: 2.1 time: 0.156854 Jan 11 15:49:14.199044 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1101/2453] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:49:14 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1755 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:49:15.215808 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-410968c6-8ffb-46c6-9638-cb1f13c6e7dc tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:49:15.216375 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-410968c6-8ffb-46c6-9638-cb1f13c6e7dc tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:49:15.222640 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-410968c6-8ffb-46c6-9638-cb1f13c6e7dc tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:49:15.223100 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-410968c6-8ffb-46c6-9638-cb1f13c6e7dc tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:49:15.223917 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-410968c6-8ffb-46c6-9638-cb1f13c6e7dc tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:49:15.224363 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-410968c6-8ffb-46c6-9638-cb1f13c6e7dc tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:49:15.367260 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-410968c6-8ffb-46c6-9638-cb1f13c6e7dc tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:49:15.375165 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-410968c6-8ffb-46c6-9638-cb1f13c6e7dc tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1755 microversion: 2.1 time: 0.163704 Jan 11 15:49:15.375793 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1353/2454] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:49:15 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:49:16.391651 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-a63936cc-8a0a-4bf6-9df8-da860a25ce8c tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:49:16.392247 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-a63936cc-8a0a-4bf6-9df8-da860a25ce8c tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:49:16.398751 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a63936cc-8a0a-4bf6-9df8-da860a25ce8c tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:49:16.399200 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a63936cc-8a0a-4bf6-9df8-da860a25ce8c tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:49:16.400004 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a63936cc-8a0a-4bf6-9df8-da860a25ce8c tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:49:16.400444 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-a63936cc-8a0a-4bf6-9df8-da860a25ce8c tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:49:16.537260 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-a63936cc-8a0a-4bf6-9df8-da860a25ce8c tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:49:16.545534 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-a63936cc-8a0a-4bf6-9df8-da860a25ce8c tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1755 microversion: 2.1 time: 0.157513 Jan 11 15:49:16.546085 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1102/2455] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:49:16 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1755 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:49:17.562628 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-99ba7df3-98ba-4e5f-a0a5-6a12745bd0b7 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:49:17.563239 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-99ba7df3-98ba-4e5f-a0a5-6a12745bd0b7 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:49:17.569512 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-99ba7df3-98ba-4e5f-a0a5-6a12745bd0b7 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:49:17.569959 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-99ba7df3-98ba-4e5f-a0a5-6a12745bd0b7 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:49:17.570727 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-99ba7df3-98ba-4e5f-a0a5-6a12745bd0b7 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:49:17.571160 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-99ba7df3-98ba-4e5f-a0a5-6a12745bd0b7 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:49:17.713097 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-99ba7df3-98ba-4e5f-a0a5-6a12745bd0b7 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:49:17.724007 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-99ba7df3-98ba-4e5f-a0a5-6a12745bd0b7 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1755 microversion: 2.1 time: 0.164618 Jan 11 15:49:17.725053 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1354/2456] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:49:17 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:49:18.741599 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-70ca6ee2-251e-43ac-9011-98de4d3a2ae0 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:49:18.742245 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-70ca6ee2-251e-43ac-9011-98de4d3a2ae0 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:49:18.748965 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-70ca6ee2-251e-43ac-9011-98de4d3a2ae0 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:49:18.749415 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-70ca6ee2-251e-43ac-9011-98de4d3a2ae0 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:49:18.750184 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-70ca6ee2-251e-43ac-9011-98de4d3a2ae0 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:49:18.750621 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-70ca6ee2-251e-43ac-9011-98de4d3a2ae0 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:49:18.887351 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-70ca6ee2-251e-43ac-9011-98de4d3a2ae0 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:49:18.895300 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-70ca6ee2-251e-43ac-9011-98de4d3a2ae0 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1755 microversion: 2.1 time: 0.157391 Jan 11 15:49:18.895881 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1103/2457] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:49:18 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1755 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:49:19.912030 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ba6f9374-1959-43c5-a1f0-c7a2184ff267 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:49:19.912714 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-ba6f9374-1959-43c5-a1f0-c7a2184ff267 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:49:19.918948 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ba6f9374-1959-43c5-a1f0-c7a2184ff267 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:49:19.919589 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ba6f9374-1959-43c5-a1f0-c7a2184ff267 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:49:19.920365 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ba6f9374-1959-43c5-a1f0-c7a2184ff267 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:49:19.920797 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-ba6f9374-1959-43c5-a1f0-c7a2184ff267 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:49:20.061497 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-ba6f9374-1959-43c5-a1f0-c7a2184ff267 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:49:20.069216 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ba6f9374-1959-43c5-a1f0-c7a2184ff267 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1758 microversion: 2.1 time: 0.160787 Jan 11 15:49:20.069786 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1355/2458] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:49:19 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:49:25.254948 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:49:25.255677 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: Tue Jan 11 15:49:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:49:27.051154 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:49:27.051959 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: Tue Jan 11 15:49:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:50:16.648700 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-f72235a5-59a7-486d-9932-f96e138e6978 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-218016201"}} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:50:16.649304 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-f72235a5-59a7-486d-9932-f96e138e6978 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:50:16.655559 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f72235a5-59a7-486d-9932-f96e138e6978 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:50:16.656012 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f72235a5-59a7-486d-9932-f96e138e6978 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:50:16.656809 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f72235a5-59a7-486d-9932-f96e138e6978 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:50:16.657248 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-f72235a5-59a7-486d-9932-f96e138e6978 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:50:16.780918 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.network.security_group_api [None req-f72235a5-59a7-486d-9932-f96e138e6978 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Removing security group abb33e9e-5d30-4c02-aaea-493c055fc1f6 from port 09678a50-7da3-4be3-a4ed-004641fadef2 Jan 11 15:50:17.161200 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-f72235a5-59a7-486d-9932-f96e138e6978 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "POST /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e/action" status: 202 len: 0 microversion: 2.1 time: 0.516599 Jan 11 15:50:17.167811 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1104/2459] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jan 11 15:50:16 2022] POST /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e/action => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:50:17.168765 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [req-954ee723-3b23-44e0-9ff6-d9051fdefca3 req-b138e49e-872b-46ae-966a-23998654fe27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "893d0984-e8f3-4e6c-8be5-443e86cdb75e", "tag": "09678a50-7da3-4be3-a4ed-004641fadef2"}]} {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:50:17.171635 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:50:17.171635 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: warnings.warn(msg) Jan 11 15:50:17.181521 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-954ee723-3b23-44e0-9ff6-d9051fdefca3 req-b138e49e-872b-46ae-966a-23998654fe27 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:50:17.181851 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [req-954ee723-3b23-44e0-9ff6-d9051fdefca3 req-b138e49e-872b-46ae-966a-23998654fe27 service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:50:17.199243 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.compute.server_external_events [req-954ee723-3b23-44e0-9ff6-d9051fdefca3 req-b138e49e-872b-46ae-966a-23998654fe27 service nova] Creating event network-changed:09678a50-7da3-4be3-a4ed-004641fadef2 for instance 893d0984-e8f3-4e6c-8be5-443e86cdb75e on hv-cinder-82418 Jan 11 15:50:17.207190 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [req-954ee723-3b23-44e0-9ff6-d9051fdefca3 req-b138e49e-872b-46ae-966a-23998654fe27 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043459 Jan 11 15:50:17.208406 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1356/2460] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:50:18.873202 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-8a286e92-a6ea-4248-85bd-a364dd3c6194 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:50:18.873766 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-8a286e92-a6ea-4248-85bd-a364dd3c6194 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:50:18.879591 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8a286e92-a6ea-4248-85bd-a364dd3c6194 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:50:18.880042 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8a286e92-a6ea-4248-85bd-a364dd3c6194 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:50:18.880805 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8a286e92-a6ea-4248-85bd-a364dd3c6194 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:50:18.881237 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-8a286e92-a6ea-4248-85bd-a364dd3c6194 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:50:18.956667 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.objects.instance [None req-8a286e92-a6ea-4248-85bd-a364dd3c6194 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lazy-loading 'services' on Instance uuid 893d0984-e8f3-4e6c-8be5-443e86cdb75e {{(pid=116903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 15:50:19.161955 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-8a286e92-a6ea-4248-85bd-a364dd3c6194 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "DELETE /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e/os-volume_attachments/abad6401-a855-4430-9c1d-bbcdfc5ce69d" status: 202 len: 0 microversion: 2.1 time: 0.293455 Jan 11 15:50:19.162592 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1105/2461] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jan 11 15:50:18 2022] DELETE /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e/os-volume_attachments/abad6401-a855-4430-9c1d-bbcdfc5ce69d => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:50:19.172498 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-9479675b-9430-4231-a7c3-74a27dbb9dea tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:50:19.175540 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-9479675b-9430-4231-a7c3-74a27dbb9dea tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:50:19.179879 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9479675b-9430-4231-a7c3-74a27dbb9dea tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:50:19.180333 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9479675b-9430-4231-a7c3-74a27dbb9dea tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:50:19.181114 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9479675b-9430-4231-a7c3-74a27dbb9dea tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:50:19.181672 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-9479675b-9430-4231-a7c3-74a27dbb9dea tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:50:19.211378 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-9479675b-9430-4231-a7c3-74a27dbb9dea tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044069 Jan 11 15:50:19.211947 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1357/2462] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:50:19 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:50:19.224758 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [req-afd74b88-eac2-4768-b587-e5ace83395f4 req-55b562e3-d075-4cfe-be99-0f1859947cac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "893d0984-e8f3-4e6c-8be5-443e86cdb75e", "tag": "09678a50-7da3-4be3-a4ed-004641fadef2"}]} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:50:19.226388 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:50:19.226388 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: warnings.warn(msg) Jan 11 15:50:19.234432 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-afd74b88-eac2-4768-b587-e5ace83395f4 req-55b562e3-d075-4cfe-be99-0f1859947cac service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:50:19.234893 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-afd74b88-eac2-4768-b587-e5ace83395f4 req-55b562e3-d075-4cfe-be99-0f1859947cac service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:50:19.246265 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.compute.server_external_events [req-afd74b88-eac2-4768-b587-e5ace83395f4 req-55b562e3-d075-4cfe-be99-0f1859947cac service nova] Creating event network-changed:09678a50-7da3-4be3-a4ed-004641fadef2 for instance 893d0984-e8f3-4e6c-8be5-443e86cdb75e on hv-cinder-82418 Jan 11 15:50:19.251993 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [req-afd74b88-eac2-4768-b587-e5ace83395f4 req-55b562e3-d075-4cfe-be99-0f1859947cac service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031230 Jan 11 15:50:19.252937 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1106/2463] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:50:20.221925 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-d8318a5a-0ab0-4063-9207-5877b044c975 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:50:20.222829 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-d8318a5a-0ab0-4063-9207-5877b044c975 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:50:20.229149 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d8318a5a-0ab0-4063-9207-5877b044c975 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:50:20.229640 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d8318a5a-0ab0-4063-9207-5877b044c975 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:50:20.230422 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d8318a5a-0ab0-4063-9207-5877b044c975 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:50:20.230883 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-d8318a5a-0ab0-4063-9207-5877b044c975 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:50:20.259586 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-d8318a5a-0ab0-4063-9207-5877b044c975 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041437 Jan 11 15:50:20.260154 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1358/2464] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:50:20 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 15:50:21.271592 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-bc336691-70ed-4df8-b695-c42ce2c124a5 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:50:21.272590 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-bc336691-70ed-4df8-b695-c42ce2c124a5 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:50:21.278682 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bc336691-70ed-4df8-b695-c42ce2c124a5 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:50:21.279820 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bc336691-70ed-4df8-b695-c42ce2c124a5 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:50:21.285744 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bc336691-70ed-4df8-b695-c42ce2c124a5 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:50:21.285744 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-bc336691-70ed-4df8-b695-c42ce2c124a5 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:50:21.308224 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-bc336691-70ed-4df8-b695-c42ce2c124a5 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041402 Jan 11 15:50:21.309169 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1107/2465] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jan 11 15:50:21 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 15:50:21.318577 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-fa184042-51ef-4324-844c-466b02ba237f tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:50:21.319136 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-fa184042-51ef-4324-844c-466b02ba237f tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:50:21.325389 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fa184042-51ef-4324-844c-466b02ba237f tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:50:21.326423 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fa184042-51ef-4324-844c-466b02ba237f tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:50:21.327158 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fa184042-51ef-4324-844c-466b02ba237f tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:50:21.327635 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-fa184042-51ef-4324-844c-466b02ba237f tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:50:21.398120 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.wsgi [None req-fa184042-51ef-4324-844c-466b02ba237f tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] HTTP exception thrown: Instance 893d0984-e8f3-4e6c-8be5-443e86cdb75e is not attached to volume abad6401-a855-4430-9c1d-bbcdfc5ce69d Jan 11 15:50:21.398806 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-fa184042-51ef-4324-844c-466b02ba237f tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Returning 404 to user: Instance 893d0984-e8f3-4e6c-8be5-443e86cdb75e is not attached to volume abad6401-a855-4430-9c1d-bbcdfc5ce69d {{(pid=116902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:50:21.399674 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-fa184042-51ef-4324-844c-466b02ba237f tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "DELETE /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e/os-volume_attachments/abad6401-a855-4430-9c1d-bbcdfc5ce69d" status: 404 len: 154 microversion: 2.1 time: 0.084865 Jan 11 15:50:21.400250 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1359/2466] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jan 11 15:50:21 2022] DELETE /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e/os-volume_attachments/abad6401-a855-4430-9c1d-bbcdfc5ce69d => generated 154 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 15:50:22.598802 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-257e497b-9353-4a40-95cc-4de458bc5cdb tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:50:22.599330 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-257e497b-9353-4a40-95cc-4de458bc5cdb tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:50:22.605464 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-257e497b-9353-4a40-95cc-4de458bc5cdb tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:50:22.605923 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-257e497b-9353-4a40-95cc-4de458bc5cdb tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:50:22.606690 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-257e497b-9353-4a40-95cc-4de458bc5cdb tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:50:22.607131 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-257e497b-9353-4a40-95cc-4de458bc5cdb tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:50:22.630491 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-257e497b-9353-4a40-95cc-4de458bc5cdb tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Going to try to terminate instance {{(pid=116903) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 15:50:22.892325 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-257e497b-9353-4a40-95cc-4de458bc5cdb tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "DELETE /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 204 len: 0 microversion: 2.1 time: 0.296700 Jan 11 15:50:22.892853 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1108/2467] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jan 11 15:50:22 2022] DELETE /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 15:50:22.900914 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-e5fb6ee2-83b6-4996-9d3c-9694784e3627 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:50:22.901562 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-e5fb6ee2-83b6-4996-9d3c-9694784e3627 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:50:22.908395 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e5fb6ee2-83b6-4996-9d3c-9694784e3627 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:50:22.908868 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e5fb6ee2-83b6-4996-9d3c-9694784e3627 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:50:22.909630 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e5fb6ee2-83b6-4996-9d3c-9694784e3627 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:50:22.910067 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-e5fb6ee2-83b6-4996-9d3c-9694784e3627 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:50:23.036773 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-e5fb6ee2-83b6-4996-9d3c-9694784e3627 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:50:23.043992 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-e5fb6ee2-83b6-4996-9d3c-9694784e3627 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1553 microversion: 2.1 time: 0.146648 Jan 11 15:50:23.044557 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1360/2468] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:50:22 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1553 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:50:24.060822 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-38f358eb-ecce-4e91-8b3b-7aea18bb07c3 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:50:24.061517 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-38f358eb-ecce-4e91-8b3b-7aea18bb07c3 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:50:24.067784 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-38f358eb-ecce-4e91-8b3b-7aea18bb07c3 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:50:24.068227 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-38f358eb-ecce-4e91-8b3b-7aea18bb07c3 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:50:24.068987 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-38f358eb-ecce-4e91-8b3b-7aea18bb07c3 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:50:24.069420 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-38f358eb-ecce-4e91-8b3b-7aea18bb07c3 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:50:24.201767 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.policy [None req-38f358eb-ecce-4e91-8b3b-7aea18bb07c3 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116903) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:50:24.209563 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-38f358eb-ecce-4e91-8b3b-7aea18bb07c3 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1553 microversion: 2.1 time: 0.152734 Jan 11 15:50:24.210126 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1109/2469] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:50:24 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:50:25.226662 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-dce3c92f-3b44-40ff-b33c-f9ba3b563691 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:50:25.227251 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.compute.api [None req-dce3c92f-3b44-40ff-b33c-f9ba3b563691 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116902) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:50:25.233255 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dce3c92f-3b44-40ff-b33c-f9ba3b563691 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:50:25.233875 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dce3c92f-3b44-40ff-b33c-f9ba3b563691 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:50:25.234509 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dce3c92f-3b44-40ff-b33c-f9ba3b563691 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:50:25.234960 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG oslo_concurrency.lockutils [None req-dce3c92f-3b44-40ff-b33c-f9ba3b563691 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:50:25.414377 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [req-6799ae72-af61-4716-8660-a3398e937aa7 req-88a7e047-b8a8-4261-a4b5-9279741fa91e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893d0984-e8f3-4e6c-8be5-443e86cdb75e", "name": "network-vif-deleted", "tag": "09678a50-7da3-4be3-a4ed-004641fadef2"}]} {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 15:50:25.415952 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 15:50:25.415952 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: warnings.warn(msg) Jan 11 15:50:25.423457 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-6799ae72-af61-4716-8660-a3398e937aa7 req-88a7e047-b8a8-4261-a4b5-9279741fa91e service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:50:25.427077 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [req-6799ae72-af61-4716-8660-a3398e937aa7 req-88a7e047-b8a8-4261-a4b5-9279741fa91e service nova] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:50:25.435650 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.compute.server_external_events [req-6799ae72-af61-4716-8660-a3398e937aa7 req-88a7e047-b8a8-4261-a4b5-9279741fa91e service nova] Creating event network-vif-deleted:09678a50-7da3-4be3-a4ed-004641fadef2 for instance 893d0984-e8f3-4e6c-8be5-443e86cdb75e on hv-cinder-82418 Jan 11 15:50:25.439217 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.policy [None req-dce3c92f-3b44-40ff-b33c-f9ba3b563691 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22875c58647e4bd089f89cd66dd473e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06276674abbb4c1f8a9437722791905e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116902) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 15:50:25.441335 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [req-6799ae72-af61-4716-8660-a3398e937aa7 req-88a7e047-b8a8-4261-a4b5-9279741fa91e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030628 Jan 11 15:50:25.442002 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1110/2470] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jan 11 15:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 15:50:25.446959 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-dce3c92f-3b44-40ff-b33c-f9ba3b563691 tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 200 len: 1553 microversion: 2.1 time: 0.224257 Jan 11 15:50:25.447700 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1361/2471] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:50:25 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 1553 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 15:50:26.465592 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-933d6d7f-5ecd-47fc-8285-24b6814a5e7c tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:50:26.466290 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.compute.api [None req-933d6d7f-5ecd-47fc-8285-24b6814a5e7c tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] [instance: 893d0984-e8f3-4e6c-8be5-443e86cdb75e] Fetching instance by UUID {{(pid=116903) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 15:50:26.472427 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-933d6d7f-5ecd-47fc-8285-24b6814a5e7c tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:50:26.472885 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-933d6d7f-5ecd-47fc-8285-24b6814a5e7c tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:50:26.473656 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-933d6d7f-5ecd-47fc-8285-24b6814a5e7c tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 15:50:26.474099 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG oslo_concurrency.lockutils [None req-933d6d7f-5ecd-47fc-8285-24b6814a5e7c tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Lock "46615978-60dd-434d-8e14-87d57df7a39e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 15:50:26.487181 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.wsgi [None req-933d6d7f-5ecd-47fc-8285-24b6814a5e7c tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] HTTP exception thrown: Instance 893d0984-e8f3-4e6c-8be5-443e86cdb75e could not be found. Jan 11 15:50:26.487780 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-933d6d7f-5ecd-47fc-8285-24b6814a5e7c tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Returning 404 to user: Instance 893d0984-e8f3-4e6c-8be5-443e86cdb75e could not be found. {{(pid=116903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 15:50:26.488587 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-933d6d7f-5ecd-47fc-8285-24b6814a5e7c tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e" status: 404 len: 111 microversion: 2.1 time: 0.027501 Jan 11 15:50:26.489102 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1111/2472] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jan 11 15:50:26 2022] GET /compute/v2.1/servers/893d0984-e8f3-4e6c-8be5-443e86cdb75e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 15:50:26.497032 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: DEBUG nova.api.openstack.wsgi [None req-ab3ebb93-be5c-42c4-beb7-006d2bcc39fc tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] Calling method '.version_select at 0x7f16be9bd670>' {{(pid=116902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:50:26.596411 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO nova.api.openstack.requestlog [None req-ab3ebb93-be5c-42c4-beb7-006d2bcc39fc tempest-TestMinimumBasicScenario-180642193 tempest-TestMinimumBasicScenario-180642193-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1112735517" status: 202 len: 0 microversion: 2.1 time: 0.102813 Jan 11 15:50:26.596900 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: [pid: 116902|app: 0|req: 1362/2473] 10.222.0.52 () {58 vars in 1271 bytes} [Tue Jan 11 15:50:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1112735517 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:51:05.359260 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:51:05.359797 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: Tue Jan 11 15:51:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:51:49.262480 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: DEBUG nova.api.openstack.wsgi [None req-6279f16a-7eb7-4af3-81db-59c36011ca68 tempest-TestVolumeBootPattern-1049221927 tempest-TestVolumeBootPattern-1049221927-project] Calling method '.version_select at 0x7f16be951430>' {{(pid=116903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 15:51:49.267246 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6279f16a-7eb7-4af3-81db-59c36011ca68 tempest-TestVolumeBootPattern-1049221927 tempest-TestVolumeBootPattern-1049221927-project] [764c30ef-950b-4f08-b00b-9eb424ae5af1] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 11 15:51:50.272555 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO oslo.messaging._drivers.impl_rabbit [None req-6279f16a-7eb7-4af3-81db-59c36011ca68 tempest-TestVolumeBootPattern-1049221927 tempest-TestVolumeBootPattern-1049221927-project] [764c30ef-950b-4f08-b00b-9eb424ae5af1] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 53836. Jan 11 15:51:50.350831 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO nova.api.openstack.requestlog [None req-6279f16a-7eb7-4af3-81db-59c36011ca68 tempest-TestVolumeBootPattern-1049221927 tempest-TestVolumeBootPattern-1049221927-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1763941462" status: 202 len: 0 microversion: 2.1 time: 1.093115 Jan 11 15:51:50.351436 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: [pid: 116903|app: 0|req: 1112/2474] 10.222.0.52 () {58 vars in 1262 bytes} [Tue Jan 11 15:51:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1763941462 => generated 0 bytes in 1094 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 15:52:45.264317 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:52:45.264735 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: Tue Jan 11 15:52:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:52:47.059149 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:52:47.059789 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: Tue Jan 11 15:52:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:53:00.610833 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:53:00.611464 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: Tue Jan 11 15:53:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:53:14.705422 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:53:14.705955 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: Tue Jan 11 15:53:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:54:25.367805 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:54:25.368511 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: Tue Jan 11 15:54:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:56:05.273041 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:56:05.273470 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: Tue Jan 11 15:56:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:56:07.066765 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:56:07.067392 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: Tue Jan 11 15:56:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:56:20.619879 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:56:20.620545 dv-cinder-824187-2-iscsi devstack@n-api.service[116902]: Tue Jan 11 15:56:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 15:56:34.713583 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 15:56:34.714098 dv-cinder-824187-2-iscsi devstack@n-api.service[116903]: Tue Jan 11 15:56:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!